Combustion engine efficiency is limited by hard physics and modern day combustion engines have gotten impressively close to that theoretical limit. So no, the remaining potential of ICE is not that great anymore.

Actual efficiency of BEVs is way better than even the theoretical limit of ICE.