Yes, there are disadvantages to using engines that big. They're heavier, they're more expensive (to buy, to get parts for, to fix, etc etc), and they're probably complete overkill for a kart.
To make the most of an engine with that much power you probably need suspension and much, much bigger...