Speaking from personal experience, it's to be expected. I had a properly set up Comet 40 in good working order, good and correctly sized belt, and all running gear properly maintained and in good order. Even though the engine and driver is not turning while the kart is being pushed, you can expect extra resistance brought upon by trying to spin the jackshaft with the added gear multiplication.
That said, it's a "feel" thing. if you don't know how it should feel, or it feels harder- by al means, check that stuff.