what they said, plus this:
The roller weights sometimes jump the track they are on, keeping the moveable sheave from closing all the way.
I thought some of my engines idled just a tad bit too high, but it was actually the springs wearing out, letting the drive unit partially engage under idle. Was barely noticeable though.
My guess is that you have a bunch of crud in the drive unit, just like everyone else is saying. Also, google "comet belt chart" and double check your center to center distance.