as Kartorburst said.. that will certainly shred your belt very quickly..
the idler should run on the "outer" the reinforced side to prevent chewing it up for no reason..
then again you run into belt length issues quickly..
or more precisely you are prone to touch the reverse running belt (which is a big nono

)
And as Tpdingo said you'd need to lock the lever in place at a set position somehow otherwise it'd be hard to hand on to it for very long..
and worst: you must not set it to a fixed position
A TC pulley works because of two variable pulelys...
and that's NOTHING to do with belt length I'm afraid..
The driver wants to shift up as soon as it's clutch is engaged...
it constantly tries to pull the belt into a larger diameter on itself (and thus a lower diameter on the driven)
The driven is the the "governor" part of this equation..
if it sees little to no counteracting force on the chain it allows the driver to force the belt in some lower orbit (shifting up, spreading it's sheaves)
but as soon as there is a fair resistance on the wheels (and chain) it works against the driver and collapses it's sheaves as hard as it can until it reaches an equilibrium state.
[that's the main reason for your belt wear in a setup like this]
let's asssumey you set your levers to the intended ratio,
now you go downhill, all of a sudden the wheels have much less resistance, the pulley spreads, the belt slacks and in fact is likely to jump off before you can even adjust the lever
to reapply tension.
And the other way around is almost worse...
Nooow you say you could rig up a spring (or rubber band) loaded system on the lever to
balance the idler tension to exactly the needed equilibrium, so the lever shifts up when it can and down when needed..
True but then all you did is build a TC setup with a reduced amount of variance,
by removing one of the variable pulleys.
So, let me suggest some two stage layout instead:
First a 1:1 fixed pulley layout from the engine to a jackshaft.
(lever actuated clutch if you like, but I guess a manual clutch causes less powerloss..
anyways....
ON that jackshaft (spinning at the same rate as the engine now) you have the TC driver (powering the driven just as the fixed pulley you wanted)
Now in order to disengage the TC completely you can disengage the jackshaft,
all variation however is still left to the TC and you can only switch it on or off basically
While I like the idea of the diff (Peerless 100 btw

)...
the problem is the overall speed is fixed
and if one wheel is stopped the other one will turn twice as fast as it would at the same engine rpm when both turn.
Viable but awkward to control I bet

Also you'd wear out brake pads quicker than you'd want...
'sid