Ok, so against EVERONES advice, I replaced the band and sanded the drum.
It was pretty tight so I adjusted a bit and although it was rubbing the drum it wasn't too/overly tight against it.
I took it for a spin and it worked really really well for the first couple stops. Then something...