I think it's more that you need to exert force inwards to stop the ball from flying off at a tangent. The motion of the ball does not cause an inwards force.
A better example might be if you sit on a roundabout and set it spinning. If you don't hold on tightly, you'll be thrown off, not pulled inwards to the centre...

__________________
Spike
:)