The wall of the container pushes the ball bearing in the centripetal direction, causing the ball bearing’s velocity to keep changing its direction. When the centripetal force dissappears (when container is lifted), the ball bearing continues at its current velocity (as according to Newton’s 1st Law), which is in the tangential direction.