Riding a bike works because of gyroscopic effects from the spinning wheels and the rider's balance. At speed, the angular momentum helps keep the bike upright.

That's why it's hard to balance a bicycle standing still but easy once you're moving.