Inflated balloons have rubber under tension, wanting to contract. When you prick a balloon, that tension releases catastrophically - the rubber tears rapidly, making the pop.

Small holes might just hiss as air escapes slowly. Big holes cause rapid tear propagation.