Joysticks are about the oldest way of interacting with arcade, and home, games systems. Joysticks were originally the ones straddled by pilots in helicopters (much bigger) and the name then originated from the slang term for something else that may stick out from between a person's legs.

Maybe the phallic similarities are more deep rooted than thought...