To give up. To surrender. Comes from the sport of boxing. To end a match, a manager can throw a towel into the ring indicating surrender much like a white flag.