The prefix giga- was derived from Greek gigas "giant", to which our giant and gigantic are kin. The current American pronunciation of this form with a hard g masks that origin, but Merriam-Webster lists soft g as preferred - "jiggabyte", etc.
I suppose this is an example of unconscious synesthesia, or sound symbolism, because the hard g is felt to be more appropriate to something large and impressive.