Is this a crossroad I have reached?

School is starting again, and I confessed something to a friend yesterday that I thought I would never tell a living soul. When asked if I would join him at college this semester, I told him no, that I was scared.
Being a true friend, he offered his aid when the classes got difficult. I then told him that it's not the classes I fear, but the people.

I don't know why, but large groups of people intimidate me. When I first developed my heart condition the Dr. gave me Buspar, because he noticed that the only time I really got upset was around groups of people. So he put me on a social anxiety drug. I took it until the condition subsided. I haven't taken it for several years now. However, I am scared to death of public places.

What should I do?