An expression of unknown origin that means "right away", as in "as soon as was possible", or you didn't waste any time doing it. For example, if you told your significant other that you loved them right off the bat, you would be doing it on the first date, which is generally a big no-no.