"Itte kimasu" is Japanese for "I'm leaving now". You should probably use "Shitsurei shimasu." instead if you are leaving your place of work, to apologise for leaving before your co-workers.