Actually the word 'Amen' is Hebrew and was 'borrowed' and christianized it from Jewish prayers.

It's quite common in the Hebrew Psalms, and when the book was translated to Greek and from Greek to Latin and from there to the other European languages, they just didn't bother to translate it and used a transcript.

Various other words were treated the same.