In mathematics a number is the actual quantity, and a numeral is the symbol used to write it, like '4' or 'IV'.

In linguistics however the quantity is called the numeral, so we speak of the numerals from one to ten being un, deux, trois etc.; because the term number refers to the grammatical property of being singular or plural (or dual or trial in those languages that have it).