No no, Middle Earth is meant to be the whole of Eurasia and Africa. Only the north-west of Middle Earth is meant to be Europe and the Shire Britian. (I like to think of the north Farthing being Scotland
) There were 'swarthy' Easterlings and I'm sure he talks about black men from Harad, from the 'burning heats' down South.