Yup. I have a good friend who is the only African-American I know - born in South Africa and now a US Citizen - a true African-American, and he's a white as an Irishman.
Africa/America has to do with nationality - not skin color. I refer to blacks as blacks, whites as whites. Nobody has criticized me for it, and I will give this same little speech if anyone ever does.
Besides not all blacks come or are an ancestor of Africa. There are many other places where blacks are from.