I guess it's how much you want "something like our world, with some magic for color and minor changes" vs. "our world for the maps and names, plus magic which run to change things a whole lot". I've been thinking about the latter, a springboard for adventures, you might be going for the former.
Re: Colonialism in fantasy