I can sympathize. My own British accent fares a lot better if there aren't any Americans or Canadians around. (As I proved repeatedly this May, when I kept being tossed into mixed company. But when left alone with a Brit, I was told I didn't have much of an [American] accent at all.)