I live by the german border. Here in Eupen everyone speaks german, YET we hate it when we're mistaken for someone from Germany. I suppose you have the same feeling if you're near France.
Yet I suppose since last year's World semi there are strong feelings towards France. Don't forget that you're giving them right by doing so.