Not at all! Plenty of people are doing it, just as long as the character fits the setting in the new TL then it's perfectly alright.
