You should be fine. I don’t think twice about changing hosts. It doesn’t seem to make an ioda of difference long term – as long as it geolocates to the same country.
If your site is about uk and you change to us ip that will make a difference.
Reply To: Dedicated IP address