Are you breaking any laws? If not then you shouldn’t be worried, course that doesn’t mean they still cant or wont hassle you.
One thing I know for sure, worrying wont get you anywhere; only make you lose your hair and die an early death. If they are going to come get you; they are going to come get you; nothing you can do; so why worry?