The problem may arise if they decide to come after you for the domain, when their name is involved, especially if you’re sending the traffic elsewhere.
What court or jurisdiction that would be involved I have no idea, but it could be a headache. If you have such a domain, you may want to trying selling it to them, rather than losing money or sleep over it. If you have considerable, quality traffic, it is a very good selling point.