The thing that seems odd to me is, why would I want to link to them without my affiliate tag? That doesn’t make any sense at all.
On the other hand, if I am an affiliate, and am linking to them, then they should link back to me anyway because if my site does better it helps them.