I have never met such a person in my life. No one likes to be stolen from, even if you say “I stole this from so and so.”
Who said anything about stealing? Most newspapers have policies published online or you can ask.
http://www.copyright.com/Rightslink/Default.asp
As far as “non news” site content – you can ask and usually get permission. For instance the wizard of odds has habitually given permission to copy IF you link.
There are advantages to producing unique content and letting people use it if they link.