Can I link my site to other sites (and other sites to my site)?
Yes, its very simple to put a link from your site to someone else's website.
The other way round requires a change to the other website. The webmaster managing that site will have to assist with that.