How can I set a product to have free delivery?

You can set a product to have free delivery whilst you are adding/editing the product itself.

Scroll to the 'stock & delivery management' section.

Locate the 'specific delivery price' field and tick the tick box that says 'free'.

That's it! Don't forget to save your changes when done and test to make sure its working as you expected.