With Old Masters, contemporary art and even restored Victorian public lavatories, the island is 'a secret hiding in plain view'