Singers down the years have been drawn to a mysterious track written by a man who turned his back on music