Comedian said his 'unspeakable crime' was recommending Dave Chappelle's controversial Netflix special