The Glee star will perform between Jonathan Groff's final show and the beginning of Jeremy Jordan's run.