The actor said he is not healing quickly enough from a shoulder injury to assume the "physically demanding role."