Controversial plans to redevelop Fairfield Halls in south London have been approved despite objections from former staff and hundreds of residents.