The museum was originally to be given three floors of a 21-storey tower block in the City of London.