The White House on Thursday notified Librarian of Congress Carla Hayden that she was removed from her position, a spokesperson for the Library of Congress told CNN.