From losing his son at the start of his term to getting rejected by his own party, Pierce would go down in history as one of the worst presidents.