“It is a most mortifying reflection for a man to consider what he has done, compared to what he might have done.”