Which Statues Should Go?

Many public monuments in the United States depict people who have done hideously immoral things. Almost all depict morally imperfect people. If we accept that some statues should be left in place and some should be torn down, what principles determine which should be torn down?