The people in the Southern US. They have lived their lives surrounded by slavery being norm. Also, slaves produced a lot of product for the south, and they would not want to give that up. Finally, many of them held racist viewpoints because they were taught that they (the slaves) are not human and do not deserve to be treated as such, and they would be apprehensive about giving them equal rights.
