There was a concern that with the increase of representation in Southern states once the three-fifths compromise was no longer in effect would make Southern states more powerful. The Republicans were afraid that the increased Democratic representation from the South would do away with many of the liberties granted to the African-Americans after the war. This Amendment was an attempt to discourage this.
