Assuming no distinct damage is on the charger (i.e fraying of the cord), it's probably just the adapter. If it overheated I would of suggested the freezer trick to see if that would work. (You could still do that if you want to. Just put the charger in the freezer for an hour or so, take it out, and see if that helps.) Other than that, you're just gonna have to take it to the apple store. If it's bad they might replace it for free.
Search around google and the forums for your problem though. Someone might have had this problem and fixed it.
@Charity M. Lewis I've switched around outlets, and unfortunately I get the same result. The charger doesn't really get insanely hot; I would say it reacts normally.
Search around google and the forums for your problem though. Someone might have had this problem and fixed it.