Okay but... a lot happened between 1810 and 2013. To the point that what happened in 1810 has long since ceased to be relevant. I mean, I assume you're talking about national debt here right? As in the government debt? Here's a graph:
The site looks either partisan or just bonkers but the graph seems fine. I'd say that looking at anything pre-WWII at the earliest is a waste of time. Recent trends in the deficit seem to have started around the Reagan era.
---------- Post added 2013-03-22 at 01:30 AM ----------
The key thing is the budget deficit - ie whether the government is making a surplus so it can pay down its debt or a deficit so it contributes to it. Same as making your credit card payments really. Last time the budget was in surplus was under Clinton:
Again, sorry that the site is partisan.