We didn't have a honeymoon, I had to leave the day after we got married

At our 1 year anniversary though, we rented a cabin up in the mountains for a long weekend
http://www.hotspringstreehousecabins.com/index.htm It was really nice. There's a really old cemetary right next to Cabin #2 (the one we stayed in) We spent about half a day just wandering around the cemetary reading the headstones. The most "recent" markers are from the 1920's IIRC, the oldest ones are from mid-1800's I think. (it was a while ago).
Another nice North Carolina spot if you're a beaches and pirates lover is
Ocracoke. Its remote, there's no chain fast food or convenience stores (island by-law, they're not allowed) but its absolutely gorgeous. We've stayed at Black Beard's Lodge, (it's ok, but if you can find something else, go there) as well as camped. We got hit with storms both times, and the time we were in our tent it fell down around our ears at aroud 2:30am. We spent the rest of the night in the truck, with Bruno under the truck and George inside with us.

Bruno wasn't at all amused at having the tent fall down around him, and prefered to be outside. We need a better stormy weather tent