Hi Pattu-Rani,
Sorry to hear you are feeling discouraged, and I hope I didn't contribute to it!
I think bszoom42's advice is very good. I'd get those affidavits... as many as you can.
I don't think your intentions are going to be in question. Everything about you indicates a sincere, sustained interest in the region, the religion, etc... that I doubt is typical of a scammer. I think what the Consulate will be interested in is anything that sheds light on your husband's intentions. To this end, anything that shows effort on his part will help, imho. Hand-written letters, cards, packages, documented phone calls that he paid for... stuff like that. That's just my opinion.
The travel together, I think, is excellent. Who said that doesn't count for much?? I would do as bszoom suggests and document where you went, when, and with whom, and include photos. A little album to submit with your package to the Consulate, I think, might be in order. You want to PERSONALIZE your submission, imho. Tell your story a little. And be sure to review all the dates etc... with your hubby so he doesn't give conflicting information at the interview.
And if there's a line on your petition (like there is on the I-129F) about how you met, tell the story there, too. Write a page or two (everyone here said no more than a page... well, I wrote a page and a half because that's the shortest I could make it... you can probably see from this post I have a problem keeping things short....

).
And if you run into a snag at the Consulate phase (I think you will breeze through USCIS), you want to be on it like white on rice. Immediately. And by all means possibly: email, phone, fax, even in person if possible. Call out the Senators, Congressman/woman, National Guard, the Girl Scouts. Everybody. That's just my opinion. When I faxed the Consulate (when I found out S's interview was the next day and I couldn't be there as planned), I put all my contact info on the letter (two phone numbers, a fax number, and two email addresses, including my work email addie which happens to end in .gov) and asked them to please call me immediately if there were ANY questions or problems. I wanted them to know I was going to be VERY PROACTIVE.
So, that's just my $ .02. I think if you massage this thing, it WILL go through. Heck, it might sail through with no problem at all. But your best bet is to throw everything you have at them (in a nice, slightly mushy, feet-not-quite-on-the-ground way), and be ready to follow your petition through NVC to Ktm, help assemble packet 3, and be available for anything the Consulate might need to feel comfortable issuing the visa.
And don't forget Ganesh... maybe a little cheese for his mouse, too.
hugs,
Maya