Reading the OP again, I would say that it's probably just the stress of adjusting of living together and being married that is the problem; BUT the fact that you are already wanting to move back home and get divorced says quite a lot about how you feel about the relationship.
Relationships, marriage in particular, need WORK to get through bad times, otherwise you'll never make it through anything! It's only been a few weeks... I would never simply give up and consider moving back after all the times we've shared.
In analyzing my first failed marriage from the very first time I met my wife, our dating, marriage, not saying it's either her fault or mine, came to the conclusion that we both had an IQ of far less than three and should have never been married in the first place. Always arguments and fightings, on the basis of it takes two to argue, took the position that I would not argue back, it's a hell of a way to live. Yes it took work, years of professional and religious counseling, and blinded by all this, didn't pay attention to the damage that was being done to our children.
Another hard lesson I learned was family interference, swore I would never interfere with the lives of my kids. After eight years of paying off huge divorce bills and raising my kids, felt I was in no position to seek a new mate, but got debt free, even a couple of bucks in the bank, and just my dog and me living alone in a big house, but was still bitter about women in general. One day my son comes home with a new girl friend, gee she was terrific, they are happily married now, but maybe I should give this one more chance. Did join several singles clubs, lots of prospects out there but you don't find virgins at my age.
Narrowed the field with divorced women with children with joint custody, that never works, friends that went that route had a grand central station for a home ending up in another divorce. But my key parameter was to find a woman that I would never want to change, maybe I met hundreds of women, maybe thousands. Talk about work, it's a lot of work to find the right mate and if it gets to be work, it's no longer fun. Funny thing about fun is that you can expend a lot more of your energy having fun than dreary work, but still have plenty of energy left, but dead tired after work. Said the heck with finding a mate, but by some miracle, and it is a miracle, met my wife. Can't described it, but from the very first moment, knew deep inside she was the right one, and she had the same feelings about me. And when I did ask her to marry me, she said yes almost before I finished the question.
We had our problems, but somehow we could talk about these, never had an argument, sometimes she came up with an ingenious solution other times it was me. I tease her about home decor, given her 90% of the vote, but she has given me that with the finances. She put me first in her life, and I put her first in my life, that is the way it should be, and after over six years of knowing her, still have a list of zero things I want to change with her.
Worse part of our life was dealing with the slowness of the USCIS, over a year before I could bring her here, and when ever there was a riot in her country feared for her safety, hours turned to an eternity until I could finally contact her to know she was alright.. That is the bad part of being in love, get that terrible pain you never had before. Even told myself that many times. But the joy of seeing her smile every morning with still strong memories of when she wasn't here.
We do have very different tastes in music, took her to a rock concert Friday night, ha, I am one of these idiots that composers went downhill after Beethoven. She said she would go alone, said no way, I am taking you, it was a pure joy for me to see how happy she was, but shouldn't mention the reward I received when we got home. That is the way a marriage should be and to read about fights or having to work on it can only lead to one spouse looking elsewhere. While I was faithful to my vows in my previous marriage, was sure looking elsewhere and perhaps dreaming about it. Shouldn't be that way, you should only covet your own wife or husband. And it can be that way if you meet the right one.
We are at the close of our USCIS journey, ha, wondering if we can live without them in our lives, they sure have been a strong part of it.