It's not been a problem so far for me and my wife.
Wife is us citizen, I'm British also!
We got married last January in the USA, the day before I left for the UK. Like you, I had other commitments back here in the UK.
So far, we have only had one delay in the process, where a lawyer failed to pick up a mistake on the affidavit!
I've just received my interview date today! Interview is end of January. So will give you a rough timeline of the process.
And yes, long distance really sucks, but don't worry, all will be fine. Everyone on this site has been brilliant at answering any question I've had about the process! So please any questions ask away!