You will surrender your green Card on the day you take the oath....no exceptions. You, then as a US citizen, will need a US passport to exit the US. In your case, you should be able to get an emergency passport appointment soon after taking the oath (maybe same day). Thus, a passport could generally be issued within a day or two, imo.