Many sources say that it is a good sign that they kept your passport.
However, they took my passport after the interview, and it was mailed back to me several days later without the visa as I had to return to work.
You won't be allowed to enter the consulate by security, let alone speak to any of the immigration staff.