Yes, your husband can apply for a F2 visa to come to the US and stay with you. He can apply for the F2 visa at a U.S. consulate in his home country. The fact that you have adjusted your status from a Tourist (B1/B2) visa to an F1 student visa, and don't have an F1 visa stamp on your passport should not impact your husband's ability to apply for an F2 visa.
Visitor Visas exchanged to Student F1 within US - Can a bring my husband with F2
in Student & Exchange Visitor Visas
Posted
Yes, your husband can apply for a F2 visa to come to the US and stay with you. He can apply for the F2 visa at a U.S. consulate in his home country. The fact that you have adjusted your status from a Tourist (B1/B2) visa to an F1 student visa, and don't have an F1 visa stamp on your passport should not impact your husband's ability to apply for an F2 visa.