Think in terms of each beneficiary's stack being able to stand alone, so yes to both your birth certificate, any divorce decrees, and the marriage certificate. For each stack, also include your wife's first marriage certificate, and divorce decree. Those will document the name change and are needed anyway.