It raises so many existential questions for me too! Yes, I do believe that the die-off is going to mean that families like yours will be able to set up homesteads on some of the best land in the best locations. Any able-bodied people with children who grow up and have the ability to have their own children will be in an enviable position, much as it was in the Renaissance that occurred after the Black Death. JMG has at least one novel, I believe it is Star's Reach, where part of the backdrop of the future society is the notion that fertile women have a great deal more decisive power because infertility is such a problem.