I like Deeply Dippy's response. The scenario is an abstract concept constructed to suit some purpose, posing a philosophical dilemma.
My "simple" response is to say, save the child, leave the frozen embryos. Why ? The child is a living person. The frozen embryos are not. There is no certainty that any of the frozen embryos will become people, a possibility is not a certainty, countless things could prevent the frozen embryos from "becoming" people. Simply removing them from the "storage system" could lead to them being damaged.. Loss of refrigeration etc.
The child is "real", there's a risk in attempting to save the child, the risk of failure increases significantly in the scenario if you attempt to save more than the child.
So as a simple balance of choices and risks..least risk to self is to leave the child and get yourself to safety. Some real risk to self is attached to attempting to save the child, but there's a significant possible reward..saving a child. Trying to do more increases the risk to self and child. So in my view the "reasonable humanitarian" choice is, try to save the child.
I can't see why this is apparently regarded as such a difficult "philosophical dilemma". And there's other possibilities with this scenario, eg, can the person facing the choice hear fire engine sirens, hear or see firemen rushing into the building ? Is there a fire extinguisher handy ? What are they wearing..clothing that offers them some protection against the fire, or nylon shorts and a polyester shirt ? Are they a fit, physically capable person, or grossly obese with severe asthma, or physical disabilities ?