A COVID-19 infected woman on Friday delivered a baby boy at All India Institute of Medical Sciences (AIIMS) in Delhi.