Bathing newborns sometimes makes parents nervous. Until the umbilical cord falls off, you should only give your newborn sponge baths. Be sure to use gentle soaps. Since newborns do not get very dirty, you only need to bathe them two or three times a week.