Nurses at a hospital in Portsmouth, N.H. gave a newborn baby to the wrong mother to breast feed.

The Portsmouth Regional Hospital released a statement that officials there regret the incident occurred and there is an ongoing investigation to find out how the error happened.

The baby's father, who did not want to be identified, said he wants answers. The hospital told him and his wife that their baby was only given to the other woman for five minutes, but also admitted the baby was with the other woman long enough to breast feed.

The man is also confused as to why the woman breast fed the baby, when his baby is Caucasian and hers is half African-American.

"We point blank asked her, 'did you not know your were taking care of our baby?' and her response was, 'I thought it wasn't my baby, but I didn't want to sound crazy so I didn't say anything,'" the man told television station WMUR.

The 29-year-old father told the Portsmouth Herald that his baby must now be tested for hepatitis C and HIV, since there is a slight chance those diseased can be transmitted through breast milk.