Some genetic disorders or developmental problems can lead to congenital infertility. However, such conditions can often be diagnosed prenatally or at an early age.