If your fibroid in uterus is too big to cause physical obstruction to the movement of sperm to the site of fertilization in the fallopian tube it may cause infertility.