Feeling very discouraged starting my 3rd round of clomid?

This is my third round and the dr said after this round (if it does not work) he will be referring me to a fertility specialist and my husband and I are not in the financial position to be taking on the extra costs of IUI or even IVF---feeling a bit disappointed and let down that we may have to take a break fir awhile. Anyone else in this situation