Worried Sick....Have to go see the fertility doc again...?

Ok... a few days ago I had my first visit with a fertility doctor who is one of the best in our area. He explained to us before the exam what he was going to do and the first course of action was going to be to take a course of Provera (to start my period) and then come back in on "day 3" for some bloodwork. He also said he would put me on Clomid again (I was on it with my OB/GYN with no success) and he would do an ultrasound to see if I was producing any follicles. THEN, we went in for the exam in which he did a transl ultrasound and pelvic exam. His resident istant was performing the ultrasound when she stopped, handed the probe to him, he froze the picture a few times, then told me he was having a hard time seeing my ovary. Then told me to go get my blood work done right then instead of waiting for my period to start. I got the bloodwork done and even the nurses were not sure why he ordered the blood draw that day. He just said to treat it like a "day 3" blood draw. I was told to start the Provera and call on day one of my period to schedule a hysterosalpingogram. He did not give me Clomid like he had originally said before the exam. Today I got a call from one of his nurses saying that my labs came back and that he wants me to come in and discuss them before we proceed any further. She did not know anything other than that. So I go in this coming Tuesday to see him. I am worried that he found something like a poor egg reserve or something like that and that it is bad news. I only have one ovary and I am 39. I am so afraid that I will not be able to have a baby with my wonderful husband. Has anyone had this happen? What could be the issue here? I am on day 25 of my cycle and started the Provera per his order. Any ideas?