Is this a good reason to switch doctors?

My current obgyn will not prescribe a medicine that I feel will help me become pregnant (clomid) .. he knows my history of having a previous ectopic (I lost my left tube) and irregular periods since. I also dont feel as I ovulate well on my own. He feels as I should jump straight into IUI or something more invasive.. but I dont want to do that just yet. I want to try clomid and for some reason he just wont prescibe it. I honestly feel as though it will help me alot! And if I am monitored with ultrasounds I can see if I have been ovulating from my good side . and if pregnancy will be possibly in a more natural way. I dont think he understands my concerns.. and this will be my second time asking for the prescription, if he denies me Im planning to switch to another obyn who will better assist me in starting my family. Do you think this is a good reason or am I over reacting?