Getting off Cymbalta and trying to control anxiety naturally.

I am 70 year old woman and I have had depression over 35 years. I was diagnosed with clinical depression and I suffered a traumatic brain injury 46 years ago. I decided to get off celexa that I was on for almost 40 years. A doctor had me on busiprone as needed, then I used it every 8 hours to get of Nortriptoline which gave me pains in my heart. Then I got on Cymbalta 3 months ago. I was on 60 mg for 2-3 weeks and it was too much then got on 30 mg for about a week then 20 because after I took it I was weepy, very sensitive and my husband was not allowed to talk to me for 4 hours then I was better. So I have been on 20 mg for 3 weeks and I feel heavy headed, and not interested in my normal life, I stay in my bed and read unless I go outside and do gardening. So I feel horrible and want to get off of it comps and try to handle my anxiety naturally. Any advice would be appreciated!!! I went to a nurse practitioner who wants to give me 1 or 2 Prozac then just stop any. Will that be enough to get me off it smoothly??