Anemia problem with iron

I was wondering if its common to have problems with oral iron. I am taking 2 iron byglycinate chelate pills to maintain my anemia and currently having hair loss, diarrhea, dizziness, anxiety and had labs a few months ago and all was normal. Awhile back this happened when I took iron to maintain my anemia and my labs were normal and I stopped and the problems went away. I worry about stopping because I don't want the anemia to come back???