Sounds like you are defining Agnostic. Doesn't matter. Atheist or Agnostic, they reject or dilute God by casting doubt.
No one can take away our rights because it is God-given and universal, true at all times and places. You have missed this point. Without God, there would be no such thing as declaration of human rights.
God gives rights, humans enforce them, or can violate them. United Nations only spelled out the rights in a document. There is no guarantee United Nations will exist. There is no guarantee any government will exist. If we are under a government, society, or individuals who want to violate human rights, and we are not the right race, ethnicity, or religion, then we are in trouble.
Without God, in an atheistic world, there is no reason why humans couldn't behave like predatory animals, i.e. survival of the fittest. We are a unique species among the millions (because of God-given moral consciousness). So, the word God has a practical purpose which anchors us in morality.