How can I give back my social security number and stop participating in this system?

You could apply for citizenship in another country but once you accepted the SS#, you can't give it back.