It will pull off but may take some damage in the process. The metal shaft under has some ridges for the plastic to grip. You have to get under the edges of the button and pull. The replacements are cheap so don't be too worried. Just don't ding the chrome. You can get new buttons from most first gen suppliers.