Is there a trick to this? I'm pulling but afraid to break the levers?

They just pull off... I have a small pair of needle nose with a 90 deg bend in them that I use to come in from behind...

thanks, i just wrapped the knobs in electrical tape and yanked on them, I was just afraid my already repaired lever would break again