Trouble is the area surrounding gets mashed and forms a lip over the caps.
Either gotta drill a hole in them then prize them out or get a small screwdriver down the side.
I broke one of mine but they had holes in them already, got a nice shiny new pair.