Screw "covers"

Has anyone ever removed this clear thing that hides the screw?  I removed the brown, male knockdown cover.  Then I removed the screw.  I thought that would allow me to remove the clear, female part in the picture but it won't come out.  Are they glued in there?  I worked slowly around all sides with a thin blade trying to ease this thing out, but it wasn't budging.  Before I pushed too hard, I thought I'd ask you very smart people!  Any suggestions?  (I will of course put the screw back in once the clear thing has been removed.)