OK, got about 2/3rds of the sleeve out with the help of some side-cutters and a screwdriver. What's left in there looks really melted on.
I think I will get a new coil and maybe work away at this one later. I might be able to file what's left of the sleeve down, but I am not that patient right now.