SUPERCB you are the man!
I drilled two holes on both sides and it snapped right off when I gave it a little torque with a screwdriver. Thanks for the info. I would suggest this to anyone who has this problem. I started with a small bit and got as close to the center of the collar as I could and then just stepped it up in bit size till it looked like I was finished, then I took a screw driver and twisted in the hole and it snapped the outer steel sleeve. I then just pulled it out and I was done. Thanks again everyone.