knock the spindle out if its still in, and i just put a massive screwdriver through the whole ( must be a biggy, as it needs to be broad enough in its head to not dent into the bearing)
make sure its on right on the edge of the bearing so as to not puncture it, and knock it out with a big hammer...
unless the frame is particularly fragile, it will be fine...
the bearing is taking the beating, and not the frame see.
if your not using the bearing, dont even bother about being on its edge, just make sure the screwy is against it and give it a mighty wack.
job done.