From the topside...
Maybe tap the wedge down with a punch, then thread some kind of bolt into the center hole of what remains of the stem, then vice grips on the bolt along with a gorilla grip to get it out.
From the bottomside...
See if there is a way to tap it out from underneath, even if you have to drill a hole to access it.