How to remove the magnet from a speaker?

I have tried both heating and hammering as suggested by various websites, with no luck. I have also tried various substances to dissolve the glue, which dissolved the visible glue but does not work on the glue in between the magnet and the metal plate. Help! I could try MORE heat, but am wary of reducing the magnets strength.