Yes, it is possible for a permanent magnet to lose its magnetism. ... If you heat a magnet up a little bit, it will lose some of its magnetism, but on returning to room temperature [depending on how high it was heated, and on the shape of the magnet itself], full magnetism can be restored.
