After opening, push forward the battery and lift it up while holding the ring on the controller with your other hand.

You can also use the top of the cover to push and lift the battery if you don't have an opening tool.

Recycle batteries properly.