Any way to repair the pairing button?

After dropping my A Series case a few too many times (the smooth, round shape of the buds does not lend much grip friction to the case...) the pairing button on the back of my case has now found its way pressed and stuck into the oblong cutout shape of the case.

I've tried to finagle it back into place with some small tools, but I'm probably just making things worse. Any suggestions on how to fix?