Use a spudger or a clean fingernail to pry the battery connector up from its socket on the logic board.

Bend the connector slightly away from the logic board to prevent it from accidentally making contact with the socket and providing power to the phone during your repair.