Open the Joy-Con like a book, with the charging rail facing away from you.

Don’t try to fully remove the back panel yet. There are still two cables connecting the charging rail to the motherboard.

During reassembly, make sure the SL/SR cable is lightly bent under the battery compartment before clipping the two halves of the joy‑con together. Otherwise, you might crease the cable and damage it.