With the charging rail facing away from you, open the the Joy-Con like a book.

Don’t try to fully remove the back panel yet. There are still two cables connecting the charging rail to the motherboard.

During reassembly, make sure the SL/SR cable is lightly bent under the battery compartment before clipping the two halves of the joy‑con together. Otherwise, you might crease the cable and damage it.