Test the sound output via amplifier, and then set it to zero.

Keeping the amplifier on with the guitar connected to it may produce unpleasant static depending on how loose the jack is. Make sure to turn it off before proceeding.