When inserting a replacement GPU, ensure that the base is lined up properly with the appropriate slot on the motherboard.

Once the replacement GPU is lined up, press down until you hear a click or can see that the locking tab is flipped up again.