Replaced battery, orange light was on and then it turned off

Ok, I just now replaced the battery, installed it just fine double checked everything only two things that needed to be plugged back in. Closed the vita back up and installed the screws back in the order they were removed, psvita was placed on the charger for two hours + as advised on the card that came with the packaging, then I noticed the orange light had turned off so I removed it off the charger and held the power button and all I saw was the ps button flash very dimly with orange and blue and then nothing happened no screen light, or solid blue light on ps button, now when I place the psvita on the charger the orange light comes on for about a second and then turns off while still on the charger could the battery that was sent be defective?