Device not charging or Staying on.

Hi, I have a Gameboy Advance SP- AGS-001 with a AGS-002 charger. The gameboy hasn't been used in about 17 years LITERALLY! The battery doesn't show any signs of corrosion or bulging. Looks brand new still. When I plug the charger with the gameboy off, The charging orange light flicks on and back off instantly. Does it everytime I plug it in. AND when I plug the charger in with the Gameboy switch ON. The system comes on for a second loading the gameboy logo and cuts back off and on back to back. Off,On,Off,On,Off,On...ect. Could it be something simple before I sell it for junk?