My USB port on my Xbox 360 is missing a peice?

I pulled on the controller and it disconnected. now nothing connects to it right so I looked in the port with a flashlight. The side that works has a black plastic piece on the metal prods but the one that doesn't work doesn't have it. I looked on the floor but couldn't find it. What should I do?