Ok, after weeks of no time, I finally got around to dealing with this. Thanks for the tip on the tool. I didn't want to spend the money on it so I came up with another idea, by using the "handles" of a jumbo binder clip. I just pinch it in to remove it from the binder clip, then pinch it to insert it into the power port and then release and the tension does essentially do the same thing as that tool.
It turns out that it was the power port itself that was damaged and replacing it solved the problem. So now I'm wondering why the power port was damaged before the fuse blew. As I said, I was using a handheld car vacuum, that uses the powerport in the car for power. I had the engine running when I was using it and then all of the sudden the vacuum stopped. When I unplugged it, the vac's power cord plug was very, very hot, to where it could've burned my hand had I held it tight enough. I don't know enough about electronics/power but I assume that means the vac was drawing too much power, more than the car could handle. But I would assume the fuse would be the first to go and not the port itself?