There's a theory that if you mount the ground in the up position it is harder for the cord to fall out when plugged in. Every notice a 3 prong cord leaning down and the top two blades are exposed in a gap?
Also, something like a metal paper clip could fall into that gap and short the two blades together. That can't happen if the ground is on the top.
At least, that's how it was explained to me. When I replace outlets, I put the new one's in the same way they came out.
Same thing was explained/taught to me, same reason, a very long time ago when I first started learning electrical installations. My step-dad was still old-school enough he cut the ground prongs off extension cords or the raised bumps on two wire cords that prevented reversal of the hot and neutral. After being nailed by older drills and other equipment a few times, I finally decided maybe electrical engineers knew a little more about it. So I became one. There's also a reason for one wide blade and a narrow blade, and the colors of the screws do have some to do with how it's wired. Most know these, but beginners do not, and more often than not, get it wrong.
If a paper clip falls between a partially engaged plug and the outlet, it's a direct short circuit, and will make a VERY loud bang even at relatively low currents. If you're lucky, there's a GFCI or AFCI feature on that circuit. If you're not, you're likely replacing the receptacle and faceplate. I usually fall into the latter category when my luck goes awry. If the ground prong is turned up, it will typically deflect the paper clip to the side. All that said, though, look at the way a GFCI outlet is designed. If you mount it with the ground prong up, the "TEST" and "RESET" buttons are upside down. Rarely will an inspector say anything about the orientation, and if there were 5 different ways to do it, you'd get 5 different opinions about the ONLY way to do it. I've seen contractors in hospitals have to go back and flip every outlet they installed because the hospital RE wouldn't approve the job until they were oriented "his way". I prefer the ground prong up, but I'm OCD enough that I don't want any text on the faces of the outlets upside down either, particularly stuff like GFCI or AFCI outlets.
Strangely enough, in a shed build I'm currently doing, I had exactly this conversation with my son just a couple days ago right after I finished the permanent electrical work.