Most DIY side links (made several myself) use the solid (rod) OEM link by cutting off the ends and welding them to the cylinder...The process is well documented in other threads here...don't recall anyone ever having an issue...!
So i had to think about it harder to figure out when it would or wouldn't cause any 'hole wallerin'..
The rectangular lower arms, having ball ends, should be able to allow an implement to 'tilt' while themselves remaining vertical or at least 'square' to the side link where it attaches to the arm.
However, if the fit from your ball ends to the implement pins is such that the implement can't tilt very much without something there contacting, that interference would rotate the lower arm into a 'bind' with the side link pin/bolt.
Or, if you had stabilizers that were actually tightened to keep the 3pt from swaying, depending on how those stabilizers were attached to the lower arms, they might potentially contribute to putting the lower arm into a bind with the side link pin/bolt.
Also, if one or both ends of a side link are 'angled' because the lower arms are further apart than the rockshaft arms, rotating that angled part the wrong way, or possibly installing the side link 'upside down' would rotate the lower arm into a bind any time the 3pt was lifted.
So i guess you're mostly right, that the majority of times probably nothing is happening that would cause that pin/hole interface to go into a bind and 'wallow out'. But i can envision many circumstances where it might and i bet plenty of lower arms out there have wallowed out side link holes in them.