I was intentionally looking for a smaller, lighter SxS when I was shopping. I have a tractor for the heavier jobs. I wanted the SxS for when the conditions are a bit too wet/soft to take the tractor out without damaging the trails, or for when I just want to zip out and take care of smaller jobs (or fell trees . I have a polar trailer I used regularly with the Pioneer 520 that is a good match. If I need to haul more than that, I get out the tractor with 3 pt hitch logging winch or haul my dump trailer or log forwarding trailer.
The Pioneer 520 has been a great match for my needs. It's rated to tow 1000#. I still do that (including on my rolling hills) even with the 27" tires. Stock tires were 24", so my 27" tires would increase the top end speed by 12.5%, but decrease torque by the same amount. I've never driven it with 24" tires, so don;t have much to compare it with. I suspect it doesn't make much difference for my uses: if the load is too much, a lower gear takes care of it.
Having said that, If I were buying new, I'd just run the 24" tires for a bit and see how I liked it. I suspect I would miss the greater ground clearance. The stock set up for my 2022 P520 is 8.5". If I were setting it up myself, I'd probably have gone with 26" tires, but I've had no problems with the 27". There is no rubbing in the turns (though some of that is helped by the spacers the previous owner installed).
If I did not have the tractor and were trying to "do it all" with the SxS, I'd probably have gone with a larger unit rated to tow more.