I built my 40x60x14 pole barn while remote (~300 miles, so a bit less than you). I found it very valuable to make local contacts and gain referrals from them. The pole building contractor built for a couple of my contacts, I did all the DWV excavation and plumbing for septic and excavation for water line, electrical contractor was another referral, I did the trenching and conduit for power to meter as well as prepping for the transformer pad, insulation for walls I did myself as well as installing OSB as my finish for walls, ceiling was insulated by another referral, HVAC and plumbing was a DYI job. Inspections were either coordinated by the appropriate contractor or myself, depending.
Needless to say it took me a little over 2 years to get to the almost finished state that I’m at now working on weekends and vacations.