Many possibilities, some already mentioned. It starts when it's cold, but not when it's hot? No click or any starter related action?
If I were faced with that situation, what would I do? Wait until it does it again, then go fishing with a volt meter? With a hot starter on a hot engine, and behind a loader frame. By myself. Trying to reach the key with one hand and probe with the other. Probably not my plan. I would take a piece of 12 or 14 gauge wire, long enough to reach from the start terminal on the solenoid, up to the positive battery post. Put a ring terminal on one end, and attach it to the starter while the engine is still cold. Maybe test it by flashing the other end of it to the battery post just to make sure it works. Place the bare end somewhere safe but where I can reach it from the seat. Now start the tractor with the key and run it up to temperature. Whatever that takes until it won't start with the key. Now try the jumper wire and see what happens. If it starts, the starter and solenoid are not the problem. Start looking at neutral switch, start relay, related wiring and connections, etc. If it still won't start, then wait for it to cool down again and plan on pulling the starter.