What I think causes a lot of problems with these things, step 1; define the scope/goal/budget, and then work from there.
What I mean is, function vs pretty; the $2000 fix or the $20,000 fix, are we wanting are low clearance corvettee to stay clean and not rub, or are we driving a suv/truck. I really think your material will be 100% fine, exactly the way you planned it, and I think adding additional fines is an unneeded expense, and could possibly make the material worse, dustier, and more prone to washing. It would, however, probably improve ride quality and appearance.