The downside of EGR is the additional soot load that is added to your oil. That's why CJ 4 oils are specified. They contain additives that are supposed to be better at holding the soot in suspension between oil changes. Other properties of CJ oil are related to removal of anti-wear agents such as sulfur and zinc in an effort to reduce emissions. If you can find API CI rated oil, it will offer a better additive package with no negative effects on the EGR system.
Also, if the EGR system is cooled by the cooling system of the engine, the possibility of a cracked heat exchanger can lead to cooling fluid being introduced into the cylinders, with obvious negative results.
If your EGR system were to become inoperable through a defect or loose wire or blocked hoses, your engine would probably be better off in the long run.