Absolutely agree. Dusting a car between washes will surely introduce micro scratches in your paint...if you have clear bra, that's a difference story. The film can take that abuse.
Your best bet is to apply a nano coating, even if it's a simple nano spray sealant like CarPro Reload. This will prevent dust from attracting to the paint, nor completely, but enough where you can rinse with DI water and a pressure washer, and you're clean again.
CA duster, detail spray wipe downs, etc. are a guarantee ticket to an expensive paint correction.
IMHO, wiping a dirty car down is like using a baby wipe instead of a shower. They each may get the job done, but only one is actually CLEAN.