I hate the term IRS Red Flag. If you aren't cheating on your taxes, then absolutely nothing should stop you from leveraging every letter of the law to reduce your taxable liability.
Do not voluntarily pay additional taxes because of a perceived reduction in audit probability.