I wouldn't worry about it too much - the noise levels are only slightly higher. I haven't noticed extra whistling or turbulence, at least not enough for me to remove the bars.
i commute 50ish miles a day, mostly freeway, typically at 70mph, if that helps.