I'm sure this will stir some people. But no, not really. I'm serious that if something isn't necessary in my car, might as well remove it. It's hidden under the bumper anyway so it doesn't change the looks of the car. It's not like I can decide to use it again, Tesla gets to decide that.
EDIT: If it weighs under a pound it's probably not necessary... I'm assuming it weighs a few pounds so it might make a difference. People have relocated 12V batteries to change weight distribution in a car, or changed to a lighter one to save a few pounds. I don't race but I'll take what I can get, especially free.