This is the the stuff that I have. I keep it on hand as it is useful for many applications and holds really well but can be removed to change batteries. A cheaper velcro option could be used as well.
https://www.amazon.com/3M-Dual-Lock-Reclosable-Fastener/dp/B007OXK330/