FYI, I have done a little more research on the Challenger panels. While I still don't have definitive information, it sounds like there are various series of Challenger panels based on different designs. It would seem that the concerns are with the panels based on the Federal Pacific design, but later panels were based on a design that is compatible with what are now Eaton BR breakers. Anecdotal information may indicate to me that these BR based designs (which is what I think the OP has) are not the ones with the fire risk.
But take this with a grain of salt. It is just information I have found online. It sounds like there is a lot of confusion out there.
Challenger panel insurance denials
I just wanted to call out that it is possible that both the main service entrance gear (HOA owned presumably) and the panel in the OP's unit may be completely fine (not a known hazard). More research may be needed.
If these panels and breakers are not a known hazard then it may not make financial sense to push for replacing them at this time. Also, I could see logic around replacing breakers (very quick and easy to do and often times inexpensive) but leaving the same panel(s) in place. Fresh modern breakers may provide some level of comfort without the cost of panel replacement.