I wish there were politicians with your mindset!I know that's a rhetorical question, and you are 100% right, but there's an answer actually: because you. an make a crap ton of money. Being part of the energy transition has bigger long term upside than oil, no question. And solving hard problems is really fun. My favorite thing in the world (career wise) is to be part of a team of engineers and lab techs that create solutions to really tough challenges that no single individual could do alone. It can be hell for a while, but once you get through, it's the best sense of accomplishment you can get.
Just chugging along doing the same thing you've done for literally a century (more) is mind numbingly boring.
But changing entrenched technology and corporate culture is usually impossible. So yeah, gotta squeeze every drop of cash out of that goose before it dies. Would be better to pivot sooner, save the oil for things that don't burn it, or just leave it in the ground.
They just take handouts, get elected, take more handouts, and kick the can down the line to the next generation. Because they know they can't actually fix the real problems, especially while still getting re-elected. No one wants to make the tough needed decisions because positive change will piss too many donors off.