Sure, it would be easier and faster if you never turned the wheel... Assuming you did a good job of laying them out in the first place. And of course, you didn't do anything asinine like moving the horn to a tiny little button instead of the middle of wheel and the list goes on.
To top it off, let's replace the shifter with buttons or a screen that operates much slower than the stalks. You'll never have to change direction quickly while needing to keep your eyes on the road. I bet you've never started to enter a blind intersection only to realize there is oncoming traffic and you need to back up. Likely you've never been going through a parking lot behind someone and they realized they overshot a parking place and throw it in reverse and you need to do the same to prevent them from backing into you. You likely never have to do 3 point turns (or a few more point so to speak) to park the car or turn around in a tight area. Hmm, maybe you've never driven in snow and were stuck and you needed to rock the car to help get unstuck.
Those are just 4 examples of where the removal of the stalks just for the gear shift is a total cluster. It isn't like they replaced it with something equal or better.