So I figured out a slightly faster way to get to quick controls. While driving, you can tap a seat adjust button on your seat, that will bring the menu up. Of course you would need to tap the restore button to undo the seat movement.
Not great - these buttons should just be there when you tap...