Yeah, there's two basic techniques. One is the two hand technique where you hold the plug normally with one hand and hold the adapter in the other. Press the J1772 release button, then pull them out together. In the second technique, you push the button, release it, push the plug back in to lock it into the adapter again, then pull both out together. It's easier than it sounds.
Unfortunately, what doesn't work very is unplugging the J1772, then separately pulling out the adapter. Unless you do it pretty quickly the port will lock on the adapter (and the door will try to close). Then you really DO have to use the app or the touch screen to unlock the port again.