I am not talking about DC charging here, but just speaking to AC charging: I assure you that if you are fast enough you can unlatch a completely functional J1772 and remove it from the port before the current is stopped. I've generated a mild orange arc (probably about 4-8 inches long) this way myself (on a 208V 30A charging station). It usually results in the red Tesla T followed by a required manual release of the adapter, and various dire messages on the in-car display. I always press the button now and wait a second before removing. Took seeing the arc (required low light conditions) for me to realize why I was getting the red Tesla T on the charging port.
There is also the case of broken buttons (which do not prevent charging). In those cases it's best to disable the charging from the app, the charging station, or the car, before removing.