One hope is that the by training on enough unusual long-tail examples, the network will develop the abstract concept of "weird stuff", along with a strategy for identifying and dealing with it in a generic and reasonable way, much as humans do. Agreed that there are many categories of edge...