This is the drawback with neural network technology as it is with today's tools. Your network is only as good as the data you train it on.
And doing iterative improvements is hard, because you don't go in and just change a line of code and the problem is gone. You need to add data to your model. And the process of fixing one edge scenario by filling in missing data at one place could bias your network away from another case of missing data, that was previously working by chance.
Neural networks is still pretty new science, and even though we have come pretty far, we're still early adapting this technology. It's like the C era back in the 90s were bugs and BSODs were pretty common. Then the tools became better, we got better programming languages (C#, Java mm), better practices, and the overall quality of the applications became much better. Neural networks are still at a stage where a lot of the development is actually making the proper tools (ref Karpathy's recent video presentation).
I'm not surprised bugs like these show up. It's inevitable at this point of development. But it will become better.
(and AP wont kill you if you don't trust it and keep hands on the wheel)
And doing iterative improvements is hard, because you don't go in and just change a line of code and the problem is gone. You need to add data to your model. And the process of fixing one edge scenario by filling in missing data at one place could bias your network away from another case of missing data, that was previously working by chance.
Neural networks is still pretty new science, and even though we have come pretty far, we're still early adapting this technology. It's like the C era back in the 90s were bugs and BSODs were pretty common. Then the tools became better, we got better programming languages (C#, Java mm), better practices, and the overall quality of the applications became much better. Neural networks are still at a stage where a lot of the development is actually making the proper tools (ref Karpathy's recent video presentation).
I'm not surprised bugs like these show up. It's inevitable at this point of development. But it will become better.
(and AP wont kill you if you don't trust it and keep hands on the wheel)