But most people using neural nets in the industry aren't working on those things. They just slap it on any data inference task, even though in most cases traditional statistical/data science models works much better.
In my experience, people use appropriate tools for the job. Most data scientists won't reach for a neural network if the problem can be solved by other, simpler means.