We all have heard about Machine Learning and how it is changing the face of technology is from social media to virtual assistants like Siri and Alexa, IoT and even automobiles, algorithms analyze terabytes of data and make quick decisions.
Storing data and coupling it with the technology to make life easier. People often think that Artificial Intelligence and Machine Learning as the same concept. But there is a difference between both technologies. AI stands for machines that perform intelligent tasks not only repetitive ones. They adapt to different situations and present us with outcomes accordingly. Machine Learning is the subset of AI. It works on the idea that machines can think for themselves and learn without our constant supervision. Deep learning is ML's most dominant technique. It's essentially a statistical method to teach machines how to classify patterns using (artificial) neural networks. These networks memorize categories and apply them to similar situations in a roughly reliable manner.
Most people believe that if we add 100X more layers and 1000X more data, a neural net can to do anything a human being does. But not everything is copacetic right now. Technology virtuosos like Elon Musk and the late Stephen Hawking have raised concerns about AI, declaring that it will turn out to be a menace to mankind.
Deep learning systems demand tremendous sets of data for training. A computer works on binary input/output data and electrical voltages. To build smart algorithms, it needs enough real-world examples of the scenario (read training data). But all this comes at a cost. Not just in terms of currency for buying data, but also hiring and training people to collect and feed it into the system.
Google and Facebook can afford infinite data for their systems, because Google answers over 1.2 trillion search queries each year, while Facebook has over 2.2 billion monthly active users. But for categories at smaller levels, this is still an obstacle to overcome. For instance, Alexa and Siri still respond with pre-defined answers to many questions, and cannot adapt to new scenarios.
When a neural net gets subjected to a transfer test situations that differ from training it cannot contextualize the situation. That's why it breaks. Quality issues have always been a challenge for deep learning.
Context matters while understanding natural language. A word can hold different meanings in different languages. A phrase can mean different things in different legal documents. And while ML has developed breadth in reading and understanding, context is still one area where it struggles. Technology has a long way to go before matching human translation and understanding.
Conventional programs have accessible code that can be debugged and fixed. Parameters of deep learning, on the other hand, can only be interpreted in terms weight within a mathematical geography.
Neural networks are programmed extensively for pattern-recognition. Most of these are done with an ideal environment in mind. But we don't live in an ideal world we are far from that reality. In the real world, humans are irrational species with millions of conflicting emotions, actions, and thoughts. Remember the Milgram experiment, where the majority of subjects who claimed that they would extend kindness to others ended up providing a (fake) shock to someone who couldn't spell?
Deep learning has little or no knowledge about the world or human psychology. They do not understand cross-cultural norms and values unless they have large volumes of data to learn it. This lack of sensitivity can prove costly while trying to enter new markets, predict human behaviour, and so on. These limitations prove that automation, as shown in movies like iRobot and Total Recall, is still a distant dream.
Sceptics highlight that we've been using the same conventional models to train machines since the 1950s, and that to train machines better, we must first build better models in our own heads. There's no doubt that machine learning has made life easier. But when it comes to making decisions like humans, this concept still has limitations that present disadvantages to those who want to apply it.