Search This Blog

Thursday, January 28, 2016

The Artificial Intelligence Technology That Solved 'Go' Will be Accessible In and Through Your Smartphone

As reported by TechRepublic:Google has developed a machine learning system capable of mastering Go - an ancient Chinese game whose complexity stumped computers for decades.
While IBM's Deep Blue computer mastered chess in the mid 1990s and in more recent years a system built by Google's DeepMind lab has beaten humans at classic 70s arcade games - Go was a different matter.
go.jpgGo has 200 moves per turn compared to 20 per turn in Chess. Over the course of a game of Go there are so many possible moves that searching through each of them to identify the best play is too costly from a computational point of view.
Now a system developed by Google DeepMind has beaten European Go champion and elite player Fan Hui. Rather than being programmed in how to play the game, the AlphaGo system learned how to do so using two deep neural networks and an advanced tree search.
Go is typically played on a 19-by-19-square board and sees players attempt to capture empty areas and surround an opponent's pieces. To teach the system how to play the game, moves from 30 million Go games played by human experts were fed into AlphaGo's neural networks. The system then used reinforcement learning to work out the type of moves that were most likely to succeed, based on these past matches. This approach allows AlphaGo to restrict the number of possible moves it needs to search through during a game - making the process more manageable.
DeepMind CEO Demis Hassibis described Go as "probably the most complex game that humans play. There's more configurations of the board then there are atoms in the universe."
It was that complexity that meant the game had been so difficult for machines to master said DeepMind's David Silver. "In the game of Go we need this amazingly complex intuitive machinery, which people previously thought was only available in the human brain, to even have the right idea of who's ahead and what the right move is."
Google has suggested that the approach used by AlphaGo to learn how to master Go could be extended to solving more weighty problems, such as climate change modelling, as well as to improving Google's interactions with users of its services.
For instance, DeepMind's Silver suggests the technology could help personalize healthcare by using a similar reinforcement learning technique to understand which treatments would "lead to the best outcomes for individual patients based on their particular track record and history".

 More significantly, Hassabis sees the achievement as progress towards an even grander goal, of building an AI with the same general capabilities and understanding as humans.

"Most games are fun and were designed because they're microcosms of some aspect of life. They might be slightly constrained or simplified in some way but that makes them the perfect stepping stone towards building general artificial intelligence."
Similar AI initiatives are underway at tech giants across the world, with Facebook recently revealing its deep learning system's ability to recognize people and things in images and to predict real-world outcomes, such as when a tower of blocks will topple.

Why Google is pursuing narrow, not general, AI

Simon Stringer, director of the Oxford Centre for Theoretical Neuroscience and Artificial Intelligence, said that AlphaGo and other deep learning systems are good at specific tasks - be that spotting objects or animals in photos or mastering a game. But these systems work very differently from the human brain and shouldn't be viewed as representing progress towards developing a general, human-like intelligence - which he believes requires an approach guided by biology.
"If you want to solve consciousness you're not going to solve it using the sorts of algorithms they're using," he said.
"We all want to get to the moon. They've managed to get somewhere up this stepladder, ahead of us, but we're only going to get there by building a rocket in the long term.
"They will certainly develop useful algorithms with various applications but there will be a whole range of applications that we're really interested in that they will not succeed at by going down that route."
In the case of DeepMind, Stringer says the reinforcement learning approach used to teach systems to play classic arcade games and Go has limitations compared to how animals and human acquire knowledge about the world.
Whereas these reinforcement learning algorithms can learn to map which actions lead to the best outcomes they are "model-free", meaning the system "knows nothing about its world".
That approach is very different to how a rat's brain enables it to navigate a maze, he said.
"It's been shown over a half a century ago that what rats do is learn about the structure of their environment, they learn about the spatial structure and the causal relations in their world and then, when they want to get from A to B, they juggle that information to create a novel sequence of steps to get to that reward."
When you teach a system using model-free reinforcement learning, Stringer says it's "behaviorally very limiting".
"As the environment changes, for example one route is blocked off, the system doesn't know anything about its world so it can't say 'This path is blocked, I'm going to take the next shortest one'. It can't adapt but rats can."
Similarly, Google's announcement a few years back that it had trained a neural network to spot cats in images doesn't represent a step towards developing a human-like vision system.
"When we look at a cat, we're not just aware there's a cat in the image, we see all of the millions of visual features that make up that cat and how they're related to each other. In other words our visual experience is much richer than one of these deep learning architectures, which simply tells you whether there's a particular kind of feature in an image."
In particular, such systems lack the human ability to bind features together - he said - to comprehensively understand how features in an image are related to one another. Deep learning neural networks also generally don't model biological systems that appear to play a key role in how humans assign meaning to the world. These models typically exclude, for example, feedback in the brain's visual cortex and the precise timings in the electrical pulses between neurons, he said, adding that the centre in Oxford had developed concrete theories about the importance of these features in the visual cortex.
"We bought all of those elements together. At the very least it gives us a deep insight into what is so special about human vision that hasn't been captured in artificial vision systems yet."
This biologically-inspired approach is very different to that taken by DeepMind but Stringer believes it is necessary to have a chance of one day cracking general artificial intelligence.
"If you want to solve consciousness you're not going to solve it using the sorts of algorithms they're using."
The downside is that Stringer believes the ultimate payoff for his research will be a long time coming, a factor he thinks has driven DeepMind's decision to focus on narrow AI that could be applicable in the near-future.
"I have to admit, I'm always a bit surprised, given the resources that DeepMind have, why they don't devote more resources to actually trying to recreate the dynamics of brain function and I think it's because when you're trying to raise funding you need to produce jam today, you need these algorithms to work quickly otherwise that tap gets turned off.
With that in mind, Google recently announced that it will use Movidius's processors to power its advanced neural computation engine on mobile devices and in turn help the chip maker with it's neural network technology.
Google plans to use Movidius's flagship MA2450 chip, touted as the only commercial solution on the market today that can perform complex neural network computations in "ultra-compact" form factors.
Stringer says: "My aim is to produce the first prototypical conscious systems, something very simple, somewhere between a mouse and a rat, within the next 20 - 30 years."
The DeepMind software that beat Go champion Hui, in a match that took place last October, was running on Google Cloud Platform and reportedly distributed across about 170 GPUs (graphics processing units) and 1,200 CPUs (central processing units).
Google has also been experimenting with Cloud Vision Tech, through a mobile accessible API.
The next major challenge for Google's AlphaGo will come in March, when it will play the world's reigning Go champion Lee Sedol.
DeepMind's Silver is confident AlphaGo has what it takes to beat all comers, at least in the long run.
"A human can perhaps play 1,000 games a year, AlphaGo can play through millions of games every single day. It's at least conceivable that as a result AlphaGo could, given enough processing, given enough training, given enough search power, reach a level that's beyond any human."

14 comments:

  1. Truly amazing post which i have come across a long way back found to be very impressive while going through this post. Thanks for sharing and keep posting such an informative content.

    Data Science Course in Raipur

    ReplyDelete
  2. Get Free Demo Sessions at Artificial Intelligence Training in Hyderabad at AI Patasala, and aspirants can benefit from world-class expertise in creating as an expert in data science.
    AI Course in Hyderabad

    ReplyDelete
  3. Excellent effort to make this blog more wonderful and attractive.
    data science course

    ReplyDelete
  4. Learning how to use Mailchimp can get your email marketing campaign done efficiently and take it to the next level. rainsoft You might think email marketing is outdated or can even question the relevance of tools like Mailchimp. squarespace pricing, wordpress .org vs .com, email services like mailchimp, linux web development tools, alternatives to mandrill, best minecraft server host, cheap domains, youtube banner maker and google map java script api

    ReplyDelete
  5. Enroll in the Data Science course near me to learn the handling of huge amounts of data by analyzing it with the help of analytical tools. This field offers ample job profiles to work as a Data Architect, Data Administrator, Data Analyst, Business Analyst, Data Manager, and BI Manager. Step into an exciting career in the field of Data Science and achieve great heights by acquiring the right knowledge and skills to formulate solutions to business problems.

    Best Data Science Training institute in Bangalore

    ReplyDelete
  6. Get a comprehensive overview of Data Science and learn all the essential skills including collecting, modeling, and interpreting data. Register with Data Science institute Bangalore and build a strong foundation for a career where you will be involved in uncovering valuable information for your organization. Learn Python, Machine Learning, Big Data, Deep Learning, and Analytics to take center stage in Data Science.


    Business Analytics Course in Jodhpur

    ReplyDelete
  7. 36DigiTMG offers top-rated courses in Data Analytics for your need and expertise. Get trained from industry experts with 170 plus hours of assignments that will help you bag a high-paying job.


    Data Science Course in Bangalore with Placement

    ReplyDelete
  8. Are you worried that joining in a top-rated Data Science course will burn a hole in your pocket, fret not 360DigiTMG offers Data Science courses that are pocket friendly. Enroll now to learn more about the course and fee details.
    Data Science Course in Delhi

    ReplyDelete
  9. This article will present a closer look at data science courses that give you a comprehensive look at the field. So let's get started.
    data science course in borivali

    ReplyDelete
  10. I wholeheartedly congratulate the writer of this post for explaining the difficult concepts of data science in a simple and easy-to-understand manner. My only regret is that I didn’t read this post earlier. I have made many career decisions in my life after reading this, and have no regrets whatsoever to date.power bi course malaysia

    ReplyDelete
  11. "We will examine some of the well-known data science programmes offered in Pune that guarantee job placement for
    graduates."

    data science course in pune

    ReplyDelete