IBM's Watson beats humans in 'Jeopardy' practice round

Discussion in 'User Submitted News' started by soulx, Jan 14, 2011.

  1. soulx
    OP

    Member soulx GBAtemp Legend

    Joined:
    Apr 4, 2009
    Messages:
    10,130
    Country:
    Canada

    So, in February IBM's Watson will be in an official Jeopardy tournament-style competition with titans of trivia Ken Jennings and Brad Rutter. That competition will be taped starting tomorrow, but hopefully we'll get to know if a computer really can take down the greatest Jeopardy players of all time in "real time" as the show airs. It will be a historic event on par with Deep Blue vs. Garry Kasparov, and we'll absolutely be glued to our seats. Today IBM and Jeopardy offered a quick teaser of that match, with the three contestants knocking out three categories at lightning speed. Not a single question was answered wrongly, and at the end of the match Watson, who answers questions with a cold computer voice, telegraphing his certainty with simple colour changes on his "avatar," was ahead with $4,400, Ken had $3,400, and Brad had $1,200.

    Alright, a "win" for silicon for now, but without any Double Jeopardy or Final Jeopardy it's hard to tell how well Watson will do in a real match. What's clear is that he isn't dumb, and it seems like the best chance the humans will have will be buzzing in before Watson can run through his roughly three second decision process and activate his buzzer mechanically. An extra plus for the audience is a graphic that shows the three answers Watson has rated as most likely to be correct, and how certain he is of the answer he selects -- we don't know if that will make it into the actual TV version, but we certainly hope so. It's always nice to know the thought processes of your destroyer.

    While Watson's ability to understand questions, buzz in, and give a correct answer might seem very human-like, the actual tech behind Watson (dubbed "DeepQA" by IBM) is very computer-ey. Watson has thousands of algorithms it runs on the questions it gets, both for comprehension and for answer formulation. The thing is, instead of running these sequentially and passing along results, Watson runs them all simultaneously and compares all the myriad results at the end, matching up a potential meaning for the question with a potential answer to the question. The algorithms are backed up by vast databases, though there's no active connection to the internet -- that seems like it would be cheating, in Jeopardy terms.

    Much of the brute force of the IBM approach (and why it requires a supercomputer to run) is comparing the natural language of the questions against vast stores of literature and other info it has in its database to get a better idea of context -- it has a dictionary, but dictionary definitions of words don't go very far in Jeopardy or in regular human conversation. Watson learns over time which algorithms to trust in which situation (is this a geography question or a cute pun?), and presents its answers with a confidence level attached -- if the confidence in an answer is high enough, it buzzes in and wins Trebek Dollars.[/p]

    [​IMG] Source

    This is an impressive display of AI. It's not perfect yet, but it's getting there!
     
  2. _Chaz_

    Member _Chaz_ GBAtemp's Official Mook™

    Joined:
    Sep 12, 2009
    Messages:
    5,624
    Country:
    United States
    Holy Christ.

    I vote that IBM remake the Cleverbot site.
     
  3. soulx
    OP

    Member soulx GBAtemp Legend

    Joined:
    Apr 4, 2009
    Messages:
    10,130
    Country:
    Canada
    We would have to change the server Cleverbot's site runs on.
    Watson is a supercomputer.
     
  4. _Chaz_

    Member _Chaz_ GBAtemp's Official Mook™

    Joined:
    Sep 12, 2009
    Messages:
    5,624
    Country:
    United States
    It's fucking IBM, they can do it.
     
  5. ProtoKun7

    Global Moderator ProtoKun7 GBAtemp Time Lord Regenerations: 3

    Joined:
    Jan 3, 2009
    Messages:
    7,480
    Location:
    Gallifrey
    Country:
    United Kingdom
    Pretty good computer, indeed.

    At one part I wondered if the computer might've actually finished the entire column first, but it didn't.
     
  6. SPH73

    Banned SPH73 Banned

    Joined:
    Sep 2, 2008
    Messages:
    889
    Country:
    United States
    "Open the pod bay doors, Hal."
     
  7. Bladexdsl

    Member Bladexdsl ZOMG my posts...it's over 9000!!!

    Joined:
    Nov 17, 2008
    Messages:
    14,347
    Location:
    Queensland
    Country:
    Australia
    IBM is gonna make skynet you wait and see...were all doomed [​IMG]
     
  8. Stephapanda

    Member Stephapanda Clover's Wife

    Joined:
    Sep 24, 2010
    Messages:
    233
    Country:
    United States
    That was sort of interesting to watch. I wonder if it'd actually win in a real game.
     
  9. TehSkull

    Member TehSkull Living the life

    Joined:
    Nov 29, 2009
    Messages:
    2,700
    Location:
    Louisiana
    Country:
    United States
    I'm glad to see it wasn't a complete win by Watson. If it was perfect, then they wouldn't even bother having it play Jeopardy, as it would always win.

    I'll definitely need to mark down when this occurs. I need to watch this.
     
  10. Ikki

    Member Ikki GBATemp's grumpy panda.

    Joined:
    Jun 1, 2010
    Messages:
    2,797
    Location:
    Montevideo
    Country:
    Uruguay
    That is creepy.

    Inb4 talk about intelligent robots and a rebellion against their creators
     
  11. Sheimi

    Member Sheimi A cute Vixen!

    Joined:
    Oct 22, 2009
    Messages:
    1,865
    Location:
    Tachikawa
    Country:
    Japan
    Oh wow, this is awesome to see Ken Jennings Lose
     
  12. sjones900

    Member sjones900 GBAtemp Advanced Member

    Joined:
    Jan 29, 2008
    Messages:
    808
    Location:
    TX
    Country:
    United States
    Host: I'm sorry Watson, that is the wrong answer.
    Watson: DESTROY!! DESTROY!! DESTROY!!!
     
  13. InuYasha

    Member InuYasha Professional Coke Fiend

    Joined:
    Dec 8, 2007
    Messages:
    1,778
    Country:
    United States
    Chess is one thing,but honestly its pointless reguardless but thats my opinion...
     
  14. Slyakin

    Member Slyakin See ya suckers

    Joined:
    Oct 15, 2008
    Messages:
    4,450
    Location:
    Soviet Slyakin
    Country:
    United States
    That is exactly what I was thinking.


    Well, time to practice those fire crossbows.
     
  15. DeMoN

    Member DeMoN GBAtemp Guru

    Joined:
    May 12, 2004
    Messages:
    7,647
    Country:
    United States
    How do they expect a human to click the buzzer faster than this thing?
    And is there a rest of the video?
     
  16. SixtySixHundred

    Member SixtySixHundred GBAtemp Fan

    Joined:
    May 21, 2010
    Messages:
    433
    Location:
    Eternia!
    Country:
    United Kingdom
    Reaches for EMP... Just in case...

    Seriously, how bored are those chaps at IBM?...

    IBM Boffin #1: "Let's make a mega powerful computer."
    IBM Boffin #2: "Yeah, let's! We can use it to help the World!"
    IBM Boffin #1: "No, I've got a better idea!.."

    Pointless... But cool, still.
     
  17. Potticus

    Member Potticus GBAtemp Advanced Fan

    Joined:
    Apr 30, 2010
    Messages:
    532
    Location:
    Oklahoma
    Country:
    United States
    I like the fact that it can click the buzzer and have time to search instantly.
     
  18. Bladexdsl

    Member Bladexdsl ZOMG my posts...it's over 9000!!!

    Joined:
    Nov 17, 2008
    Messages:
    14,347
    Location:
    Queensland
    Country:
    Australia
  19. cwstjdenobs

    Member cwstjdenobs Sodomy non sapiens

    Joined:
    Mar 10, 2009
    Messages:
    1,757
    Location:
    Ankh-Morpork
    Country:
    United Kingdom
    It's really not pointless. Imagine being able to ask your PC "Do I have any appointments today I can't put off", and it replying "Yes [please insert username], you have a dialysis session at 3pm". Or "Computer, search for blah blah blah" and it understands the question and only displays relevant results. The software is the amazing thing, the hardware is just a tool to get there quickly.
     
  20. TehSkull

    Member TehSkull Living the life

    Joined:
    Nov 29, 2009
    Messages:
    2,700
    Location:
    Louisiana
    Country:
    United States
    I'm sure it's in the programming to only click the buzzer after the calculations have finished and it has an answer with higher than 50% probability.

    Humans can cheat. We could press the button and as Kebert Xela is saying our name we can think about the answer.
     

Share This Page