The Game That Learns

published on July 13, 2020

Vsauce Kevin here and I've built acomputer capable of explaining how youget smarter out of these match boxessome colorful beads and Shrek real quickbefore we get into the game we're aboutto play I want to tell you about thegame that I've been playing I partnered

With raid Shadow legends on this videoand if you follow me on Instagram youknow that I'm a huge fan of RPGs wellraid is the most immersive championcollecting experience you'll get on asmartphone it has a deep story detailed

Graphics giant boss fights and hundredsof champions to collect and customizeand you can play it free so to check itout download raid using only my link inthe description below to get 50,000silver immediately and a free epic

Champion courtesy of the dev team thanksagain to them for supporting Vsauce togo check out their game it's amazing howfar mobile gaming has come now let's getback to the inner workings of our gameokay 24 batch boxes all filled with

Beads and covered in potential moves forthe game we're about to play and this isour computer now shrek comes along andwait how is this a computer aren'tcomputers just like electronic machinesthat run software what is a computer

Well the earliest computer was you oryour ancestors they used calculatingmachines like the abacus to inputinformation which output a result but wewere the ones computing the humanoperators of early calculating machines

Were literally called computers okayback to our match boxes once weintroduce a game board Shrek and thegang this match box and beads set upprocesses our input gives us an outputand not only that it also learns this is

Not just a computethis is an artificial intelligencemachine capable of matching wits withthe brightest minds humanity has tooffer at a game called hexa pawn here'show hexa pawn is based on chess each

Player has three pawns on a board withjust nine squares the pieces move likechess pawns – they can go forward onespace if that space is unoccupied if itis occupied by the opponent then theycan't go forward sorry

Donkey you can however move diagonallybut only to take an opponent's piecethere are three ways to win get upon tothe other side of the board take all ofyour opponent's pieces or leave youropponent without a possible move like a

Checkmate in chess our setup works likethis I've got 24 match boxes here andeach one corresponds to the position ofpieces on the board during that roundI've got my team Kevin pawns versus thecomputers team Shrek and do you know

What that meansthat means that we've officially turnedhex upon into Shrek's upon all rightlet's play the human that's me alwaysgoes first wait why because recreationalmathematician Martin Gardner said so he

Actually created hexa pond and its rulesas a simplified version of a 304Matchbox computer called menace 15 yearsafter helping the British break theNazis codes in World War 2 Donald Michieinvented menace to learn how to master

Tic-tac-toe and now 59 years later I'mon YouTube playingShrek's upon since I go first my movesonly occur in the odd-numbered roundsone three five and seventherefore the match boxes are grouped by

Possible team Shrek moves in rounds twofour and six one of us is guaranteed towin before around eight so team Shrekhas no round eight moveseach box contains one colored bead foreach potential move on that board

Position so like this first box has agreen blue and purple and I've cut ahole at the bottom of the box that willonly allow one bead at a time to fallout so I'll just shake the box and letone beat out and it's purple

That means if my pawn was here and itwas team Shrek's move team Shrek wouldmake the purple arrow move like this ifa blue bead had fallen out and teamShrek would have made the blue arrowmove and if it was a green bead then

Team Shrek would have made the greenarrow move and taken my pawn okay sothat's how team Shrek will move teamKevin will move however I want teamKevin to move because I'm Kevin and thenwe'll play back and forth until there's

A winner all right round one fight Idecide to move Lord Farquaad forward forround two I now use this box todetermine team Shrek's move so we'llgive it a shake whoa let's try thatagain and it's the green move so donkey

Moves forward now it's my turn and Idecide that look I can just takePrincess Fiona when I move diagonallyand win the game that's it now here'sthe important part when team Shrek makesa losing move I remove that bead from

The box that way the computer can't makethe same bad move the next time thatthis situation comes up by removing itsbeads the computer learns to play betterwhen team Shrek does win then instead ofremoving the bead I'll just put the bead

Back in the box okay I'm gonna play abunch of rounds now and I'll keep trackof wins over here with a K when I winand I'll write an S for a Shrek win herewe goharpy

Be recognizedyesscrolling for attention whyokay I've played 14 games I started offwinning a lot more than I was losing andthen things changed out of the last

Seven games teen Shrek has won six ofthem the computer is clearly gettingbetter at the game but is it reallylearning I mean I'm just taking beadsout of match boxes how is that learningwhat is learning at the most basic level

Learning is acquiring new knowledge or anew skill or modifying an existingbehavior every time I take a bead out ofa matchbox the computer loses a behaviorthat leads to an outcome of failure thatincreases the probability that the

Computers move each round leads to itssuccess which in our cases winningShrek's upon after a sufficient numberof games the computer will evolve toplay perfectly my team Shrek computermay not be thinking on its own but it is

Learning and it can also learn in adifferent wayremoving beads is basically a form oflearning by punishment when team Shrekmakes a bad move I'm punishing thecomputer for being wrong I don't have to

Worry about the computer feeling badabout losing these match boxes aren'tgonna get frustrated and quit playingand run away crying and slam the door inmy face and tell me I'm not their realdad but what happens if instead of

Punishing my computer I reward itinstead of just putting the good playbead back in the box when the computerwins I could add another bead of thesame color that made the winning movethat would reduce the probability of a

Losing bead appearing by increasing theprobability of a match box generating awinning bead the computer would stilleventually reach perfect play becauseI'll still remove the loosebeads but it'll take longer because it's

Winning more often if it could feel itwould probably feel a lot better aboutwinning more often along its longerjourney toward perfection so the fastestway to perfect play is by punishing thecomputers mistakes but the way to win as

Many games as possible along the way isto reward its victories to improve athex upon our matchbox computer actuallyuses a type of genetic algorithm it's away to solve problems and learn based onnatural selection based on the process

That drives biological evolution thebeads of learning in your life may berefined by punishment put your hand on ahot stove once and learn out that'spainfulso you remove the touch hot stove bead

From your brain they may also beaugmented by rewards my parents boughtme ice cream for getting an A on my examand another get good grades bead to yourmatchboxhead computer hexa pawn is an obscure

Academic gain from over 50 years ago andyou can make a matchbox computer thatlearns to win every time but by allowingthis matchbox computer full of coloredbeads to learn the player who's learninga bit more about learning is you and as

Always thanks for watchingif you want to make your own matchboxand I lost a bead matchbox computerdownload my template for free attwittercom slash Vsauce- that's at Vsauce t w or if he saw two

Videos just click over here and if youaren't subscribed to Vsauce 2 then maybeyou should put a subscribe to Vsauce tobeat in your brain but I'll this isweirdly creepy

Related Videos

hey guys techrax here coming at you guys with another giveaway this is gonna be an iPhone 5s two of these brand new phones not the one in this video guys this i...
hey guy there's a popular game in the app store called flappy bird right now and it's supposedly really annoying believe it or not I haven't played ...
hey guys tech Rex here so right here with me I have an Apple iPhone 5s this is the gold one I also have with me some liquid nitrogen yes this is the real deal a...
hey guys techrax here right here I have the iPhone 5s with me this is the champagne or the gold color I still can't really figure out if it's champagne ...
hey guys tear cracks here so this video really exciting video I have the new Samsung Galaxy s5 for you guys this is the long-awaited cellular devices releases i...
everyone techrax here in this video I've got the latest Samsung Galaxy s5 right here as well as the Apple iPhone 5s and we're going to be doing a simple...
everyone techrax here in this video guys have a really exciting device this is the Samsung Galaxy s5 charcoal black and I'm really liking I after seeing the...
everyone techrax here here with me off the Samsung Galaxy s5 this is a perfectly fine s5 it is cracked from the drop test that I had with also one minor neck as...
hey guys tetrax here so in this video I'm going to try and burn the newly released Samsung Galaxy s5 this is the shimmering white 16 gigabyte model and if y...
everyone techrax here so I got my burn Samsung Galaxy s5 and I wanted to see whether the heartbeat sensor would still work the heart monitor on your galaxy s5 a...
hey guys Tech Rex here so I'm really excited to bring you guys a giveaway for my channel but this time I'm actually teaming up with a buddy of mine your...
hey guys techrax here so in this video I'm going to be hopefully instructing you guys how to make your very own a tech sandwich slash burger slash meal so y...
hey guys techrax here so I've got a galaxy s5 here this is the copper gold hopefully you guys can see pretty well it is sunset so it's getting a little ...
hey guys techrax here so right here with me I have a professional deep fryer in here is already some canola or corn or whatever oil I don't know vegetable o...
hey guys techrax here so just trying to make this video short and quick i'm having recently i got five hundred thousand subscribers and yeah most of you guy...
hey guys texture so in this video I have a drop test on the latest LG g3 device now this is actually the gold-coloured LG g3 this has not been released in the U...
hey guys techrax here so in this video we'll teach you guys how to make your iPhone indestructible this is essentially a case that's been around for yea...
hey guys techrax here soon in this video we had a train run over the iPhone 5s so we actually did this in two different instances initially we had a Space Gray ...
hey guys tech cracks here so in this video we're going to be dropped testing the newly released Amazon fire phone this is exclusive for AT&T and I belie...
hey guys techrax here so right here with me I have the Amazon fire phone this is the one I dropped and you know I thought what better what else do I do with thi...