« Terminator Returns To Arcades | Main | Interview: BioShock 2's Finley On Designing For Player Desire »

Tuesday, June 23, 2009

Machine Plays Pitfall, Dances

Several Rutgers University researchers devised a new method for "reinforcement learning" (a sub-area of machine learning) using Object-Oriented Markov Decision Processes, which is described as "a representation that looks at a higher level than usual and considers objects and interactions."

If that sounds complicated, their demonstration makes the concept much easier to understand. They showed the OO-MDPs representation by presenting a system that learned to play the original Pitfall in an Atari 2600 emulator (shown in the video above).

At first, you can see the system's learning algorithm discovering how to progress from the first screen, experimenting with different actions. In the system's second run, it uses what it learned, celebrating with a dance of joy!

According to the reasearchres, OO-MDP will also have plenty of "plenty of 'serious' uses in addition to being used in video game testing and in-game AI".

[Via Nick Montfort]

Comments

As good ol' vintage Fear Factory sung, "Man is obsolete. Erased. Extinct" :)

Post a comment



If you enjoy reading GameSetWatch.com, you might also want to check out these CMP Game Group sites:

Gamasutra (the 'art and business of games'.)

Game Career Guide (for student game developers.)

Indie Games (for independent game players/developers.)

Finger Gaming (news, reviews, and analysis on iPhone and iPod Touch games.)

GamerBytes (for the latest console digital download news.)

Worlds In Motion (discussing the business of online worlds.)


GameSetWatch [Twitter / RSS feed] is an alt.video game weblog from the people who run:



Copyright © 2009 Think Services