Skip to main content
Let's play Minecraft/Doom/StarCraft!  Game Agent AI for Udacity Artificial Intelligence Nanodegree Term 2!

Let's play Minecraft/Doom/StarCraft! Game Agent AI for Udacity Artificial Intelligence Nanodegree Term 2!

94 signatures 6 to reach 100
S
Swapan J. signed
N
Noyin L. signed
K
Kyung M. signed
Y
Yannik Z. signed
F
Fawad K. signed
S
Someone signed
T
Tsega signed
S
Someone signed
D
Damien S. signed
G
Grégory B. signed
JT
Started by James Tolton 9 years, 9 months ago

An Open Letter to Udacity CEO Sebastian Thrun:

With tremendous gratitude for bringing us together to learn some of the most important emerging skills and technologies of our time, we your passionate students present to you a petition for an interesting second (or third?) term project for AIND. These signatures were gathered over the course of only 12 hours! When we heard the proposal from our fellow student Adrian Melic, we thought it was too good to be ignored, and I'm sure you will immediately see the value when you take a look at it!

Although the proposal speaks for itself, the impetus behind it is in reaction to the choices for the second term project. The options presented during the AMA-session were CV, NLP, and speech recognition. While each is respectively a fascinating and worthy topic, we aspire to use those tools in conjunction with others to accomplish something extraordinary -- something fun and easily appreciated that brings together both experienced industry professionals and the most non-technical among us who we support with our efforts -- something truly worthy of the lofty title "Artificial Intelligence".

Both a means to making many powerful techniques accessible and an enjoyable end unto itself, and the potential basis for a fantastic Open Source Udacity General Game Player Artifical Intelligence, we present to you the proposal for the Game Agent AI Project:

@adrianmelic:

Speech Recognition seems almost "solved". Amazon, Google, IBM, Baidu... Really great interpreters.

*What if Speech Recognition is changed to "Game Agent AI"?*

After Google DeepMind's victory at Go, in the beginning of 2017 they will release StarCraft II as an AI research environment. OpenAI has a gym where you fit an agent playing games. Microsoft with project Malmo (Minecraft AI agent). Facebook with Doom... Everything we can create in a game, a simulation, can be tried later in the real world. Every business is just some kind of game to be optimized. Maybe in the future we create a micro-version of The Matrix :sunglasses: but right now we need some great course that includes this. It will be super fun to watch shared videos of Udacity's student AI agents playing, competing, trying to help OpenAI or winning to a human.

Specifically, we would like to see the use of model-free reinforcement learning such as Q-Learning in conjunction with these games as a medium to help us achieve fantastic ends! Some comments by your students:

"I am writing an email to OpenAI CEO. It will be so cool if we help them democratize AI. Maybe some of our code can be in a Mars base builder robot when SpaceX launch the firsts missions to Mars" ~ @adrianmelic

"If they included reinforcement learning for games as a term 2 focus I would take it 12 times" ~ @nash

"That could be a nice enough challenge to have a bot flexible enough to handle the difference of environment while still staying in a context that is similar to the one it was trained with" - @kavignon

"that would be great if we could work on something related to reinforcement/q learning and OpenAI Gym" ~@jro

"I am also very interested in "Game Agent AI", especially if more "game theory" content is included. Game theory will be a crucial knowledge to determine/prevent the robot before it go against us.... I will take it too. Count me in." ~@kora

"I definitely see a lot more value add from a gameAI concentration than speech recognition. Decision support in the future will be infinitely more valuable than speech recognition -- being able to take confident, autonomous actions produces so much more business value across industries than speech recognition which has diminishing research returns at this point" ~ @mattzhou

We need all the help we can get. It will be very difficult to adopt this, as pointed out:

"Does the Udacity team even 6 pool?" ~ @madhavajay

(hint: https://www.google.com/search?q=zerg+rush)

Gauntlet has been thrown, Udacity! ;)

Don't worry! We understand this may be a daunting task and we are 100% committed to both helping develop and execute the new curriculum.

Sincerely,

The undersigned.

Updates

December 1, 2016

The administration has acknowledged the momentum behind this proposal. I am currently finalizing a formal briefing document to present during our upcoming meeting with the curriculum development team.

38 Comments

K
Kevin Avignon
9 years ago Featured

We were talking about this in the game agent ai channel; we'd like to implement a really smart bot that would learn by experimenting and exploring to play with street fighter games and have a flexible data model to be able to appropriately work when changing environment such as moving from SF2 to SF3 alpha for instance. To make it easier on us, because CV with creating a proper data model with Q-learning seems extremely heavy, it'd be cool to do a mod directly in Minecraft ! Experimenting with game AI is something that I'm fond of as I am right now working on a game AI for a RPG prototype. I would really like to have see either Spec rec swapped with Game AI or simply adding Game AI as a new possibility for students.

A
Alex Ponamarev
9 years ago Featured

Game agents are the bleeding edge of artificial intelligence. The research in this area will be beneficial to many fields (especially robotics). I would really love to see this topic as part of Udacity curriculum/concentrations.

A
Anonymous
9 years ago Featured

Hi Sebastian, I am enrolled in the Self-Driving-Car NanoDegree (first cohort), and will be taking the AI-nd as well (since I will have enough time for both). I am in thorough agreement about the reasoning in this petition, and would love to have such a concentration area for the 2nd term. I'd choose this over speech recognition any day. Regards, Ali

B
Bryan Pellegrino
9 years ago Featured

100% agree with what's written here, I'm in the Feb. Cohort and have no strong interest in any of the listed term 2s, but would LOVE to see some sort of gameAI / prediction engine focus. Please add it!

M
Madhava Jay
9 years ago Featured

I love Doom / Quake and StarCraft! Whats not to love. Given that Facebook has provided Broodwar as an AI platform, and Google with Blizzard are looking to provide SC2 it would be great to do this in the AIND!

N
Nash Taylor
9 years ago Featured

If I got the opportunity to apply reinforcement learning to a game playing agent, it would be the most exciting project I've ever done in my life.

K
Kyung Mo Kweon
9 years ago

AIND without deep reinforcement learning is disappointing.

G
Grégory Besson
9 years ago

I don't 6 Pool neither. I'm more 2 'racks reaper ;)

Help this petition grow

Share it with friends to help reach 100 signatures.

Your share link

Share directly