The OpenAI Five: video game bots that beat the world's best Dota 2 players

In the middle of game one between the human team OG (world champions at the game Dota 2) and the bots of OpenAI Five, an AI player sent a message to the in-game chat:

"We estimate the probability of winning to be above 95%."

The crowd laughed in surprise.

"From our human perspective, this is an even game, Owen," one announcer said.

His partner agreed.

"This game does not look one-sided."

OpenAI Five, though, went on to win twice in a row, becoming the first AI to beat world champions in esports.

OpenAI Five, a group of five bots developed by the company OpenAI, had done something significant-- unlike previous human-machine competitions, this one involved teamwork among AI bots, against a team of close-knit human players that worked together.

"We use Dota as a testbed for general-purpose AI systems," OpenAI wrote in a blog post, referring to Dota 2, the game played at the tournament.

Complicated, real-time strategy games, the blog post says, "Start to capture the messiness and continuous nature of the real world, such as teamwork, long time horizons, and hidden information.""

The AIs played an average of 180 years per day training under a model of machine learning known as Reinforcement Learning, which rewards positive outcomes. OpenAI Five observes every forth screen frame (the game runs at 30 frames per second, similar to a movie) as a list of 20,000 numbers, and sends back an 8-digit string in response.

The AIs themselves are totally self-taught, meaning that they play against versions of themselves.

"In the first games, the heroes walk aimlessly around the map," OpenAI wrote in a blog post. "After several hours of training, concepts such as laning, farming, or fighting over mid emerge. After several days, they consistently adopt basic human strategies."

"Once trained, these neural networks are creatures of pure instinct—their neural networks implement memory but do not otherwise learn further," according to OpenAI.

Sections

OpenAI

August 11th

OpenAI was founded as a non-profit research lab by Elon Musk and Sam Altman in 2015.

In February, 2018, Musk left, citing a conflict of interest with his work on Tesla's autopilot system.

In 2019, with Altman in charge, OpenAI formed OpenAI LP, a for-profit company it wrote will allow them "to rapidly increase our investments in compute and talent while including checks and balances to actualize our mission."

OpenAI has produced some impressive accomplishments-- in early 2019, its neural networks beat the world's best Dota 2 players. And in July, Microsoft invested $1 billion in OpenAI to pursue artificial general intelligence, an accomplishment many think is atill decades away, if not longer.