OpenAI is an organization dedicated to AI research, founded by Elon Musk in 2015. The researchers are reported to have used a technique called video pre-training (VPT), which involves collecting sample data from videos of actual human games, such as pressing buttons and mouse movements, and creating an algorithm to annotate these actions.
The researchers then trained an “inverse dynamic model (IDM)” to predict the sequence of actions taken in the game video. Finally, 70, 000 hours of online video was shown to the trainee IDM.
The model can copy actions from the video. It can collect logs, make logs into boards, and then make boards into a craft table. The model can also swim, hunt animals and eat food. In fact, it can even perform quite complex movements-jumping over and over again and placing pieces of wood under the player.
The AI can even make diamond picks, a complex skill that takes about 20 minutes for human players to complete.