Unity ML-Agents Toolkit Documentation

Installation & Set-up

• Installation
  • Background: Jupyter Notebooks
  • Using Virtual Environment
• Basic Guide

Getting Started

• ML-Agents Toolkit Overview
  • Background: Unity
  • Background: Machine Learning
  • Background: TensorFlow
• Getting Started with the 3D Balance Ball Environment
• Example Environments

Creating Learning Environments

• Making a New Learning Environment
• Designing a Learning Environment
• Designing Agents
• Learning Environment Best Practices

Advanced Usage

• Using the Monitor
• Using the Video Recorder
• Using an Executable Environment

Training

• Training ML-Agents
• Using TensorBoard to Observe Training
• Training Using Concurrent Unity Instances
• Training with Proximal Policy Optimization
• Training with Soft Actor-Critic

Advanced Training Methods

• Training with Curriculum Learning
• Training with Imitation Learning
• Training with LSTM
• Training Generalized Reinforcement Learning Agents

Inference

• Unity Inference Engine

Help

• Migrating from earlier versions of ML-Agents
• Frequently Asked Questions
• ML-Agents Glossary
• Limitations

API Docs

• API Reference
• How to use the Python API
• Wrapping Learning Environment as a Gym (+Baselines/Dopamine Integration)

Deprecated Docs

We no longer use them ourselves and so they may not be up-to-date. We've decided to keep them up just in case they are helpful to you.

• Training on the Cloud with Amazon Web Services
• Training on the Cloud with Microsoft Azure
• Using Docker
• Installation-Windows