Skip to content
forked from microsoft/AirSim

Open source simulator based on Unreal Engine for autonomous vehicles from Microsoft AI & Research

License

Notifications You must be signed in to change notification settings

messiLiao/AirSim

Repository files navigation

Welcome to Aerial Informatics and Robotics Simulator (AirSim)

AirSim is a simulator for quadrotors (and soon other vehicles) built on Unreal Engine. It is open-source, cross platform and supports hardware-in-loop with popular platforms such as PixHawk for physically and visually realistic simulations. It is developed as an Unreal plugin that can simply be dropped in to any Unreal environment you want.

Our goal is to develop AirSim as a platform for AI research where we can experiment with deep learning, computer vision and reinforcement learning algorithms for autonomous vehicles. For this purpose, AirSim also exposes APIs to retrieve data and control vehicles in a platform independent way.

AirSim Demo Video

Development Status

This project is under heavy development. While we are working through our backlog of new features and known issues, we welcome contributions! Our current release is in beta and our APIs are subject to change.

How to Get It

Prerequisites

To get the best experience you will need PixHawk or compatible device and a RC controller. These enables the "hardware-in-loop simulation" that provides more realistic experience. Follow these instructions on how to get it, set it up and other alternatives.

Windows

There are two ways to get AirSim working on your machine. Click on below links and follow the instructions.

  1. Build it and use it with Unreal
  2. Use the precompiled binaries

Linux

The official Linux build is expected to arrive in about a couple of weeks. All our current code is cross-platform and CMake enabled so please feel free to play around on other operating systems and report any issues. We would love to make AirSim available on other platforms as well.

How to Use It

Manual flights

Just plugin your PixHawk (or compatible device) in your USB port, turn on the RC and press the Play button in Unreal. You should be able to control the quadrotor in the simulator with the RC and fly around. Press F1 key to view several available keyboard shortcuts.

More detailed instructions and troubleshooting

Gathering training data

There are two ways you can generate training data from AirSim. The easiest way is to simply press the record button on the lower right corner. This will start writing pose and images for each frame. If you would like more data logging capabilities and other features, [file a feature request]https://github.com/Microsoft/AirSim/issues) or contribute changes. The data logging code is pretty simple and you can modify it to your heart's desire.

A more complex way to generate training data is by writing client code that uses our APIs. This allows you to be in full control of how, what, where and when you want to log data. See the next section for more details.

Programmatic control

The AirSim exposes easy to use APIs in order to retrive data from the quadrotor that includes ground truth, sensor data as well as various images. It also exposes APIs to control the quadrotor in a platform independent way. This allows you to use your code to control different quadrotor platforms, for example, PixHawk or DJI Matrice, without any changes.

These APIs are also available as a part of a separate independent cross-platform library so you can deploy them on an offboard computer on your vehicle. This way you can write and test your code in simulator and later execute it on the real quadrotor. Transfer learning and related research is one of our focus areas.

More detailed instructions for using APIs

Paper

You can get additional technical details in our paper (work in progress). Please cite this as:

@techreport{MSR-TR-2017-9,
     title = {{A}erial {I}nformatics and {R}obotics Platform},
     author = {Shital Shah and Debadeepta Dey and Chris Lovett and Ashish Kapoor},
     year = {2017},
     institution = {Microsoft Research},
     number = {{M}{S}{R}-{T}{R}-2017-9}}
}

Contribute

We welcome contributions to help advance research frontiers.

License

This project is released under MIT License. Please review License file for more details.

About

Open source simulator based on Unreal Engine for autonomous vehicles from Microsoft AI & Research

Resources

License

Stars

Watchers

Forks

Packages

No packages published

Languages

  • C++ 74.7%
  • C# 21.4%
  • C 2.7%
  • Python 0.5%
  • CMake 0.3%
  • Shell 0.3%
  • Batchfile 0.1%