[ ![Release] release-image ] releases
[ license-image ] license
| Platform | Build Status |
|---|---|
| Linux and OS X |  |
| Windows |
This project is a cross-platform library (Linux, OSX, Windows) for capturing data from the Intel® RealSense™ F200, SR300 and R200 cameras. This effort was initiated to better support researchers, creative coders, and app developers in domains such as robotics, virtual reality, and the internet of things. Several often-requested features of RealSense™ devices are implemented in this project, including multi-camera capture.
Developer kits containing the necessary hardware to use this library are available for purchase at this link. This project is separate from the production software stack available in the Intel® RealSense™ SDK, namely that this library only encompasses camera capture functionality without additional computer vision algorithms.
The Intel® RealSense™ Cross Platform API is experimental and not an official Intel product. It is subject to incompatible API changes in future updates. Breaking API changes are noted through release numbers with semver.
The project requires two external dependencies, GLFW3 (all platforms) and libusb-1.0 (Mac/Linux). These dependencies should be gathered through manual steps that are enumerated as part of this readme file (i.e. these packages must be installed with apt-get on Linux and Homebrew on OSX). GLFW is not required for the core library and is only used for examples.
- Compatible Devices
- Supported Platforms
- Compatible Languages
- Functionality
- Installation Guide
- Hardware Requirements
- Integrations
- Documentation
- RealSense R200
- RealSense F200
- RealSense SR300
The library is written in standards-conforming C++11 and relies only on the C89 ABI for its public interface. It is developed and tested on the following platforms:
- Windows 8.1 (Visual Studio 2013 Update 5)
- Ubuntu 14.04.03 LTS x64 (GCC 4.9 toolchain)
- Mac OS X 10.7+ (Clang toolchain)
Neither libuvc nor V4L2 backends have been validated on Ubuntu 12.04 LTS or Ubuntu 15.10, and several attempts to bring cameras up on these platforms have been problematic due to the requirement of a patched uvcvideo driver. It may be possible to compile and run the library on other platforms. Please file an issue or submit a pull request if the library has been successfully ported to a platform.
- C - Core library API exposed via the C89 ABI
- C++ - Single header file (rs.hpp) wrapper around C API, providing classes and exceptions
- Native streams: depth, color, infrared
- Synthetic streams: rectified images, depth aligned to color and vice versa, etc.
- Intrinsic/extrinsic calibration information
- Majority of hardware-specific functionality for individual camera generations (UVC XU controls)
- Multi-camera capture across heterogeneous camera architectures (e.g. mix R200 and F200 in same application)
All RealSense™ cameras ship with proprietary firmware. This firmware is periodically updated with critical bugfixes, however the API does not currently expose functionality to upload new firmware. A supported update path is available on Windows 8.1 and Windows 10 systems via the Intel® RealSense™ DCM (Depth Camera Manager). Installing the DCM on a supported machine with an attached camera will automatically flash the latest firmware released by Intel.
| Camera | F/W |
|---|---|
| R200 | 1.0.72.04 |
| F200 | 2.60.0.0 |
| SR300 | 3.10.10.0 |
The Intel® RealSense™ Cross Platform API communicates with RealSense™ devices directly via the UVC and USB protocols. It does not link against the RealSense™ SDK runtime. Most of the library source code is platform agnostic, but there is a small UVC abstraction layer with platform-specific backends, including:
- A video4linux2 backend which provides kernel-space access to UVC devices on Linux.
- A libuvc backend which provides user-space access to UVC devices on Linux and Mac OS X (built with libusb).
- A Windows Media Foundation backend which provides kernel-space access to UVC devices on Windows 8.1 and above.
New Users: A comprehensive installation guide is available here
Developer kits containing the necessary hardware to use this library are available for purchase at this link. In addition, several consumer tablets and laptops with integrated cameras may also function, such as the HP Spectre x2 with R200.
Developer kits require USB 3.0. RealSense™ cameras do not provide backwards compatibility with USB 2.0. Not all USB host chipsets are compatible with this library, although it has been validated with recent generations of the Intel Host Controller chipset. An exhaustive list of incompatible hardware is not presently provided. On x86, a Haswell or newer architecture is recommended.
For small-form factor usages, this library has been demonstrated to work on the following boards:
The library has been integrated with a number of third-party components and operating systems. While most of these projects are not directly supported by the team, they are useful resources for users of this library.
- Robotic Operating System (Intel Supported, R200 Only)
- Yocto / WindRiver Linux
- Arch Linux
A comprehensive suite of sample and tutorial applications are provided in the /examples subdirectory. For new users, it is best to review the tutorial series of apps which are designed to progressively introduce API features.
- Installation Instructions - Comprehensive platform-specific installation steps
- C API - With doxygen-style API comments
- Projection APIs - A guide on coordinate systems, calibration information, and projection
- Camera Spec Sheet - A brief overview of R200, F200 and SR300
- Developer Notes - Several informal notes gathered during internal releases
Copyright 2015 Intel Corporation
Licensed under the Apache License, Version 2.0 (the "License"); you may not use this project except in compliance with the License. You may obtain a copy of the License at
http://www.apache.org/licenses/LICENSE-2.0
Unless required by applicable law or agreed to in writing, software distributed under the License is distributed on an "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. See the License for the specific language governing permissions and limitations under the License.