- Isaac Gym 1.0.preview4
- https://github.com/NVIDIA-Omniverse/IsaacGymEnvs
- To perceive obstacles, image information is given to RL agents.
- We preprocess the image information uisng VAE, and the encoded vectors are given as observations.
- Therefore, the environment is constructed as follows:
- Images are collected in
vae/collect.py
with theDummyJackal
task. - Encder and Decoder are trained in
vae/main.py
. - Using the trained encoder, the
Jackal
task is constructed inutils/jackal_env/task2.py
.
- Images are collected in
# 1. Collect images.
cd vae
python collect.py
# 2. Train VAE.
python main.py
# 3. Train PPO agents.
cd ../ppo
python main.py
# 4. Visualize PPO agents.
python main.py --test