ReorientBot

Learning Object Reorientation for Specific-Posed Placement

Kentaro Wada, Stephen James, Andrew J. Davison
Dyson Robotics Laboratory, Imperial College London
IEEE International Conference on Robotics and Automation (ICRA), 2022

Installation | Usage | Paper | Video | Webpage

---

Installation

Python project only

make install

source .anaconda3/bin/activate
./checks/check_motion_planning.py

ROS project

• robot-agent: A computer for visual processing.
• robot-node: A computer with a real-time OS for a Panda robot.

@robot-agent

make install
source .anaconda3/bin/activate

cd ros/
make install
source devel/setup.sh

@robot-node

cd ros/
source /opt/ros/noetic/setup.sh

catkin build morefusion_panda
rosrun morefusion_panda create_udev_rules.sh

catkin build reorientbot_ros

Usage

Training & inference

Reorient pose selection

cd examples/reorientation/

./download_piles.py

# # train from scratch
# for seed in $(seq 0 4999); do
#   ./pickable_create_dataset.py --seed $seed
# done
# ./pickable_view_dataset.py
# ./pickable_train.py --name franka_panda-panda_suction

# NOTE: replace model path to use your own model
./pickable_eval.py --seed 0

Figure 1. Reorient pose selection's dataset (left) and inference (right)

Reorient motion selection

# # train from scratch
# for seed in $(seq 0 4999); do
#   ./reorientable_create_dataset.py --seed $seed
# done
# ./reorientable_view_dataset.py
# ./reorientable_train.py --name franka_panda-panda_suction

# NOTE: replace model path to use your own model
./reorient_dynamic.py --seed 0 --face front

Figure 2. Reorient motion selection's dataset (left) and inference (right)

Real-world demonstration

robot-node  $ roslaunch reorientbot_ros panda_control.launch

robot-agent $ roslaunch reorientbot_ros setup.launch
robot-agent $ rosrun reorientbot_ros reorientbot_task_interface.py
>>> # self.run_singleview()
>>> self.run_multiview()

Figure 3. Robotic rearrangement while picking, reorienting and placing objects.

Citation

@inproceedings{Wada:etal:ICRA2022b,
  title={{ReorientBot}: Learning Object Reorientation for Specific-Posed Placement},
  author={Kentaro Wada and Stephen James and Andrew J. Davison},
  booktitle={IEEE International Conference on Robotics and Automation (ICRA)},
  year={2022},
}