Intelligent Systems
Note: This research group has relocated. Discover the updated page here

Learning Variable Impedance Control for Contact Sensitive Tasks

2020

Article

mg


Reinforcement learning algorithms have shown great success in solving different problems ranging from playing video games to robotics. However, they struggle to solve delicate robotic problems, especially those involving contact interactions. Though in principle a policy outputting joint torques should be able to learn these tasks, in practice we see that they have difficulty to robustly solve the problem without any structure in the action space. In this paper, we investigate how the choice of action space can give robust performance in presence of contact uncertainties. We propose to learn a policy that outputs impedance and desired position in joint space as a function of system states without imposing any other structure to the problem. We compare the performance of this approach to torque and position control policies under different contact uncertainties. Extensive simulation results on two different systems, a hopper (floating-base) with intermittent contacts and a manipulator (fixed-base) wiping a table, show that our proposed approach outperforms policies outputting torque or position in terms of both learning rate and robustness to environment uncertainty.

Author(s): Miroslav Bogdanovic and Majid Khadiv and Ludovic Righetti
Journal: IEEE Robotics and Automation Letters
Volume: 5(4)
Year: 2020
Month: July
Publisher: IEEE

Department(s): Movement Generation and Control
Bibtex Type: Article (article)
Paper Type: Journal

DOI: 10.1109/LRA.2020.3011379
State: Published

BibTex

@article{bogdanovic2019learningb,
  title = {Learning Variable Impedance Control for Contact Sensitive Tasks},
  author = {Bogdanovic, Miroslav and Khadiv, Majid and Righetti, Ludovic},
  journal = {IEEE Robotics and Automation Letters},
  volume = {5(4)},
  publisher = {IEEE},
  month = jul,
  year = {2020},
  doi = {10.1109/LRA.2020.3011379},
  month_numeric = {7}
}