Vision Perception-based Adaptive Pushing Assisted Grasping Network for Dense Clutters

During the execution of a robotic grasping task, the task may fail due to the close proximity of multiple objects if grasping is the only motion primitive. Non-prehensile manipulations, such as pushing, can be used to rearrange objects and benefit grasping. Varying pushing actions with different spe...

Full description

Saved in:
Bibliographic Details
Published in:Chinese Control Conference pp. 8411 - 8416
Main Authors: Liu, Xinqi, Chai, Runqi, Wang, Shuo, Chai, Senchun, Xia, Yuanqing
Format: Conference Proceeding
Language:English
Published: Technical Committee on Control Theory, Chinese Association of Automation 28.07.2024
Subjects:
Adaptation models
Adaptive systems
Big Data in Robotics and Automation
Clutter
Force
Grasping
Reinforcement Learning
Robotics Control
Robots
Vision Perception
ISSN:1934-1768
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:During the execution of a robotic grasping task, the task may fail due to the close proximity of multiple objects if grasping is the only motion primitive. Non-prehensile manipulations, such as pushing, can be used to rearrange objects and benefit grasping. Varying pushing actions with different speeds, distances, and routines may result in better performance. In this study, we propose a vision perception-based Adaptive Pushing Assisted Grasping Network (APAGN) system for generating a sequence of actions that includes grasping and adaptive pushing. APAGN can perceive the scene and then predict the locations of objects after an adaptive push, which adjusts the force and direction of pushing based on expected performance. To achieve a more efficient calculation, an Action Selector of APAGN is designed to choose the object with the highest expected outcome before making a prediction. The value of pushing actions is estimated based on how they benefit grasping, which breaks the limitation of manually designed rewards. Simulations show that APAGN might achieve higher action efficiency than baseline methods, especially in cluttered environments.
ISSN:1934-1768
DOI:10.23919/CCC63176.2024.10662371