Autonomous robotic bin picking platform generated from human demonstration and YOLOv5
Jinho Park(Purdue University)
USA | Journal of Manufacturing Science and Engineering
2023 | 바로가기
computer-integratedmanufacturing, robotics
Cited by 2
■ View full text
Journal of Manufacturing Science and Engineering (2023): 1-33.
https://url.kr/dogb5u
■ Researchers
Jinho Park
Indiana Next Generation Manufacturing Competitiveness Center (IN-MaC), Purdue University
Park, J., C. Han, M.B.G. Jun, and H. Yun*
■ Abstract
Vision-basedrobotshavebeenutilizedforpick-and-placeoperationsbytheirabilitytofind objectposes.Astheyprogressintohandlingavarietyofobjectswithclutteredstate,more flexibleandlightweightoperationshavebeenpresented.Inthispaper,anautonomous roboticbin-pickingplatformisproposed.ItcombineshumandemonstrationwithacollaborativerobotfortheflexibilityoftheobjectsandYOLOv5neuralnetworkmodelforfaster objectlocalizationwithoutpriorcomputer-aideddesignmodelsordatasetinthetraining. Afterasimplehumandemonstrationofwhichtargetobjecttopickandplace,therawcolor anddepthimageswererefined,andtheoneontopofthebinwasutilizedtocreatesynthetic imagesandannotationsfortheYOLOv5model.Topickupthetargetobject,thepointcloud wasliftedusingthedepthdatacorrespondingtotheresultofthetrainedYOLOv5model, andtheobjectposewasestimatedbymatchingthemwithIterativeClosestPoints(ICP) algorithm.Afterpickingupthetargetobject,therobotplaceditwheretheuserdefinedit intheprevioushumandemonstrationstage.Fromtheresultofexperimentswithfour typesofobjectsandfourhumandemonstrations,ittookatotalof0.5storecognizethe targetobjectandestimatetheobjectpose.Thesuccessrateofobjectdetectionwas 95.6%,andthepick-and-placemotionofallthefoundobjectswassuccessful.
- computer-integratedmanufacturing
- robotics
전체댓글 0