The paper deals with a lead-through method of programming for industrial robots. The goal is to automatically reproduce 6DoF trajectories of a tool wielded by a human operator demonstrating a motion task. We present a novel motion-tracking system built around the HTC Vive pose estimation system. Our solution allows complete automation of the robot teaching process. Specific algorithmic issues of system calibration and motion data post-processing are also discussed, constituting the paper's theoretical contribution. The motion tracking system is successfully deployed in a pilot application of robot-assisted spray painting.

NTIS Research Centre Faculty of Applied Sciences University of West Bohemia 30100 Pilsen Czech Republic

Zobrazit více v PubMed

IFR World Robotics Report. [(accessed on 7 June 2022)]. Available online: https://ifr.org/ifr-press-releases/news/record-2.7-million-robots-work-in-factories-around-the-globe.

Sanneman L., Fourie C., Shah J.A. The State of Industrial Robotics: Emerging Technologies, Challenges, and Key Research Directions. Found. Trends Robot. 2021;8:225–306. doi: 10.1561/2300000065. DOI

Vicentini F. Collaborative robotics: A survey. J. Mech. Des. 2021;143:040802. doi: 10.1115/1.4046238. DOI

Hentout A., Aouache M., Maoudj A., Akli I. Human–robot interaction in industrial collaborative robotics: A literature review of the decade 2008–2017. Adv. Robot. 2019;33:764–799. doi: 10.1080/01691864.2019.1636714. DOI

Fanuc Collaborative Robot Hand Guidance. [(accessed on 7 June 2022)]. Available online: https://www.fanuc.eu/ua/en/robots/accessories/hand-guidance.

Programming Robots in Next to No Time: Hand Guiding with KUKA Ready2_Pilot. [(accessed on 7 June 2022)]. Available online: https://www.kuka.com/en-us/company/press/news/2020/11/ready2_pilot.

Rossano G.F., Martinez C., Hedelind M., Murphy S., Fuhlbrigge T.A. Easy robot programming concepts: An industrial perspective; Proceedings of the 2013 IEEE International Conference on Automation Science and Engineering (CASE); Madison, WI, USA. 17–20 August 2013; pp. 1119–1126.

Canfield S.L., Owens J.S., Zuccaro S.G. Zero moment control for lead-through teach programming and process monitoring of a collaborative welding robot. J. Mech. Robot. 2021;13:031016. doi: 10.1115/1.4050102. DOI

Griffiths C.A., Giannetti C., Andrzejewski K.T., Morgan A. Comparison of a Bat and Genetic Algorithm Generated Sequence Against Lead Through Programming When Assembling a PCB Using a Six-Axis Robot with Multiple Motions and Speeds. IEEE Trans. Ind. Inform. 2021;18:1102–1110. doi: 10.1109/TII.2021.3082877. DOI

API Radian Laser Trackers. [(accessed on 7 June 2022)]. Available online: https://apimetrology.com/radian/

FARO Vantage Laser Trackers. [(accessed on 7 June 2022)]. Available online: https://www.faro.com/en/Products/Hardware/Vantage-Laser-Trackers.

Leica Laser Trackers. [(accessed on 7 June 2022)]. Available online: https://www.hexagonmi.com/en-GB/products/laser-tracker-systems/leica-absolute-tracker-at960.

Omnitrac 2 Laser Tracker. [(accessed on 7 June 2022)]. Available online: https://www.ems-usa.com/products/3d-scanners/api-laser-trackers/omnitrac-2.

VICON Motion Capture System. [(accessed on 7 June 2022)]. Available online: https://www.vicon.com/

LEAP Motion Tracker System. [(accessed on 7 June 2022)]. Available online: https://www.ultraleap.com/product/leap-motion-controller/

OptiTrack. [(accessed on 7 June 2022)]. Available online: https://www.optitrack.com/

Orbit Series Motion Capture Cameras. [(accessed on 7 June 2022)]. Available online: https://www.nokov.com/en/products/motion-capture-cameras/Oribit.html.

Čečil R., Tolar D., Schlegel M. RF Synchronized Active LED Markers for Reliable Motion Capture; Proceedings of the 2021 International Conference on Electrical, Computer, Communications and Mechatronics Engineering (ICECCME); Port Louis, Mauritius. 7–8 October 2021; pp. 1–10. DOI

Ferreira M., Costa P., Rocha L., Moreira A.P. Stereo-based real-time 6-DoF work tool tracking for robot programing by demonstration. Int. J. Adv. Manuf. Technol. 2016;85:57–69. doi: 10.1007/s00170-014-6026-x. DOI

HiBall Wide-Area Optical Tracking System. [(accessed on 7 June 2022)]. Available online: http://www.cs.unc.edu/~tracker/media/pdf/Welch2001_HiBall_Presence.pdf.

Otus Tracker (Discontinued) [(accessed on 7 June 2022)]. Available online: https://www.tytorobotics.com/pages/otus-tracker.

Ruzarovsky R., Holubek R., Delgado Sobrino D.R., Janíček M. The Simulation of Conveyor Control System Using the Virtual Commissioning and Virtual Reality. Adv. Sci. Technol. Res. J. 2018;12:164–171. doi: 10.12913/22998624/100349. DOI

Shintemirov A., Taunyazov T., Omarali B., Nurbayeva A., Kim A., Bukeyev A., Rubagotti M. An Open-Source 7-DOF Wireless Human Arm Motion-Tracking System for Use in Robotics Research. Sensors. 2020;20:3082. doi: 10.3390/s20113082. PubMed DOI PMC

Qi L., Zhang D., Zhang J., Li J. A lead-through robot programming approach using a 6-DOF wire-based motion tracking device; Proceedings of the 2009 IEEE International Conference on Robotics and Biomimetics (ROBIO); Guilin, China. 19–23 December 2009; pp. 1773–1777. DOI

Lu X., Jia Z., Hu X., Wang W. Double position sensitive detectors (PSDs) based measurement system of trajectory tracking of a moving target. Eng. Comput. 2017;34:781–799. doi: 10.1108/EC-08-2015-0214. DOI

HTC Vive Tracker. [(accessed on 7 June 2022)]. Available online: https://www.vive.com/eu/accessory/tracker3/

Bauer P., Lienhart W., Jost S. Accuracy Investigation of the Pose Determination of a VR System. Sensors. 2021;21:1622. doi: 10.3390/s21051622. PubMed DOI PMC

Borges M., Symington A.C., Coltin B., Smith T., Ventura R. HTC Vive: Analysis and Accuracy Improvement; Proceedings of the 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS); Madrid, Spain. 1–5 October 2018; pp. 2610–2615.

Al-Ibadi A., Nefti-Meziani S., Davis S. Active Soft End Effectors for Efficient Grasping and Safe Handling. IEEE Access. 2018;6:23591–23601. doi: 10.1109/ACCESS.2018.2829351. DOI

Libsurvive Library—Open Source Lighthouse Tracking System. [(accessed on 7 June 2022)]. Available online: https://github.com/cntools/libsurvive.

REXYGEN—Programming Automation Devices without Hand Coding. [(accessed on 7 June 2022)]. Available online: www.rexygen.com.

ReactiveX for Python (RxPY) [(accessed on 7 June 2022)]. Available online: https://rxpy.readthedocs.io/en/latest/

MAVLink Developer Guide—Common Message Set. [(accessed on 7 June 2022)]. Available online: https://mavlink.io/en/messages/common.html.

Golub G.H., Van Loan C.F. Matrix Computations. 3rd ed. The Johns Hopkins University Press; Baltimore, MD, USA: 1996.

What Is REST—API Tutorial. [(accessed on 7 June 2022)]. Available online: https://restfulapi.net/

MathWorks Help Center—1-D Data Interpolation in Matlab. [(accessed on 7 June 2022)]. Available online: https://www.mathworks.com/help/matlab/ref/interp1.html.

MathWorks Help Center—Zero-Phase Digital Filtering. [(accessed on 7 June 2022)]. Available online: https://www.mathworks.com/help/signal/ref/filtfilt.html.

Gustafsson F. Determining the initial states in forward-backward filtering. IEEE Trans. Signal Process. 1996;44:988–992. doi: 10.1109/78.492552. DOI

Proakis J.G., Manolakis D.K. Digital Signal Processing. 4th ed. Prentice Hall; Hoboken, NJ, USA: 2006.

Harris F.J. On the Use of Windows for Harmonic Analysis with the Discrete Fourier Transform. Proc. IEEE. 1978;66:51–83. doi: 10.1109/PROC.1978.10837. DOI