Istrazivanja i projektovanja za privreduJournal of Applied Engineering Science

MODULAR CLIMBing ROBOT DESing WITH AUTOMATED VISION-BASED DEFECT CLASSIFICATION


DOI: 10.5937/jaes0-37355 
This is an open access article distributed under the CC BY 4.0
Creative Commons License

Peter O. Oyekola*
Department of Mechanical Engineering, Tennessee Tech University, Cookeville, USA

Shoeb Ahmed Syed
Department of Mechanical Engineering, Papua New Guinea University of Technology, PNG

In the examination of critical infrastructure for failure, common problems faced are restricted access to the inspection site, size and geometry constraints, cost, and extended inspection period. Facilities such as marine vessels, petrochemical pressure vessels, rail lines, and airplane fuselage, are regularly inspected. Mostly manual techniques with sensors like cameras and non-destructive testing kits are usually employed in detecting structural defects such as cracks and corrosion which constitute the central part of the cost and time spent. This paper, therefore, describes the design of a modular climbing robot for industrial inspection of structures. The main aim of improving and automating defect classification and identification is achieved by applying computer vision with an embedded wireless camera. YOLOv4 machine learning algorithm is implemented to identify and classify surface cracks and corrosion. The robot design combines a set of 6-DOF modular arm and tracked locomotion system. Embedded magnets are integrated into the design to aid navigation on vertical ferromagnetic structures and uneven surfaces. The final design shows that the robot can successfully navigate ferromagnetic structures, detect defects, and climb over moderately sized obstacles without loss of adhesion. This ensures performance in unfriendly and inaccessible environments, reducing costs and inspection time considerably.

View article

1.     P. Oyekola, A. Mohamed, and J. Pumwa, “Robotic model for unmanned crack and corrosion inspection,” International Journal of Innovative Technology and Exploring Engineering, vol. 9, no. 1, pp. 862–867, Nov. 2019, doi: 10.35940/ijitee.A4367.119119.

2.      A. S. Rajawat, R. Rawat, K. Barhanpurkar, R. N. Shaw, and A. Ghosh, “Robotic process automation with increasing productivity and improvin  g product quality using artificial intelligence and machine learning,” in Artificial Intelligence for Future Generation Robotics, Elsevier, 2021, pp. 1–13.

3.      P. O. Oyekola, S. Kolawole, S. A. Syed, and O. Apis, “Application of Computer Vision in Pipeline Inspection Robot,” 2021.

4.      A. Skoczylas, P. Stefaniak, S. Anufriiev, and B. Jachnik, “Belt conveyors rollers diagnostics based on acoustic signal collected using autonomous legged inspection robot,” Applied Sciences, vol. 11, no. 5, p. 2299, 2021.

5.      M. Fisher et al., “An overview of verification and validation challenges for inspection robots,” Robotics, vol. 10, no. 2, p. 67, 2021.

6.      M. Z. Ab Rashid, M. F. M. Yakub, S. A. Z. bin Shaikh Salim, N. Mamat, S. M. S. M. Putra, and S. A. Roslan, “Modeling of the in-pipe inspection robot: A comprehensive review,” Ocean Engineering, vol. 203, p. 107206, 2020.

7.      Saiigdeok Park, Hee Don Jeong, and Zhong Soo Lim, “Design of a mobile robot system for automatic integrity evaluation of large size reservoirs and pipelines in industrial fields,” 2004. doi: 10.1109/iros.2003.1249265.

8.      J. Wang, J. Huang, and R. Cheng, “Automatic reading system for analog instruments based on computer vision and inspection robot for power plant,” in 2018 10th International Conference on Modelling, Identification and Control (ICMIC), 2018, pp. 1–6.

9.      H. Ahmed, H. M. La, and N. Gucunski, “Review of non-destructive civil infrastructure evaluation for bridges: State-of-the-art robotic platforms, sensors and algorithms,” Sensors, vol. 20, no. 14, p. 3954, 2020.

10.   A. Perelli, L. De Marchi, A. Marzani, and S. Freear, “Compressive Sensing for Damage Detection in Composite Aircraft Wings,” Structural Health Monitoring 2013, Vols 1 and 2, 2013.

11.   C. Yuan, B. Xiong, X. Li, X. Sang, and Q. Kong, “A novel intelligent inspection robot with deep stereo vision for three-dimensional concrete damage detection and quantification,” Structural Health Monitoring, vol. 21, no. 3, pp. 788–802, 2022.

12.   N. Elkmann, T. Felsch, M. Sack, J. Saenz, and J. Hortig, “Innovative service robot systems for facade cleaning of difficult-to-access areas,” IEEE International Conference on Intelligent Robots and Systems, 2002, doi: 10.1109/IRDS.2002.1041481.

13.   J. Li, S. Jin, C. Wang, J. Xue, and X. Wang, “Weld line recognition and path planning with spherical tank inspection robots,” Journal of Field Robotics, vol. 39, no. 2, pp. 131–152, 2022.

14.   R. Enjikalayil Abdulkader, P. Veerajagadheswar, N. Htet Lin, S. Kumaran, S. R. Vishaal, and R. E. Mohan, “Sparrow: A magnetic climbing robot for autonomous thickness measurement in ship hull maintenance,” Journal of Marine Science and Engineering, vol. 8, no. 6, p. 469, 2020.

15.   W. Shen, J. Gu, and Y. Shen, “Permanent Magnetic System Design for the Wall-Climbing Robot,” Applied Bionics and Biomechanics, 2015, doi: 10.1155/2006/143256.

16.   G. Niu, J. Wang, and K. Xu, “Model analysis for a continuum aircraft fuel tank inspection robot based on the Rzeppa universal joint,” Advances in Mechanical Engineering, vol. 10, no. 5, p. 1687814018778229, 2018.

17.   W. Guo, M. Zhong, M. T. Li, and Y. Li, “Design of a six legged wall-climbing robot,” 2008. doi: 10.1109/ARSO.2008.4653597.

18.   Y. Liu, S. Sun, X. Wu, and T. Mei, “A leg-wheel wall-climbing robot utilizing bio-inspired spine feet,” 2013. doi: 10.1109/ROBIO.2013.6739732.

19.   K. A. Daltorio et al., “Mini-whegsTM climbs steep surfaces using insect-inspired attachment mechanisms,” International Journal of Robotics Research, 2009, doi: 10.1177/0278364908095334.

20.   P. Boscariol, M. A. Henrey, Y. Li, and C. Menon, “Optimal Gait for Bioinspired Climbing Robots Using Dry Adhesion: A Quasi-Static Investigation,” Journal of Bionic Engineering, 2013, doi: 10.1016/S1672-6529(13)60193-6.

21.   C. Balaguer, A. Gimenez, and A. Jordon, “Climbing robots’ mobility for inspection and maintenance of 3D complex environments,” Autonomous Robots, 2005, doi: 10.1007/s10514-005-0723-0.

22.   S. Wu, L. Wu, and T. Liu, “Design of a sliding wall climbing robot with a novel negative adsorption device,” 2011. doi: 10.1109/URAI.2011.6145940.

23.   R. Lal Tummala et al., “Climbing the walls [robots],” IEEE Robotics & Automation Magazine, 2003, doi: 10.1109/mra.2002.1160067.

24.   R. D. Dethe and S. B. Jaju, “Developments in wall climbing robots: a review,” International journal of engineering research and general science, vol. 2, no. 3, pp. 33–42, 2014.

25.   H. Albitar, A. Ananiev, and I. Kalaykov, “New concept of in-water surface cleaning robot,” 2013. doi: 10.1109/ICMA.2013.6618150.

26.   Y. Yoshida and S. Ma, “A wall-climbing robot without any active suction mechanisms,” 2011. doi: 10.1109/ROBIO.2011.6181587.

27.   J. Gu, C. Wang, and X. Wu, “Self-adjusted adsorption strategy for an aircraft skin inspection robot,” Journal of Mechanical Science and Technology, vol. 32, no. 6, pp. 2867–2875, 2018.

28.   M. Carlo and S. Metin, “A Biomimetic Climbing Robot Based on the Gecko,” Journal of Bionic Engineering, 2006, doi: 10.1016/S1672-6529(06)60015-2.

29.   K. H. Koh, R. M. Kuppan Chetty, and S. G. Ponnambalam, “Modeling and simulation of electrostatic adhesion for wall climbing robot,” 2011. doi: 10.1109/ROBIO.2011.6181590.

30.   J. Sánchez, F. Vázquez, and E. Paz, “Machine vision guidance system for a modular climbing robot used in shipbuilding,” 2006. doi: 10.1007/3-540-26415-9-107.

31.   “Robotics - Standards | Occupational Safety and Health Administration.” https://www.osha.gov/robotics/standards (accessed Aug. 19, 2022).

32.   “Standards, Guidelines & Industry Best Practices for Industrial & Collaborative Robots | RoboticsTomorrow.” https://roboticstomorrow.com/article/2021/08/standards-guidelines-industry-best-practices-for-industrial-collaborative-robots/17289 (accessed Aug. 19, 2022).

33.   M. Oitzman, “Mobile Robot Standards,” Mobile Robot Guide, May 18, 2021. https://mobilerobotguide.com/2021/05/18/mobile-robot-standards/ (accessed Aug. 19, 2022).

34.   A. M. Mohamed, Z. A. Zyada, and E. A. El-Shenawy, “Design, modeling and control of a wall climbing robot crossingover obstacles,” 2014 IEEE/SICE International Symposium on System Integration, SII 2014, pp. 46–51, 2014, doi: 10.1109/SII.2014.7028009.

35.   C. D. Bellicoso, L. R. Buonocore, V. Lippiello, and B. Siciliano, “Design, modeling and control of a 5-DoF light-weight robot arm for aerial manipulation,” 2015. doi: 10.1109/MED.2015.7158852.

36.   C. Park, J. Bae, S. Ryu, J. Lee, and T. Seo, “R-track: separable modular climbing robot design for wall-to-wall transition,” IEEE Robotics and Automation Letters, vol. 6, no. 2, pp. 1036–1042, 2020.

37.   X. Chen, Y. Wu, H. Hao, H. Shi, and H. Huang, “Tracked wall-climbing robot for calibration of large vertical metal tanks,” Applied Sciences, vol. 9, no. 13, p. 2671, 2019.