Pengembangan Aplikasi berbasis Virtual Reality untuk Sistem Teaching Robot pada SmartEdu Station
DOI:
https://doi.org/10.47065/bulletincsr.v6i4.1187Keywords:
Digital Twin; Inverse Kinematics; Robotic Arm; System Usability Scale; Virtual RealityAbstract
Conventionally, the trajectory programming procedure for industrial robots using physical teach pendants imposes a high cognitive load, is prone to triggering structural collision accidents for novice students, and limits training efficiency due to the minimal availability of equipment. This study aims to solve these issues by developing an autonomous direct teaching system for the UR5e manipulator utilizing Virtual Reality (VR) technology and a Digital Twin architecture at the SmartEdu-Station facility. As a solution, the system captures global spatial coordinate inputs from the user's natural hand movements via 6-DoF VR controller tracking, then translates them into real-time virtual robot posture visualization using Inverse Kinematics computation. The trajectory coordinate sets are validated for safety as autonomous waypoint data before being transmitted to the physical controller. Empirical testing results prove that data communication via TCP/IP and RTDE protocols records a trajectory packet transmission success rate of 100%, with an average execution response delay consistently under 1 second. Furthermore, interface ergonomics testing using the System Usability Scale (SUS) questionnaire on 10 respondents yielded an average score of 79.0 (Good Category). This research contributes significantly by providing an offline teaching simulation framework that successfully eliminates the risk of physical equipment damage while interactively and safely reducing the learning curve of spatial mapping.
Downloads
References
M. C. Castells, M. Puig i Vidal, and L. S. Serapio, “Control of a UR5e robotic arm through a simulate 2D camera,” pp. 3–8, 2020.
D.-A. Ciungan et al., “Enhancing IoT Education Through Hybrid Robotic Arm Integration: A Quantitative and Qualitative Student Experience Study,” Appl. Sci., vol. 15, no. 19, p. 10537, 2025, doi: 10.3390/app151910537.
B. S. H. Alsoliman, “Virtual robotics in education: The experience of eighth grade students in STEM,” Front. Educ., vol. 7, no. July, pp. 1–12, 2022, doi: 10.3389/feduc.2022.950766.
M. F. Wirayudha, G. W. Wiriasto, and Paniran, “Prototype Model 3D Robot Lengan dan Simulasi Kendali Pergerakan pada 4-DOF Berbasis Virtual Reality,” J. Ilm. Kaji. Teor. dan Apl. Tek. Elektro , vol. 11, no. 2, pp. 159–166, 2024, [Online]. Available: www.petercork.com
W. Chang, W. Sun, P. Chen, and H. Xu, “Construction and Validation of a Digital Twin-Driven Virtual-Reality Fusion Control Platform for Industrial Robots,” Sensors, vol. 25, no. 13, 2025, doi: 10.3390/s25134153.
Y. Wu, B. Zhao, and Q. Li, “The Teleoperation of Robot Arms by Interacting with an Object’s Digital Twin in a Mixed Reality Environment,” Appl. Sci., vol. 15, no. 7, pp. 1–18, 2025, doi: 10.3390/app15073549.
B. R. Galarza, P. Ayala, S. Manzano, and M. V. Garcia, “Virtual Reality Teleoperation System for Mobile Robot Manipulation,” Robotics, vol. 12, no. 6, 2023, doi: 10.3390/robotics12060163.
K. Wan, C. Li, F. S. Lo, and P. Zheng, “A virtual reality-based immersive teleoperation system for remote human-robot collaborative manufacturing,” Manuf. Lett., vol. 41, pp. 43–50, 2024, doi: 10.1016/j.mfglet.2024.09.008.
T. Luu et al., “Enhancing real-time robot teleoperation with immersive virtual reality in industrial IoT networks,” Int. J. Adv. Manuf. Technol., vol. 139, no. 11–12, pp. 6233–6257, 2025, doi: 10.1007/s00170-025-16236-w.
F. P. Audonnet, J. Grizou, A. Hamilton, and G. Aragon-Camarasa, “TELESIM: A Modular and Plug-and-Play Framework for Robotic Arm Teleoperation using a Digital Twin,” Proc. - IEEE Int. Conf. Robot. Autom., pp. 17770–17777, 2024, doi: 10.1109/ICRA57147.2024.10610935.
“Version of Record: https://www.sciencedirect.com/science/article/pii/S0168169920311479,” pp. 1–35, 2020.
J. D. Setiawan, Y. F. Dwiyanto, and M. Munadi, “Pengembangan User Interface Aplikasi Simulasi Robot Arm Manipulator Berbasis Augmented Reality,” Rotasi, vol. 26, no. 1, pp. 44–51, 2024, doi: 10.14710/rotasi.26.1.44-51.
F. Zanatta, A. Giardini, A. Pierobon, M. D’Addario, and P. Steca, “A systematic review on the usability of robotic and virtual reality devices in neuromotor rehabilitation: patients’ and healthcare professionals’ perspective,” BMC Health Serv. Res., vol. 22, no. 1, pp. 1–16, 2022, doi: 10.1186/s12913-022-07821-w.
Z. Chen, Y. J. Yoon, R. Bautista-Montesano, Z. Zhao, A. Mandlekar, and J. Liu, “TeleopLab: Accessible and Intuitive Teleoperation of a Robotic Manipulator for Remote Labs,” 2025, [Online]. Available: http://arxiv.org/abs/2509.05547
X. Wang, S. Guo, Z. Xu, Z. Zhang, Z. Sun, and Y. Xu, “A robotic teleoperation system enhanced by augmented reality for natural human robot interaction,” Cyborg Bionic Syst., vol. 5, pp. 1–12, 2024, doi: 10.34133/cbsystems.0098.
Ridwan, Y. Erdani, Sarosa Castrena Abadi, M. D. Anugrah, Abdur Rohman Harits Martawireja, and Rizqi Aji Pratama, “Developing Sorting Algorithm for SmartEdu Conveyor using Computer Vision Technology,” Inform. J. Ilmu Komput., vol. 21, no. 3, pp. 207–213, 2025, doi: 10.52958/iftk.v21i3.12434.
N. Terras et al., “Integration of Deep Learning Vision Systems in Collaborative Robotics for Real-Time Applications,” Appl. Sci., vol. 15, no. 3, 2025, doi: 10.3390/app15031336.
S. P. Arunachalam, I. Guzey, S. Chintala, and L. Pinto, “Holo-Dex: Teaching Dexterity with Immersive Mixed Reality,” Proc. - IEEE Int. Conf. Robot. Autom., vol. 2023-May, pp. 5962–5969, 2023, doi: 10.1109/ICRA48891.2023.10160547.
S. Andy, I. S. Surya, and S. Fidelis, “Pengenalan Teknologi Virtual Reality (Vr) Pada Pembelajaran Simulasi Pembuatan Komputer Di Jurusan Teknik Informasi Dan Jaringan (Tkj),” J. Ilm. Tek., vol. 2, no. 3, pp. 33–42, 2023.
A. C. Bavelos, E. Anastasiou, N. Dimitropoulos, G. Michalos, and S. Makris, “Virtual reality-based dynamic scene recreation and robot teleoperation for hazardous environments,” Comput. Civ. Infrastruct. Eng., vol. 40, no. 3, pp. 392–408, 2025, doi: 10.1111/mice.13337.
Bila bermanfaat silahkan share artikel ini
Berikan Komentar Anda terhadap artikel Pengembangan Aplikasi berbasis Virtual Reality untuk Sistem Teaching Robot pada SmartEdu Station
ARTICLE HISTORY
How to Cite
Issue
Section
Copyright (c) 2026 Yuliadi Erdani, Sarosa Castrena Abadi, Ihsan Kamaludin, Abdur Rohman Harits Martawireja, Adhitya Sumardi Sunarya, Nuryanti Nuryanti
This work is licensed under a Creative Commons Attribution 4.0 International License.
Authors who publish with this journal agree to the following terms:
- Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under Creative Commons Attribution 4.0 International License that allows others to share the work with an acknowledgment of the work's authorship and initial publication in this journal.
- Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgment of its initial publication in this journal.
- Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work (Refer to The Effect of Open Access).
