Evaluation of the Effectiveness of the Silvercoms Metaverse Based Immersive Learning Model for Satellite Communication System Education

Abstract

Satellite communication systems education in Indonesian universities faces limitations such as expensive measuring instruments, limited access to ground stations, and a lack of virtual simulations, thus limiting students' opportunities to gain practical learning experiences in the Industry 4.0 era. This study evaluates the effectiveness of Silvercoms (Satellite Immersive Learning and Communication Model), a metaverse-based immersive learning model developed through Design Science Research Methodology, in improving learning outcomes and user experience for Telecommunication Engineering students. A quasi-experimental design with a pre-test/post-test control group was implemented at three Telkom University campuses (Bandung and Purwokerto), involving a total of 170 students divided into a control group (conventional PowerPoint-based learning) and an experimental group (Virtual Reality MetaQuest 2) using the Nusa Satelit prototype. Learning outcomes were analysed using Analysis of Covariance (ANCOVA) with pre-test scores as covariates, while user experience was evaluated using the System Usability Scale (SUS), Simulator Sickness Questionnaire (SSQ), and Learning Experience Questionnaire (LEQ). ANCOVA results confirmed a significant and positive effect of the treatment on post-test scores across all three locations (Bandung: F(1,137)=27.47, p<.001, R²=.834; Purwokerto: F(1,27)=154.29, p<.001, partial η²=.851). The prototype obtained an average SUS score of 82.8 (range 75.8–87.5), which falls into the acceptable to excellent usability category, and a low simulator sickness index (SSQ total 3.20–5.19), with disorientation as the most dominant symptom although still considered mild. All five dimensions of the LEQ were rated positive (M>3.9 on a scale of 1–5) across both campuses. These findings demonstrate that the Silvercoms model is an effective, easy-to-use, and physiologically tolerable alternative to conventional learning methods for satellite communication systems education, providing a validated framework that other universities can adapt for immersive technology-based STEM learning.