Journal Details

Archive

2026

2025

2024

2023

2022

2021

2020

2019

2018

2017

Instrument Validation for Measuring ChatGPT Usage, Problem-Solving, and Ethical Awareness Among TVET Students
Open AccessJournal Type: Research ArticleSubject: EducationSubject Field: Vocational Education and Training ResearchVolume:181, Issue: 1, September, 2025Publish Date: 19 October 2025

Download: 59

Views: 32

Pages: 76-88

Abstract

The use of ChatGPT and other generative AI tools in education has increased the need to assess how these tools affect students academic performance, particularly in areas such as problem-solving and ethical awareness. However, there is a lack of a comprehensive instrument to assess these areas among Malaysian Technical and Vocational Education and Training (TVET) students. This study addresses the gap by developing and validating a questionnaire to evaluate the responsible use of ChatGPT among TVET students. The questionnaire was constructed in three phases: (i) questionnaire development, (ii) content validation by four experts using Aikens V (threshold ≥ 0.83) and (iii) pilot testing with 43 purposively sampled TVET students to assess internal consistency. Expert evaluations of item relevance, clarity, and simplicity (RCS) led to minor items refinement. The pilot results showed high reliability (Cronbachs α > 0.80) across all sections. Due to the limited sample size (n = 43), exploratory or confirmatory factor analysis was not conducted. Instead, item-level performance was evaluated using descriptive statistics, corrected item–total correlations, and Cronbachs alpha, which provided sufficient evidence for validation. The validated instrument serves as a foundation that offers a reliable tool for full-scale studies and lays a strong foundation for future research on AI-assisted problem-solving and ethical awareness in Malaysian TVET programs.

Copyright ©2026 IJRP Inc. All Rights Reserved.

TermsPrivacyCookies