Human-in-the-Loop Data Science: Enhancing Model Performance Through Interactive Learning Mechanisms

., Isnawijayani and Noche, Elmar B. and Sood, Yamini and Kumar, Dinesh (2026) Human-in-the-Loop Data Science: Enhancing Model Performance Through Interactive Learning Mechanisms. Journal of Data Science, 2026 (11). pp. 183-199. ISSN 2805-5160

	Text jods2026_11.pdf - Published Version Available under License Creative Commons Attribution. Download (239kB)
	Text 929 - Published Version Available under License Creative Commons Attribution. Download (48kB)

Abstract

Purely automated machine learning systems often struggle to incorporate domain knowledge and contextual reasoning, resulting in reduced performance when handling ambiguous, noisy, or complex real-world data. Although existing approaches such as active learning and semi-supervised learning partially address these limitations, they typically treat human input as an auxiliary component rather than an integral part of the learning process. This creates a critical research gap in developing frameworks that systematically and iteratively integrate human expertise into model training. To address this issue, this study proposes a human-in-the-loop (HITL) data science framework that embeds structured human feedback into the machine learning lifecycle, enabling continuous refinement of model predictions through interactive learning mechanisms. The proposed framework is evaluated using real-world datasets requiring expert judgment, with experiments designed to compare fully automated models, limited human interaction, and continuous HITL integration. The results demonstrate that the proposed approach achieves superior performance, including improved predictive accuracy, faster convergence, and significant reduction in labeling errors. Notably, the HITL framework shows consistent robustness under noisy and ambiguous data conditions, outperforming baseline models while maintaining stable learning behavior. This research aims to enhance the reliability, interpretability, and adaptability of machine learning systems by leveraging collaborative intelligence between humans and machines. The findings highlight that structured human feedback can serve as an effective learning signal, enabling more accurate and trustworthy data-driven models.

Item Type:	Article
Uncontrolled Keywords:	Human-In-The-Loop, Interactive Learning, Collaborative Intelligence, Data Science Workflows, Model Refinement
Subjects:	Q Science > QA Mathematics Q Science > QA Mathematics > QA75 Electronic computers. Computer science Q Science > QA Mathematics > QA76 Computer software
Depositing User:	Unnamed user with email masilah.mansor@newinti.edu.my
Date Deposited:	11 Sep 2026 02:21
Last Modified:	11 Sep 2026 02:21
URI:	http://eprints.intimal.edu.my/id/eprint/2366

Actions (login required)

View Item