Sistem Gaze Tracking Berbasis YOLOv8 dan Random Forest Melalui Ekstraksi Fitur Geometris Landmark Mata
DOI:
https://doi.org/10.35746/jtim.v8i4.1075Keywords:
gaze tracking, YOLOv8, random forest, eye landmarks, geometric featuresAbstract
Eye gaze tracking serves as a pivotal instrument in realizing adaptive Human-Centric AI interactions within the Industry 5.0 era. However, current appearance-based gaze estimation methods primarily rely on large-scale end-to-end deep learning regression architectures characterized by high network complexity and computational overhead. This research proposes a hybrid framework integrating the YOLOv8-Pose computer vision model with the Random Forest Classifier machine learning algorithm for the spatial classification of gaze directions. Raw image pixel matrices are efficiently reduced by localizing 55 ocular keypoints, which are subsequently extracted into 113 tabular geometric feature attributes, encompassing Eye Aspect Ratio (EAR) parameters and the relative spatial shifts of the iris. The ensemble model was trained utilizing a synthetic dataset generated via the UnityEyes simulator. Experimental results demonstrate that the proposed hybrid system achieved a global accuracy of 82.75%. The highest feature space discrimination capabilities were recorded in the TopRight (F1-score 0.91) and MiddleRight (F1-score 0.85) spatial classes. This structured feature engineering approach is empirically proven to effectively mitigate anisotropic classification errors without necessitating high-end computational resources. For further development, future research is directed towards exploring aggressive hyperparameter tuning, meta-heuristic feature selection using Particle Swarm Optimization (PSO), and evaluating the model's robustness limit using real-world datasets in unconstrained open domains.
Downloads
References
M. V. Raja, H. Thaker, S. R. Katragadda, and S. Kadam, “A review of human-centric ai in industry 5.0: Integrating data science with mechanical automation,” Journal of Economics, Finance and Accounting Studies, vol. 7, no. 1, pp. 42–58, 2025. https://doi.org/10.32996/jefas.2025.7.4.4.
S. Brdnik, T. Heriˇcko, and B. ˇSumak, “Intelligent user interfaces and their evaluation: A systematic mapping studytrim,” Sensors, vol. 22, no. 15, p. 5830, 2022. https://doi.org/10.3390/s22155830.
N. Ibrahimoglu, F. Yıldız, and M. Kahraman, “Through the eyes: A survey on gaze-based biometric authentication systems,” AIPA’s International Journal on Artificial Intelligence: Bridging Technology, Society and Policy, vol. 1, no. 2, 2025. https://doi.org/10.5281/zenodo.17191813.
S. Hussain, K. Saeed, A. Baimagambetov, S. Rab, and M. Saad, “Advancements in gesture recognition techniques and machine learning for enhanced human-robot interaction: A comprehensive review,” tech. rep., University of Brighton, Brighton, U.K., 2024.
L. Huang, S. Li, Y. Man, X. Wang, X. Tang, and R. Ji, “Fatigue driving detection via multi-head transformer with adaptive weighted loss,” ICCK Transactions on Intelligent Systematics, vol. 3, no. 1, 2026. https://doi.org/10.62762/TIS.2025.633754.
K. Shen, Y. Li, Z. Guo, J. Gao, and Y. Wu, “Model-based 3d gaze estimation using a tof camera,” Sensors, vol. 24, no. 4, p. 1070, 2024. https://doi.org/10.3390/s24041070.
A. Bhatt, K. Watanabe, A. Dengel, and S. Ishimaru, “Appearance-based gaze estimation with deep neural networks: From data collection to evaluation,” International Journal of Activity and Behavior Computing, 2024. https://doi.org/10.60401/ijabc.9.
Y. Lei, S. He, M. Khamis, and J. Ye, “An end-to-end review of gaze estimation and its interactive applications on handheld mobile devices,” ACM Computing Surveys, vol. 56, no. 2, p. 34, 2023. https://doi.org/10.1145/3606947.
N. Gunawardena, MobileEYE: Deep Learning Based Mobile Device Eye Tracking Solution for Dynamic Visuals. PhD thesis, Western Sydney University, Sydney, Australia, 2025.
N. Gunawardena, J. A. Ginige, and B. Javadi, “Eye-tracking technologies in mobile devices using edge computing: A systematic review,” ACM Computing Surveys, vol. 55, no. 8, p. 158, 2022. https://doi.org/10.1145/3546938.
N. Elmobark, “Evaluating the trade-offs between machine learning and deep learning: A multi-dimensional analysis,” Journal of Computer, Software, and Program, vol. 2, no. 1, pp. 10–18, 2025. https://doi.org/10.69739/jcsp.v2i1.254.
Z. Li, Z. Liu, S. Lee, A. Fadaeinejad, and Y. Yu, “Real-time appearance based gaze estimation for open domains,” arXiv preprint arXiv:2603.26945, 2026. https://arxiv.org/html/2603.26945v1.
J. M. Park, D. J. Hwang, Y. C. Hwang, J. M. Lee, H. Y. Shin, K. D. Jung, and C. Y. Go, “The impact of face angle and lighting changes on eye state recognition accuracy: A comparative evaluation of cnn, mediapipe, and dlib performance,” International Journal of Advanced Smart Convergence, vol. 13, no. 4, pp. 210–221, 2024. https://doi.org/10.7236/IJASC.2024.13.4.210.
Q. Wu, X. Wang, L. Zhang, and F. R. Yu, “A real-time multi-task learning system for joint detection of face, facial landmark and head pose,” arXiv preprint arXiv:2309.11773, Sep. 2023. https://arxiv.org/abs/2309.11773.
Y. Wu, Z. Chen, H. Zhang, Y. Yang, and W. Yi, “Enhanced pose estimation for badminton players via improved yolov8-pose with efficient local attention,” Sensors, vol. 25, no. 14, p. 4446, 2025. https://doi.org/10.3390/s25144446.
H. U. Ukwu and K. Yurtkan, “4d facial expression recognition using geometric landmark-based axes-angle feature extraction,” Intelligent Automation & Soft Computing, vol. 33, no. 1, pp. 1–20, 2022. https://doi.org/10.32604/iasc.2022.025695.
T. Rahnuma, S. N. Jothiraj, V. Kuvar, M. Faber, R. T. Knight, and J. W. Y. Kam, “Gaze-based detection of thoughts across naturalistic tasks using a pso-optimized random forest algorithm,” Bioengineering, vol. 11, no. 8, p. 760, 2024. https://doi.org/10.3390/bioengineering11080760.
C. Macx˜as, J. R. Campos, N. Louren¸co, and P. Machado, “Visualisation of random forest classification,” Information Visualization, vol. 23, no. 4, pp. 312–327, 2024. https://doi.org/10.1177/14738716241260745.
M. Zhao and N. Ye, “High-dimensional ensemble learning classification: An ensemble learning classification algorithm based on high-dimensional feature space reconstruction,” Applied Sciences, vol. 14, no. 5, p. 1956, 2024. https://doi.org/10.3390/app14051956.
B. Ahmed, S. R. Naqvi, T. Akram, L. Peng, and F. Almarshad, “A hybrid deep learning-vit model and a meta-heuristic feature selection algorithm for efficient remote sensing image classification,” International Journal of Computational Intelligence Systems, vol. 18, p. 122, 2025. https://doi.org/10.1007/s44196-025-00838-z.
H. Fahmy, “Eye gaze detection dataset,” 2023. https://www.kaggle.com/datasets/hazemfahmy/eye-gaze-detection.
Y. Kim, “Assessing the impact of data impurity measures on decision tree performance,” Journal of Animal Reproduction and Biotechnology, vol. 39, 2024.
Downloads
Published
Issue
Section
License
Copyright (c) 2026 Dadya Vio Hendraksa, Denny Budiansyach, Aditya Dwi Putro Wicaksono

This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.









