Predicting and Explaining Middle-School Dropout Risk on Imbalanced Data

¹ Modeling and Simulation of Intelligent Industrial Systems Laboratory (M2S2I), ENSET Mohammedia, University Hassan II of Casablanca, Casablanca 20000, Morocco
² Regional Center for Education and Training Professions, Rabat 11000, Morocco

^* Corresponding author: mohamed.eljihaoui-etu@etu.univh2c.ma

Abstract

Early identification of students at risk of dropping out is vital for providing timely support and efficiently allocating educational resources. Using a large, real-world middle-school cohort (N = 810,853; prevalence 4.38%), we develop an explainable TabNet-based model for tabular data. We train with class-weighted loss and early stop on validation PR-AUC to prioritize minority detection, we calibrate probabilities via Platt scaling, and fix a single operating threshold by maximizing Youden’s J. The model achieves strong discrimination (ROC-AUC ≈ 0.90; PR-AUC ≈ 0.47 vs. 0.043 baseline) and a recall-centric operating point on test (TPR = 0.793, TNR = 0.833), with balanced metrics confirming robustness (G-Mean ≈ 0.813; MCC ≈ 0.324). Calibration markedly improves probability quality (Brier score 0.1234→0.0317), to better reflect the true likelihood of outcomes. The use of the mask-based TabNet feature provides transparent reasons—where the most recent cumulative grade point average, academic delay, and socioeconomic vulnerability/poverty dominate, supporting targeted and interpretable intervention. The study also reveals that some students are flagged as dropouts despite continuing, necessitating real follow-up costs.