Educational research has a critical issue to consider: can yesterday’s methods still yield trustworthy evidence in a world flooded with complex, real-time data or is it time to embrace new ways of knowing that reflect the scale, speed, and messiness of contemporary learning? Traditional approaches, which are grounded in small samples, clear models, and controlled settings, have long been valued for their rigor and clarity (
The review of the literature is organized to trace the methodological evolution in educational research, beginning with the foundational roles of statistical, qualitative, and mixed methods traditions. Then the review examines the growing integration of machine learning (ML) and natural language processing (NLP), highlighting their technical utility and epistemic significance. Finally, the review explores the broader implications of this shift, focusing on the emergence of hybrid expertise, the need for interpretability, and the ethical and political stakes of AI adoption in education.
An Epistemic Shift in Educational Research
Foundational statistical approaches such as regression and structural equation modeling have shaped educational research for decades. They anchor causal inference, ensure clarity in research design, and allow scholars to communicate evidence transparently (
More critically, these studies illustrate that ML is not limited to prediction; it can provide new entry points for interpretive work by uncovering the underlying themes in the ways people communicate and behave. In fact, NLP expands the frontier of qualitative scaling. Topic modeling, originally formalized by
Many of the most influential contributions to learning analytics and educational data mining now emerge from interdisciplinary teams where ML is integrated with robust understanding of learning theory, pedagogy, and equity. Scholars like Ryan Baker, Dragan Gašević, and Alyssa Wise exemplify this fusion: their research not only advances technical methods but also interrogates what constitutes meaningful learning and fair assessment. However, scholars with such hybrid expertise are so rare that even educational research journals struggle to find qualified reviewers who can engage with both the technical and pedagogical dimensions of submitted work. That said, the hybridity reflects a broader epistemic shift where knowledge production demands more than computational skill; it requires theoretical grounding in how people learn, teach, and interact with complex systems. As a result, methodological innovation in education is not merely a technical enhancement but a redefinition of what counts as valid insight. Supporting this shift,
Causality, Transparency, and the Urgency of Data Politics in Education
A persistent critique of ML is that it excels in prediction but falters in explanation (
A causal forest is an adaptation of the random-forest algorithm that estimates heterogeneous treatment effects for individual observations, revealing how an intervention’s impact varies across subgroups. These methods align with pressing educational priorities such as personalized learning and equity-driven interventions (
However, the stakes extend far beyond methodology. With the rise of platform-driven education, student data is increasingly commodified for commercial ends, a process
The integration of ML into educational research demands enthusiasm tempered with caution. Methodologically, ML expands the field’s capacity to analyze scale, capture heterogeneity, and produce interpretable causal estimates. Philosophically, it demands reflection on what counts as valid explanation and who holds authority over knowledge. The most promising path forward is methodological bilingualism, where researchers are trained in both conventional design logics and computational methods (
Additionally, faculty hiring and tenure processes should recognize scholarship that bridges traditions rather than siloing computational work. Journals should encourage submissions that combine interpretive theory with ML analyses and reward methodological transparency. Institutions should also practice transparency by investing in open data infrastructures and resist the outsourcing of analytic capacity to corporations. Without such integration, the field risks bifurcation. Computational researchers may drift toward technical optimization detached from pedagogy, while traditional researchers may struggle to remain relevant in a world defined by data traces. The worst outcome is that educational research cedes authority entirely to platform vendors, allowing data colonialism to shape policy. The best outcome is that scholars reclaim interpretive sovereignty by embedding computational methods in educational values, ensuring that the digital transformation strengthens rather than weakens the field’s commitments to justice and equity.
Beyond methodological reform, the integration of AI in education raises critical concerns about data privacy, algorithmic bias, and the responsible governance of student information. Current international frameworks such as UNESCO’s (2021) Recommendation on the Ethics of Artificial Intelligence and the Organization for Economic Co-operation and Development’s (OECD) AI Principles stress transparency, human oversight, and fairness as non-negotiable standards. Educational researchers should therefore align analytic pipelines with these ethical benchmarks, ensuring informed consent, auditability of models, and safeguards against demographic bias in training data. While the present commentary advocates methodological reform in education, it should be noted that it offers a conceptual synthesis of theoretical and methodological perspectives rather than presenting new empirical evidence. This limitation suggests future research to empirically test the propositions advanced here, for example, by comparing conventional regression, causal-ML, and interpretability techniques on shared educational datasets. Such validation would clarify not only performance differences but also practical implications for policy and pedagogy.
Educational research stands at the cusp of a methodological revolution. Traditional quantitative, qualitative, and mixed methods remain indispensable, but they are increasingly insufficient on their own. ML and causal inference provide tools that can address complexity, scale, and heterogeneity in ways that extend, and not replace, established traditions. Interpretability and fairness must remain non-negotiable, and critical attention to the political economy of educational data is essential. The way forward requires deliberate synthesis, cultivating bilingual scholars who can move fluently between regression tables and neural networks, between ethnographic coding and topic modeling, between explanation and prediction. Only then can educational research remain both scientifically rigorous and socially just in a data rich century. The cost of inaction is irrelevance: if educational research clings to archaic methods, it risks being bypassed by corporate analytics and policy regimes that redefine knowledge without educators at the table.