Artificial Intelligence in Intelligent Tutoring Systems Toward Sustainable Education - A Systematic Review
Artificial Intelligence in Intelligent Tutoring Systems Toward Sustainable Education - A Systematic Review
*Correspondence:
[email protected] Abstract
1
National Central University, Sustainable education is a crucial aspect of creating a sustainable future, yet it
Taoyüan, Taiwan faces several key challenges, including inadequate infrastructure, limited resources,
2
National Chengchi University, and a lack of awareness and engagement. Artificial intelligence (AI) has the potential
Taipei, Taiwan
to address these challenges and enhance sustainable education by improving access
to quality education, creating personalized learning experiences, and supporting
data-driven decision-making. One outcome of using AI and Information Technology
(IT) systems in sustainable education is the ability to provide students with personal‑
ized learning experiences that cater to their unique learning styles and preferences.
Additionally, AI systems can provide teachers with data-driven insights into student
performance, emotions, and engagement levels, enabling them to tailor their teaching
methods and approaches or provide assistance or intervention accordingly. However,
the use of AI and IT systems in sustainable education also presents challenges, includ‑
ing issues related to privacy and data security, as well as potential biases in algorithms
and machine learning models. Moreover, the deployment of these systems requires
significant investments in technology and infrastructure, which can be a challenge
for educators. In this review paper, we will provide different perspectives from educa‑
tors and information technology solution architects to connect education and AI tech‑
nology. The discussion areas include sustainable education concepts and challenges,
technology coverage and outcomes, as well as future research directions. By address‑
ing these challenges and pursuing further research, we can unlock the full potential
of these technologies and support a more equitable and sustainable education system.
Keywords: Artificial intelligence, Sustainable education, Education sustainability,
Intelligent tutoring system, Massive open online course
Introduction
The term "sustainable" is intended to describe something that can be maintained or
continued over the long term without significant negative environmental, social, or
economic impacts. It implies a concept that meets the needs of the present without
compromising future generations. To elaborate on the concept of sustainability in
education, Sterling and Orr (2001) proposed that sustainable education aims to fos-
ter a learning culture that values diversity, creativity, and participation and empowers
© The Author(s) 2023. Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits
use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original
author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third
party material in this article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line to the mate‑
rial. If material is not included in the article’s Creative Commons licence and your intended use is not permitted by statutory regulation or
exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://
creativecommons.org/licenses/by/4.0/.
Lin et al. Smart Learning Environments (2023) 10:41 Page 2 of 22
Along with the versatile AI machine learning solutions in the recent decade, many
ITSs are empowered by AI solutions. For example, the natural language process (NLP)
(Liddy, 2001) can be used as a chatbot to interact with students to provide feedback
and necessary learning interventions (Lin & Mubarok, 2021). The other example is
that of leveraging the powerful data mining capability of machine learning to perform
learning analytics activities or performance prediction (Choi & McClenen, 2020;
Ouyang et al., 2023). Other areas include leveraging image recognition to identify
students’ facial expressions, gestures, or emotions to inform teachers’ future actions
(Leony et al., 2013; Singh et al., 2022).
AI systems can play a significant role in sustainable education. AI-powered algo-
rithms can be used to analyze student data and create personalized learning experi-
ences for each student. This can help students learn more effectively and efficiently
while reducing the amount of time and resources required for traditional teaching
methods. There are several AI systems that can be used in sustainable education. One
example is personalized learning systems that use AI-powered algorithms to analyze
student data and create personalized learning experiences for each student. Another
example is chatbots powered by AI that can answer inquiries from students and offer
them individualized learning experiences. The other typical example is AI-enabled
technology can also be used for performance prediction and real-time monitor stu-
dents’ performance so that necessary intervention can be provided to the instructors.
From educators’ perspectives, an ITS can act as a potential tool to enhance their
teaching and learning practices rather than as a threat or a replacement. ITSs can
offer several benefits for educators, such as providing individualized and differenti-
ated instruction for diverse learners, which is one of the key concepts for shifting
from teacher-centered to student-centered processes (Ogunkunle & Qu, 2020; Silva
et al., 2022). ITSs can also offload teachers’ workload on routine tasks, such as grad-
ing feedback and remediation, so that teachers can focus more on teaching itself (Ata-
pattu & Falkner, 2016; Tobarra et al., 2021). Ultimately, teachers will promote lifelong
learning and professional development not only to students but also themselves.
There will be some gaps when bringing educators with IT solutions, especially when
educators are asked to implement an intelligent tutoring system with modern arti-
ficial intelligence features enabled. Some examples of the gaps include lacking the
understanding of how IT technology works, the difficulties of integrating ITS into
educational curricula, building effective assessments for ITSs, and funding concerns.
Even if the ITS is properly built, training instructors to use the system effectively
might be another challenge. Thus, we are trying to address the gaps and challenges in
this review paper and provide guidance for educators and IT solutions architects by
reviewing different approaches to tutoring systems implementation.
In this review paper, we will bridge the perspectives of educators and information
technology specialists on sustainable education. Furthermore, we extended the origi-
nal definition of ITS to be AI and machine learning embedded. Below is the research
agenda and questions we will address.
Lin et al. Smart Learning Environments (2023) 10:41 Page 4 of 22
• Background
• Define the title and focused key areas of the surveyed papers.
• Define the source of selecting papers.
• Define the keywords, screening criteria, and year range of the surveyed papers.
• Review, study, categorize and determine the relevance.
• Define the target audience of this surveyed paper.
• What are the key factors to consider when building AI/IT systems to support sus-
tainable education?
• What are the typical AI/IT solutions used to support sustainable education?
• What and how are pedagogical methods integrated into AI/IT solutions?
• How are learning statistics data accumulated and analyzed?
• What are the outcomes and challenges of AI/IT embedded as the ITS in sustainable
education?
Thus, based on the research agenda, the following 4 research questions will be
addressed and answered.
In the remaining sections of this paper, we will illustrate the overall methodology
of how we developed this review study. In section "Methodology", we will perform
a literature review and share some typical cases and scenarios about how AI supports
Lin et al. Smart Learning Environments (2023) 10:41 Page 5 of 22
sustainable education. In section "Results and discussion", we will detail the breakdown
of the information gathered from the reviewed papers, discuss the findings and answer
the research questions. In the last section, we will conclude the overall study and discuss
future trends.
Literature review
The trend of changing teaching scenarios from traditional classroom style to remote,
virtual, and blended is inevitable. There are lots of research focus on how to leverage
TEL to make overall learning more efficient and engaged. Xie et al. (2019) reviewed the
trend and how and what kind of technologies are applied into the learning environment.
There are also review focus on specific subjects like flipping mathematics (Yang et al.,
2019) and chemistry (Wu et al., 2021) by leveraging TEL which shows the benefits when
embedding technologies into the learning.
With more instructional courses being moved online and becoming remotely acces-
sible, the data generated from the system also become more complicated to manage. Big
data mining along with AI has become mainstream when examining information tech-
nology in educational systems. Yousuf and Wahid (2021) elaborated different kinds of
areas and applications in which AI can support as well as provide good insights for the
following research.
There are different perspectives when looking at how AI can support ITSs toward sus-
tainable education. It is reasonable to review different implementations with a stand-
ardized framework that can help researchers gain a decent understanding and support
sustainable education implementation. To help researchers, Gillani et al. (2023) precisely
defined different dimensions of reviewing mechanisms, which were also adopted in this
study.
There are two main categories of AI integration with tutoring systems. The first is to
not interfere with the tutoring system and to extract log data for further analysis. This
kind of approach typically leverages much data mining and clustering to derive learning
behaviors (Corrigan et al., 2015b; Ouyang et al., 2023; Weng et al., 2020). When catego-
rizing learning behaviors, unsupervised learning methodology and clustering algorithms
are usually used since there is no ground truth data to train the model. The other major
approach is for performance prediction (Afzaal et al., 2021; Choi & McClenen, 2020;
Serrano-Laguna et al., 2018) and involves extracting features and machine learning algo-
rithms through supervised learning.
The other category of integrating AI with tutoring systems is more difficult to imple-
ment. Typically, in this kind of implementation, personalization can be better consid-
ered in terms of learning process (Singh et al., 2022; Tobarra et al., 2021) or intervention
(Weng et al., 2020). For this kind of integration, the system architecture needs to be con-
sidered along with the inflexibility since the AI algorithm is tightly integrated within the
system; it is also a kind of adaptive learning (Paramythis & Loidl-Reisinger, 2003) (Par-
amythis & Loidl-Reisinger, 2003) implementation. AI-embedded ITSs may have better
adaptation capability to respond to students’ real-time learning status and have a better
chance to intervene with students to provide early necessary assistance.
Many studies have focused on engagement and dropout prevention. Leony et al.
(2013) leverage students’ facial expressions captured by cameras and leverages machine
Lin et al. Smart Learning Environments (2023) 10:41 Page 6 of 22
image recognition algorithms to detect students’ emotions. Pereira et al. (2019) lever-
age historic system log data and train a machine learning program to detect if the stu-
dent will drop out of an online course, which also provides teacher assistance in terms of
engagement.
The major contribution of exploiting AI in education probably has not yet been fully
discovered. Although Explainable AI (XAI) is becoming popular in the computer sci-
ence world, it is still being introduced in the education area. Afzaal et al. (2021) used a
counterfactual method to explain how an AI algorithm gave instructors predictions to
provide students with necessary assistance. In the other research of Pereira et al. (2021),
a more recently developed XAI algorithm called SHAP was used to explain the predic-
tion result.
Methodology
This review paper conceptualization process is based on the book “Qualitative Research
from Start to Finish” by Yin (2015) with the analytical methodology mentioned in (Chatti
et al., 2012). The overall paper review methodology and content framework follows the
PRISMA (Page et al., 2021) methodology.
Conceptualization
Based on the analytical model proposed by Chatti et al. (2012), we can put our main
topic in the center and consider four different dimensions around the topic, as shown in
Fig. 1. We started from the “Why” and focused on the research objectives coming from
the research agenda and research questions. We also conducted a brainstorming session
with a few researchers to define “Who” are the key stakeholders and what they will be
interested to know and what we can contribute from this review paper.
This review paper focuses on educators in the SDG sector and educational technology
R&D to provide a systematic review of how AI systems support sustainable education. It
may contribute to the understanding and alignment between educators and IT technol-
ogy in building suitable solutions as well as future potential enhancement toward sus-
tainable education. We discuss the “What” and the “How” in the following section.
Type of data (what) Type of data A1 Refers to any kind of data such as academic data, performance
data, interaction data, etc. that are collected by tutoring to sup‑
port feedback practices in education
Methods (how) Machine learning B1 Refers to the machine learning methods such as neural
network to learn from data and perform tasks within tutoring
systems
Data mining B2 Refers to the data mining methods such as clustering, clas‑
sification, decision tree, regression, etc. that are used to analyze
data within tutoring systems
Gaming B3 Refers to the leveraging gaming methods within tutoring
systems
Others B4 Refers to the other methods such home grown systems
Objectives (why) Monitoring C1 Refers to tracking students’ learning performance
Prediction C2 Refers to predicting students’ learning behavior and perfor‑
mance
Assessment C3 Refers to providing an evidence-based assessment
Adaptation C4 Refers to providing an adaptive and flexible learning scenario
Personalization C5 Refers to providing individualized training scenarios
Recommendation C6 Refers to providing recommendation of what to do next
Others C7 Refers to any other goal that can help to support learners
Target Learners and Elementary D1 Refers to the elementary school students as the learners
stakeholders (who) High school D2 Refers to the high school students as the learners
University D3 Refers to the university students as the learners
Others D4 Refers to not specifically mentioned who is the learners
have shifted to a different angle, especially after information technology was integrated
into the implementation of the whole sustainable education system. Sustainability con-
cepts have gradually emerged as part of education curricula, and the challenges with
AI and information technology have become more obvious. There might still be resist-
ance (Smaniotto et al., 2023; Wade, 2012), mindset (Tsegay et al., 2022), and awareness
(Khahro & Javed, 2022; Shah et al., 2022; Smaniotto et al., 2023) issues, but eventually,
these issues will be improved by deploying sustainability culture through information
technology in schools. As we stated earlier in this review paper, the challenges may come
from IT perspectives as well as the education system. Below are the key challenges sum-
mary from the surveyed paper we selected:
• [C1] More challenges taking care of more students during virtual or blended learning
environment (Tsegay et al., 2022; Wade, 2012), it may be because students are from
remote especially like under COVID situation, and the instructors are forced to use
tutoring systems to deliver courses on line.
• [C2] Unequal global access, lack of devices for connectivity or bandwidth (Simuț
et al., 2021; Wade, 2012). The network connectivity becomes a bottleneck when stu-
dents need to join the training from remote, and it becomes another challenge to
ensure the quality of connectivity and healthy bandwidth.
• [C3] Teachers’ ICT (Information and Communication Technology, which means the
integration of telecommunications and computers, as well as necessary enterprise
software, middleware, storage and audiovisual, that enable users to access, store,
transmit, understand and manipulate information.) teaching skill, use and accept-
ance of new technologies (Saudelli & Niemczyk, 2022; Simuț et al., 2021; Tsegay
et al., 2022). There will be more training needed to enhance the teachers’ internet
tools usage skill set to ensure teachers accept the new technologies.
• [C4] Lack of physical and emotional interaction (Simuț et al., 2021). Due to the vir-
tual training environment, the teachers will worry about the lack of students’ interac-
tion.
• [C5] Limited students collaborative learning (Acevedo-Duque et al., 2023). The stu-
dents’ collaboration will be limited by the systems since the students cannot see each
other with virtual and remote training environment.
• [C6] Engagement and dropout concern in virtual learning environments (Khahro &
Javed, 2022; Simuț et al., 2021). It’s another challenge that students will dropout due
to losing attention without teachers’ intervention.
• [C7] Privacy and security concern (Tewari, 2020). This is another challenging area
when students need to provide personal identify through internet as well as facial
biological features.
• [C8] Fairness and bias correction (Tewari, 2020). When leveraging AI systems, the
system will be very challenging to provide fair interactions without the bias.
• [C9] Interpretability and transparency (Smaniotto et al., 2023; Tewari, 2020). Provid-
ing comprehensive explanation from the AI system to the teachers is another major
challenge, the educators will always need a good explanation to trust the AI system
when providing any prediction and intervention.
Lin et al. Smart Learning Environments (2023) 10:41 Page 11 of 22
Based on the challenges listed above, there must be some recommendations and guid-
ance that can be given to educators and IT solution architects when implementing sus-
tainable education solutions. Below are key recommendations summarized from the
surveyed papers.
These challenges require collaborative and collective action from all stakehold-
ers involved in education and IT solution architects, such as policymakers, educa-
tors, researchers, parents, and students. We need to work together to find innovative
and inclusive solutions that can ensure sustainable education for all in the twenty-first
century.
RQ2: how are AI and IT incorporated as the ITS to support sustainable education?
There are different purposes and objectives when considering ITSs in sustainable educa-
tion implementation. However, one of the major consideration points is the need to be
more student centric. Below in Table 4, we list the major objectives from the 29 selected
surveyed papers.
There is much research focusing on students’ performance prediction based on the
systems’ logs generated during the interaction between the students and the systems.
The typical approach involves using machine learning algorithms with a feature extrac-
tion process to predict students’ performance (Guerrero-Higueras et al., 2018; Yang
et al., 2021a, b). The next major objectives are to identify learners’ learning behaviors
(Lee et al., 2021; Weng et al., 2020), which will most likely be input into the machine
Lin et al. Smart Learning Environments (2023) 10:41 Page 12 of 22
about bias, fairness and equality due to overfitting issues, which means that researchers
may need more and better training data.
On the other hand, when performing learning behavior analysis (Pereira et al., 2021;
Weng et al., 2020), most of the technology used turns to unsupervised learning, which
also makes sense since there are no ground truth data for model training and the
overall concept is for clustering or categorization without any reference. In addition
to the objectives and embedded technology, we also need to examine the scenario
used by the educator to answer RQ 2 in a more complete way. In Table 6, we list the
typical pedagogical scenarios in the 29 surveyed papers.
Lin et al. Smart Learning Environments (2023) 10:41 Page 14 of 22
Table 7 Outcome observed from intelligent tutoring systems with AI and IT support
Category Description Count
The key scenario involves instructors predicting learners’ performance based on the
learning behaviors captured during the learning process. Here, we combine perfor-
mance prediction and behavior analysis because normally learning behaviors are cap-
tured as one of the features for performance prediction (Ouyang et al., 2023; Weng
et al., 2020). Some of the scenarios are for instructors to adopt necessary actions for
intervention, while some of the scenarios are for learners to have personalized learn-
ing experiences (Serrano-Laguna et al., 2018; Singh et al., 2022).
RQ3: what are the outcomes of AI/IT embedded as the ITS in sustainable education?
In response to RQ 3, the outcomes of tutoring systems integrated with AI and infor-
mation technology are listed in Table 7. There are still two main approaches in which
Lin et al. Smart Learning Environments (2023) 10:41 Page 15 of 22
AI is or is not embedded into the tutoring system itself. For AI-embedded tutoring sys-
tems, most of the outcomes indicate that the performance prediction accuracy is high
(Guerrero-Higueras et al., 2018; Hasnine et al., 2018), which implies an opportunity to
aid those predicted low performers. However, most of the research does not focus on
explaining why and how machine learning algorithms perform predictions, which means
that instructors can only take necessary actions based on their experience. Of the 29 sur-
veyed papers, only 2 focus on the result and try to leverage explainable AI (Afzaal et al.,
2021; Pereira et al., 2021) on machine learning prediction. Eventually, this will be more
valuable to the whole education system since it can eliminate the concerns of educators
in terms of fairness, trustworthiness, and inclusion.
There are also some researchers who have explored different learning behaviors (Rui-
pérez-Valiente et al., 2021; Yang et al., 2021a, b) through clustering algorithms, which
can also provide instructors with information for further intervention as necessary. The
relationship between performance and learning behaviors is also one of the major areas
where researchers may invest great effort since this may help instructors to understand
and improve the overall pedagogical process. Some researchers have also shown that AI
machine learning algorithms can provide early notification to prevent student dropout
(Weng et al., 2020) and enhance engagement (Ouyang et al., 2023).
For AI-embedded tutoring systems, researchers focus on dynamic learning processes
and personalization (Tobarra et al., 2021) experience when a system is designed to pro-
vide any necessary intervention or adjust the learning path for instructors. Overall, there
are still many potential areas we should address to reflect instructors’ resource shortages
when they have no bandwidth to take care of every student during the learning process
and provide necessary intervention or assistance.
The overall outcome seems reasonable, but it needs to be more explainable for learners
and instructors to adopt AI technology. Since machine learning algorithms are normally
treated as a black box, an increasing number of studies have focused on explaining the
AI machine learning model to gain trust from users so that the true value can be demon-
strated and accepted.
RQ4: what is the future trend of AI/IT embedded ITS in sustainable education?
Before we answer RQ 4 and identify potential future research trends, we list the limita-
tions of the challenges of AI-embedded tutoring systems in Table 8. Since most of the
AI technology that is used is machine learning, the first limitation and challenge is the
amount of data. Theoretically, the more training data from more participation there is,
the better, and some research (Corrigan et al., 2015a; Guerrero-Higueras et al., 2018)
demonstrates an ambition to expand the participation scope and expectations of higher
performance through obtaining more sampling data. The following key limitations are
also related to machine learning and include feature extraction improvement (Hasnine
et al., 2018), needing longer period learning data (Guerrero-Higueras et al., 2018), or the
solution not being portable to other tutoring systems (Yang et al., 2021a, b).
Based on the limitations and challenges, many future potential research directions
were mentioned and discussed in the 29 surveyed papers. Potential future directions are
listed in Table 9. Again, the top items tend to be related to machine learning aspects,
which gives IT solution architect good opportunities with which to start. Typically,
researchers want to have a robust solution architecture that can support more pre-
cise performance prediction (Lin & Mubarok, 2021) and hope that the solution can be
more portable (Silva et al., 2022) by providing a better sample space and training dataset
(Guerrero-Higueras et al., 2018).
There is not much research from the 29 papers addressing more recent ways to train
machine learning algorithms, such as leveraging transformer to conduct learning behav-
ior clustering or leveraging reinforcement learning to predict or evaluate students’ status
by teachers’ input. While AI and machine learning are becoming increasingly advanced,
there might always be a better way to improve and make prediction and analysis more
accurate.
There are also some important potential future research directions brought up in some
research. While researchers want to focus more on engagement rate improvement (Silva
et al., 2022) or personalization (Lin & Mubarok, 2021), some researchers have started
to focus on emerging educational theories (Leony et al., 2013) and boosting students’
learning interest. Researchers are eager to prove the phenomena derived from machine
learning algorithms by linking to educational theories or seeking educational experts’
comments. Some researchers have started to combine all observations and created
theories to reflect the foundational change from an examination-focused to an interest-
focused instruction style (Chan et al., 2018) or even to build a vision of what the future
educational environment will be like.
The “explainable” requirements need to be considered and incorporated into the
machine learning algorithm during the design phase in the future. Khosravi et al. (2022)
deeply explore XAI in terms of education, which also provides good guidance for edu-
cators and IT solution architects. Similar to the 4-year project conducted by DARPA
(Gunning & Aha, 2019), the technical teams were requested to provide an explainable
model and explanation interface to support users making decisions. In addition, there
is another team addressing humans’ psychological aspects to define how an explana-
tion can be acceptable. Finally, there is also an evaluation assessment check list to verify
whether a system can truly be trusted and adopted by users.
In the XAI review paper, Arrieta et al. (2020) categorized many common machine
learning algorithms in detail and described how a model can be explained. Such
approaches can be adopted in these AI-integrated educational systems to gain more
trust from users. Eventually, designing AI and machine learning algorithms with expla-
nations for users will become culture because this might be the only way to eliminate
concerns from learners and instructors and adopt AI as a supportive tool when working
toward sustainable education.
However, bringing in more social value and human factors will be one of the key future
focuses. Along with explainable AI systems and explainable interfaces to support learn-
ers and instructors in decision-making, Human-Centered AI (HCAI) (Auernhammer,
2020) consideration is another future trend in the AI and education integration area.
Shneiderman (2020) defined a two-dimensional approach for categorizing and provid-
ing guidance on how to produce system designs that are Reliable, Safe, and Trustworthy
(RST). In the papers of (Yang et al., 2021a, b, 2023), the authors share the aspects of
how AI and HCAI can contribute in different ways to sustainable education with proper
social values.
Another potential future trend is to maximize the social value that AI systems can
bring. For example, virtualized online courses with AI support can eliminate the dis-
tance gap of some students so that their educational equality issue can be addressed. In
addition, with AI support, the system can be intelligent enough to consider the minority
group or individual by providing an adaptive or personalized learning experience. Even-
tually, the instructors can focus on pedagogical strategy and improve the overall teach-
ing efficacy, students’ learning performance with proper intervention, and sustainable
education goals.
Lin et al. Smart Learning Environments (2023) 10:41 Page 18 of 22
Conclusions
In this review paper, we leveraged a combination of learning model analytics and the
PRISMA review paper framework to discuss how AI can empower educational systems
in many aspects. Starting with RQ1, we listed the typical challenges of sustainable edu-
cation implementation and the integration of AI and information technology. Following
RQ2 to RQ4, we discussed different kinds of AI-embedded technology and how they
support sustainable education implementation. We also discussed the typical scenarios
that are involved when ITSs are deployed to give educators some reference and guidance
when thinking about integrating AI into their tutoring systems. Finally, we discussed
future research directions that may also provide IT solution architects and educators
some ideas on which to continue working.
In this study, we aimed to help our target audience understand the current state of
integrating AI technology into tutoring systems, along with the challenges that come
with it. We provided clear guidance for educators and IT solution architects on how
to implement and deploy AI-enabled systems. This guidance includes understanding
the different types of machine learning algorithms, raising awareness among educa-
tors, and the needs of navigating government policies and regulations, among other
things. Our hope is that this will bridge the gap between educators and IT solution
architects, facilitating the smooth deployment of sustainable education systems.
Many benefits have been explored through the implementation of tutoring systems
with big data analysis capabilities. AI-integrated tutoring systems may use natural
language processing and machine learning techniques to evaluate student responses
and determine individual progress by analyzing their learning behaviors. Additionally,
AI-based tutoring systems help bridge the gap between educators and students by
providing an innovative platform that makes education more accessible. This means
that students can learn at their own pace, from wherever they are, which increases
flexibility in the learning process. As a result, AI-powered tutoring systems promote
equal access to education, regardless of geographical location or financial status.
However, researchers have started to notice that along with the various benefits,
the bias generated from AI and machine learning algorithms may also create harm.
This harm may come from “allocational” or “representational” aspects (Mayfield
et al., 2019) and may eventually derail the purposes of education. As a result of these
potential harms and biases, researchers have also started looking at AI not only in an
explainable way but also from fairness and trustworthiness perspectives. This will be
one of the major future research directions, and more human-centered (or teacher-
centered) factors may need to be considered.
Finally, AI has revolutionized education by promoting sustainable education prac-
tices that are more student-centered. Compared to a traditional classroom setting,
electronic educational resources significantly share the effort of teachers when indi-
vidual students’ learning status needs to be considered. With better data analytics and
insights provided via AI, tutoring applications can also reduce resource waste and
improve sustainable education in the long run.
In conclusion, the incorporation of AI in tutoring systems has resulted in positive
outcomes in sustainable education. From personalized education, adaptive learning,
automated assessments, and flexible learning environments to eco-friendly practices,
Lin et al. Smart Learning Environments (2023) 10:41 Page 19 of 22
Abbreviations
AI Artificial Intelligence
HCAI Human-Centered AI
ICT Information and Communication Technology
IT Information Technology
ITS Intelligent Tutoring System
NLP Natural Language Processing
PRISMA Preferred Reporting Items for Systematic review and Meta-Analyses
RST Reliable, Safe and Trustworthy
SDG Sustainable Development Goal
TEL Technology-Enhanced Learning
XAI EXplainable Artificial Intelligence
Acknowledgements
Not applicable.
Author contributions
All authors planned, discussed, verified, and approved the manuscripts.
Funding
This research was funded by National Science and Technology Council Grant Nos. 111-2410-H-008-010-MY3 and
109-2511-H-008-007-MY3.
Declarations
Competing interests
The authors declare that there is not competing interests.
References
Acevedo-Duque, Á., Jiménez-Bucarey, C., Prado-Sabido, T., Fernández-Mantilla, M. M., Merino-Flores, I., Izquierdo-Marín, S.
S., & Valle-Palomino, N. (2023). Education for sustainable development: Challenges for postgraduate programmes.
International Journal of Environmental Research and Public Health, 20(3), 1759, Article 1759. https://doi.org/10.3390/
ijerph20031759
Afzaal, M., Nouri, J., Zia, A., Papapetrou, P., Fors, U., Wu, Y., Li, X., & Weegar, R. (2021). Automatic and intelligent recom‑
mendations to support students’ self-regulation. In 2021 International conference on advanced learning technologies
(ICALT), Tartu, Estonia.
Arrieta, A. B., Díaz-Rodríguez, N., Del Ser, J., Bennetot, A., Tabik, S., Barbado, A., Garcia, S., Gil-Lopez, S., Molina, D., Benjamins,
R., Chatila, R., & Herrera, F. (2020). Explainable artificial intelligence (XAI): Concepts, taxonomies, opportunities and
challenges toward responsible AI. Information Fusion, 58, 82–115. https://doi.org/10.1016/j.inffus.2019.12.012
Atapattu, T., & Falkner, K. (2016). A framework for topic generation and labeling from MOOC discussions. In Proceedings of
the third (2016) ACM conference on learning @ scale, Edinburgh, Scotland, UK.
Auernhammer, J. (2020). Human-centered AI: the role of human-centered design research in the development of AI.
https://doi.org/10.21606/drs.2020.282
Carbonell, J. R. (1970). AI in CAI: An artificial-intelligence approach to computer-assisted instruction. IEEE Transactions on
Man-Machine Systems, 11(4), 190–202. https://doi.org/10.1109/TMMS.1970.299942
Chan, T.-W., Looi, C.-K., Chen, W., Wong, L.-H., Chang, B., Liao, C. C. Y., Cheng, H., Chen, Z.-H., Liu, C.-C., Kong, S.-C., Jeong,
H., Mason, J., So, H.-J., Murthy, S., Yu, F.-Y., Wong, S. L., King, R. B., Gu, X., Wang, M., … Ogata, H. (2018). Interest-driven
creator theory: Towards a theory of learning design for Asia in the twenty-first century. Journal of Computers in
Education, 5(4), 435–461. https://doi.org/10.1007/s40692-018-0122-0
Chatti, M. A., Dyckhoff, A. L., Schroeder, U., & Thüs, H. (2012). A reference model for learning analytics. International Journal
of Technology Enhanced Learning, 4(5–6), 318–331. https://doi.org/10.1504/IJTEL.2012.051815
Lin et al. Smart Learning Environments (2023) 10:41 Page 20 of 22
Choi, Y., & McClenen, C. (2020). Development of adaptive formative assessment system using computerized adaptive
testing and dynamic Bayesian networks. Applied Sciences, 10(22), 1–17, Article 8196. https://doi.org/10.3390/app10
228196
Corrigan, O., Glynn, M., McKenna, A., Smeaton, A., & Smyth, S. (2015a). Student data: Data is knowledge: Putting the
knowledge back in the students’ hands. Paper presented at the proceedings of the 14th European conference on
e-learning, South Oxfordshire, UK.
Corrigan, O., Smeaton, A. F., Glynn, M., & Smyth, S. (2015b). Using educational analytics to improve test performance.
Design for teaching and learning in a networked world. EC-TEL 2015b. Lecture notes in computer science, Cham.
Deng, R., & Benckendorff, P. (2020). Technology-enabled learning. Handbook of e-Tourism, 1–27.
Gillani, N., Eynon, R., Chiabaut, C., & Finkel, K. (2023). Unpacking the “Black Box” of AI in education. Educational Technology
and Society, 26(1), 99–111. https://doi.org/10.30191/ETS.202301_26(1).0008
Guerrero-Higueras, Á. M., DeCastro-García, N., Conde, M. Á., & Matellán, V. (2018). Predictive models of academic success:
A case study with version control systems. In Proceedings of the sixth international conference on technological ecosys-
tems for enhancing multiculturality, Salamanca, Spain.
Gunning, D., & Aha, D. (2019). DARPA’s explainable artificial intelligence (XAI) program. AI Magazine, 40(2), 44–58. https://
doi.org/10.1609/aimag.v40i2.2850
Hasnine, M. N., Akcapinar, G., Flanagan, B., Majumdar, R., Mouri, K., & Ogata, H. (2018). Towards final scores prediction over
clickstream using machine learning methods. In ICCE 2018—26th International conference on computers in education,
workshop proceedings, Philippines.
Jiang, X., Liu, W., & Liu, J. (2019). Learning analytics in a blended computer education course. In Proceedings of the interna-
tional workshop on artificial intelligence and education, Singapore.
Khahro, S. H., & Javed, Y. (2022). Key challenges in 21st century learning: A way forward towards sustainable higher educa‑
tional institutions. Sustainability (Switzerland), 14(23), 16080, Article 16080. https://doi.org/10.3390/su142316080
Khosravi, H., Shum, S. B., Chen, G., Conati, C., Tsai, Y.-S., Kay, J., Knight, S., Martinez-Maldonado, R., Sadiq, S., & Gašević, D.
(2022). Explainable artificial intelligence in education. Computers and Education: Artificial Intelligence, 3, 100074.
https://doi.org/10.1016/j.caeai.2022.100074
Lee, C. A., Tzeng, J. W., Huang, N. F., & Su, Y. S. (2021). Prediction of student performance in massive open online courses
using deep learning system based on learning behaviors. Educational Technology and Society, 24(3), 130–146.
Leony, D., Muñoz-Merino, P. J., Pardo, A., & Kloos, C. D. (2013). Provision of awareness of learners’ emotions through visuali‑
zations in a computer interaction-based environment. Expert Systems with Applications, 40(13), 5093–5100. https://
doi.org/10.1016/j.eswa.2013.03.030
Liddy, E. D. (2001). Natural language processing.
Lin, C. J., & Mubarok, H. (2021). Learning analytics for investigating the mind map-guided AI chatbot approach in an EFL
flipped speaking classroom. Educational Technology and Society, 24(4), 16–35.
Llurba, C., Fretes, G., & Palau, R. (2022). Pilot study of real-time emotional recognition technology for secondary school
students. Interaction Design and Architecture(s), 52, 61–80. https://doi.org/10.55612/s-5002-052-004
Lu, O. H. T., Huang, A. Y. Q., & Yang, S. J. H. (2018). Benchmarking and tuning regression algorithms on predicting students’
academic performance. In 26th International conference on computers in education, Philippines.
Mayfield, E., Madaio, M., Prabhumoye, S., Gerritsen, D., McLaughlin, B., Dixon-Román, E., & Black, A. W. (2019). Equity
beyond bias in language technologies for education. In Proceedings of the fourteenth workshop on innovative use of
NLP for building educational applications, Florence, Italy.
Montpetit, C., & Sabourin, S. (2016). Assessing the impact of an “echo360-active learning platform—Enabled classroom in
a large enrolment blended learning undergraduate course in genetics. In Proceedings of the 33rd international confer-
ence of innovation, practice and research in the use of educational technologies in tertiary education.
Niyogisubizo, J., Liao, L., Nziyumva, E., Murwanashyaka, E., & Nshimyumukiza, P. C. (2022). Predicting student’s dropout in
university classes using two-layer ensemble machine learning approach: A novel stacked generalization. Computers
and Education: Artificial Intelligence, 3, 100066, Article 100066. https://doi.org/10.1016/j.caeai.2022.100066
Ogunkunle, O., & Qu, Y. (2020). A data mining based optimization of selecting learning material in an intelligent tutoring
system for advancing STEM education. In 2020 International conference on computational science and computational
intelligence (CSCI), Las Vegas, USA.
Ouyang, F., Wu, M., Zheng, L., Zhang, L., & Jiao, P. (2023). Integration of artificial intelligence performance prediction and
learning analytics to improve student learning in online engineering course. International Journal of Educational
Technology in Higher Education, 20(1), 4, Article 4. https://doi.org/10.1186/s41239-022-00372-4
Page, M. J., McKenzie, J. E., Bossuyt, P. M., Boutron, I., Hoffmann, T. C., Mulrow, C. D., Shamseer, L., Tetzlaff, J. M., Akl, E. A., &
Brennan, S. E. (2021). The PRISMA 2020 statement: An updated guideline for reporting systematic reviews. Interna-
tional Journal of Surgery, 372, n71. https://doi.org/10.1136/bmj.n71
Paramythis, A., & Loidl-Reisinger, S. (2003). Adaptive learning environments and e-learning standards. In Second European
conference on e-learning.
Pereira, F. D., Fonseca, S. C., Oliveira, E. H. T., Cristea, A. I., Bellhauser, H., Rodrigues, L., Oliveira, D. B. F., Isotani, S., & Carvalho,
L. S. G. (2021). Explaining individual and collective programming students’ behavior by interpreting a black-box
predictive model. IEEE Access, 9, 117097–117119. https://doi.org/10.1109/ACCESS.2021.3105956
Pereira, F. D., Oliveira, E., Cristea, A., Fernandes, D., Silva, L., Aguiar, G., Alamri, A., & Alshehri, M. (2019). Early dropout predic‑
tion for programming courses supported by online judges. Artificial intelligence in education. AIED 2019. Lecture
notes in computer science, Cham.
Perikos, I., Grivokostopoulou, F., & Hatzilygeroudis, I. (2017). Assistance and feedback mechanism in an intelligent tutoring
system for teaching conversion of natural language into logic. International Journal of Artificial Intelligence in Educa-
tion, 27(3), 475–514. https://doi.org/10.1007/s40593-017-0139-y
Lin et al. Smart Learning Environments (2023) 10:41 Page 21 of 22
Ruipérez-Valiente, J. A., Jaramillo-Morillo, D., Joksimović, S., Kovanović, V., Muñoz-Merino, P. J., & Gašević, D. (2021). Data-
driven detection and characterization of communities of accounts collaborating in MOOCs. Future Generation
Computer Systems, 125, 590–603. https://doi.org/10.1016/j.future.2021.07.003
Saudelli, M. G., & Niemczyk, E. K. (2022). Education for sustainable development: Insights from Canadian and South Afri‑
can universities. Perspectives in Education, 40(3), 47–61. https://doi.org/10.18820/2519593X/pie.v40.i3.4
Serrano-Laguna, A., Manero, B., Freire, M., & Fernandez-Manjon, B. (2018). A methodology for assessing the effectiveness
of serious games and for inferring player learning outcomes. Multimedia Tools and Applications, 77(2), 2849–2871.
https://doi.org/10.1007/s11042-017-4467-6
Shah, Z., Kennedy-Clark, S., Xie, Y., Rahim, M. S., Mahdavi, M., & Levula, A. (2022). Teacher views on teaching sustainability
in higher education institutes in Australia. Sustainability (Switzerland), 14(14), 8431, Article 8431. https://doi.org/10.
3390/su14148431
Shneiderman, B. (2020). Human-centered artificial intelligence: Reliable, safe & trustworthy. International Journal of
Human-Computer Interaction, 36(6), 495–504. https://doi.org/10.1080/10447318.2020.1741118
Silva, K., Induwara, R., Wimukthi, M., Poornika, S., Samaratunge Arachchillage, U. S. S., & Jayalath, T. (2022). E-tutor: Compre‑
hensive student productivity management system for education. In 2022 4th International conference on advance-
ments in computing (ICAC), Colombo, Sri Lanka.
Simuț, C., Petrila, L., Popescu, F. A., & Oprea, I. M. (2021). Challenges and opportunities for telecommuting in the school
system: Building a sustainable online education in the context of the SARS-Cov-2 pandemic. Sustainability (Switzer-
land), 13(18), 10296, Article 10296. https://doi.org/10.3390/su131810296
Singh, N., Gunjan, V. K., Mishra, A. K., Mishra, R. K., & Nawaz, N. (2022). Seistutor: A custom-tailored intelligent tutoring
system and sustainable education. Sustainability (Switzerland), 14(7), 4167, Article 4167. https://doi.org/10.3390/
su14074167
Smaniotto, C., Saramin, A., Brunelli, L., & Parpinel, M. (2023). Insights and next challenges for the italian educational system
to teach sustainability in a global context. Sustainability (Switzerland), 15(1), 209, Article 209. https://doi.org/10.3390/
su15010209
Sterling, S. R., & Orr, D. (2001). Sustainable education: Re-visioning learning and change (Vol. 6). Green Books for the Schu‑
macher Society Totnes.
Tewari, A. (2020). Sustainable education in India through artificial intelligence: Challenges and opportunities. In WebSci
2020—Companion of the 12th ACM conference on web science, Southampton, United Kingdom.
Tobarra, L., Utrilla, A., Robles-Gómez, A., Pastor-Vargas, R., & Hernández, R. (2021). A cloud game-based educative platform
architecture: The cyberscratch project. Applied Sciences, 11(2), 1–22, Article 807. https://doi.org/10.3390/app11
020807
Tsegay, S. M., Ashraf, M. A., Perveen, S., & Zegergish, M. Z. (2022). Online teaching during COVID-19 pandemic: Teachers’
experiences from a Chinese university. Sustainability (Switzerland), 14(1), 568, Article 568. https://doi.org/10.3390/
su14010568
Tzeng, J. W., Lee, C. A., Huang, N. F., Huang, H. H., & Lai, C. F. (2022). MOOC evaluation system based on deep learning.
International Review of Research in Open and Distance Learning, 23(1), 21–40. https://doi.org/10.19173/IRRODL.V22I4.
5417
United Nations. (2015). Sustainable development 17 goals. Retrieved 05 May 2023 from https://sdgs.un.org/goals
Wade, R. (2012). Pedagogy, places and people. Journal of Teacher Education for Sustainability, 14(2), 147–167. https://doi.
org/10.2478/v10099-012-0014-8
Weng, J. X., Huang, A. Y. Q., Lu, O. H. T., Chen, I. Y. L., & Yang, S. J. H. (2020). The implementation of precision education
for learning analytics. In Proceedings of 2020 IEEE international conference on teaching, assessment, and learning for
engineering, TALE, Takamatsu, Japan.
Wu, S.-H., Lai, C.-L., Hwang, G.-J., & Tsai, C.-C. (2021). Research trends in technology-enhanced chemistry learning: A
review of comparative research from 2010 to 2019. Journal of Science Education and Technology, 30(4), 496–510.
https://doi.org/10.1007/s10956-020-09894-w
Xie, H., Chu, H.-C., Hwang, G.-J., & Wang, C.-C. (2019). Trends and development in technology-enhanced adaptive/person‑
alized learning: A systematic review of journal publications from 2007 to 2017. Computers & Education. https://doi.
org/10.1016/j.compedu.2019.103599
Xing, W., & Goggins, S. (2015). Learning analytics in outer space: A hidden naïve bayes model for automatic student
off-task behavior detection. In Proceedings of the fifth international conference on learning analytics and knowledge,
Poughkeepsie, New York.
Yang, C. C. Y., Chen, I. Y. L., & Ogata, H. (2021a). Toward precision education: Educational data mining and learning
analytics for identifying students’ learning patterns with ebook systems. Educational Technology and Society, 24(1),
152–163.
Yang, Q.-F., Lin, C.-J., & Hwang, G.-J. (2019). Research focuses and findings of flipping mathematics classes: A review of
journal publications based on the technology-enhanced learning model. Interactive Learning Environments, 29(6),
905–938. https://doi.org/10.1080/10494820.2019.1637351
Yang, S. J. H., Ogata, H., & Matsui, T. (2023). Guest editorial: Human-centered AI in education: Augment human intel‑
ligence with machine intelligence [Editorial]. Educational Technology and Society, 26(1), 95–98. https://doi.org/10.
30191/ETS.202301_26(1).0007
Yang, S. J. H., Ogata, H., Matsui, T., & Chen, N. S. (2021b). Human-centered artificial intelligence in education: Seeing the
invisible through the visible. Computers and Education: Artificial Intelligence, 2, 100008, Article 100008. https://doi.
org/10.1016/j.caeai.2021.100008
Yin, R. K. (2015). Qualitative research from start to finish. Guilford Publications.
Yousuf, M., & Wahid, A. (2021). The role of artificial intelligence in education: Current trends and future prospects. In 2021
International conference on information science and communications technologies (ICISCT), Tashkent, Uzbekistan.
Lin et al. Smart Learning Environments (2023) 10:41 Page 22 of 22
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Chien‑Chang Lin is currently working for Applied Materials as Asia Information Service Head. He is a
Ph.D. candidate in National Central University. His research interests include Artificial Intelligence, Natural
Language Processing and Sustainable Education.
Anna Y.Q. Huang received her PhD degree in Institute of Engineering Science and Technology from
National Kaohsiung First University of Science and Technology at Taiwan in 2011. Her research interests
include Big Data technology, LA, mobile learning, MOOCs, Computer Supported Collaborative Learning
(CSCL).
Owen H.T. Lu is currently serves as Assistant Professor, College of Computer Science, National Chengchi
University. Dr. Lu received a Ph.D. in Computer Science & Information Engineering at National Central Uni‑
versity, Taiwan.