TEM Journal. Volume 14, Issue 2, pages 1014-1023, ISSN 2217-8309, DOI: 10.18421/TEM142-04, May 2025.

ChatGPT as a Supportive Tool for

Creating Assessment Resources
Gabriela Kiryakova 1
1
Faculty of Education, Trakia University, Armeiska 9, Stara Zagora, Bulgaria

Abstract – The widespread penetration of Artificial 1. Introduction

Intelligence (AI) tools has created many chances for
educators. AI applications can be used to prepare Today’s learners are representatives of the digital
lectures and classroom exercises – from creating lesson generation. Their educational characteristics require
plans, presentations, and lectures, generating tasks for
the integration of modern digital technologies in
practical work and self-assessment to generating exam
tasks and quiz questions. This study presents the learning [1]. Education needs significant changes to
generation of quiz questions and tasks by ChatGPT on meet the expectations of new learners. The
the topic of number systems. Findings show that the development of technologies and their integration into
generation of quiz questions and their answers, education alter existing practices, and educators must
practical tasks, and their solutions has taken ChatGPT adapt to new realities, including their advantages and
minutes, less than teacher's time preparing a quiz. In challenges [2]. The changes in teaching and learning
the current research, ChatGPT has demonstrated its brought about by artificial intelligence tools
capabilities to generate different types of questions necessitate a reevaluation of the present role of
relevant to the learning content, clearly and correctly education [3].
defined, as well as practical tasks. The presence of
There is evidence that ChatGPT, one of the popular
inaccuracies indicates that generative models are still
developing. The research outcomes have shown that representatives of AI, can provoke changes that could
teachers must integrate ChatGPT into their activities lead to innovation [4]. ChatGPT is becoming an
responsibly, considering the possible challenges and inevitable part of education, therefore teachers and
threats. educational institutions should embrace it as an
opportunity to change existing teaching and
Keywords – Artificial Intelligence, ChatGPT,
teaching, education, quiz, questions, number systems. assessment methods [5].
Discussions in the scientific literature regarding the
integration of AI in educational activities have
focused on concerns that learners may use it
unethically, potentially stifling their creativity and
critical thinking. Questions about the new position and
functions of teachers are also on the agenda. Concerns
are that such tools will displace teachers and harm
DOI: 10.18421/TEM142-04 education for both teachers and learners. The
https://doi.org/10.18421/TEM142-04 accumulated experience so far related to the
integration of ChatGPT and similar tools in real
Corresponding author: Gabriela Kiryakova, learning activities allows experts to highlight more
Faculty of Education, Trakia University, Armeiska 9, benefits than risks and threats.
Stara Zagora, Bulgaria. The popularity of AI tools has revealed many new
Email: [email protected] possibilities as well as challenges for educators.
Received: 29 September 2024. Teachers can use AI applications to prepare lectures,
Revised: 05 April 2025. seminars, and classroom exercises – from creating
Accepted: 28 April 2025. lesson plans, presentations, and lectures, generating
Published: 27 May 2025. tasks for practical work and self-assessment, to
© 2025 Gabriela Kiryakova; published by generating exam tasks and quiz questions. AI tools can
UIKTEN. This work is licensed under the Creative Commons help teachers by providing them with numerous
Attribution-NonCommercial-NoDerivs 4.0 License. resources and support, thereby improving the
effectiveness of teaching and learning [6]. Studies in
The article is published with Open Access at this area show that users cannot fully rely on
https://www.temjournal.com/ educational content created by generative models.

1014 TEM Journal – Volume 14 / Number 2 / 2025.

 TEM Journal. Volume 14, Issue 2, pages 1014-1023, ISSN 2217-8309, DOI: 10.18421/TEM142-04, May 2025.

The specifics of the subject area, educational goals, Generating learning and assessment resources
and learners’ needs should be considered [2]. Teachers ChatGPT can support teachers in preparing for
must critically evaluate the limitations of AI teaching activities and assessing learners’ knowledge
applications and accept them as supportive tools rather and skills. It can create course syllabi, learning units,
than replacements [7]. materials, and tasks for students’ evaluation [13].
One of the most popular chatbots that helped make Based on documents provided to models, a syllabus
generative AI widely accessible to users is ChatGPT. can be generated with a brief description of each topic
ChatGPT, developed by OpenAI, is a natural language [14]. Large language models can help teachers in
processing model. It is trained on massive datasets and creating effective lesson plans and engaging learning
can generate human-like responses to answer user activities. presentations, quizzes, and exams [15],
questions [8]. ChatGPT interacts with users in a saving time and effort [16] in the initial selection and
dialogue format consisting of questions and answers. integration of educational resources [6].
The model can identify incorrect assumptions and ChatGPT is a powerful tool for creating engaging
reject unsuitable queries [9]. presentations and other educational resources that
ChatGPT can discuss various topics, which teachers can adapt, enrich, and enhance to meet the
expands its potential areas of use [8]. One possible diverse needs of learners [10].
application of ChatGPT in education is to generate In language learning, ChatGPT can assist learners
quiz questions on learning topics. by playing the role of a conversation partner [11]. The
The current paper aims to present the generation of ability of ChatGPT to generate and provide authentic
quiz questions by ChatGPT on the topic of number language materials, such as dialogues and reading
systems. The study aims to verify the accuracy of the texts, guarantees the improvement of learners’ reading
generated questions and determine whether similar and language comprehension skills [17]. Its ability to
tools can be used to assist teachers. generate personalized texts on specific topics at a
The paper presents the generation of quiz questions given level of language proficiency helps teachers to
and tasks by ChatGPT on the topic of number systems. create content tailored to the learners’ individual
The generated questions and tasks are used for self- needs [18].
assessment by students. The topic of number Systems Assessment is an integral part of education, and
is part of the curriculum of disciplines studied by ChatGPT supports teachers in creating various
students – future teachers of informatics and assessment resources that offer real-time feedback and
information technologies at the University in reports [19]. ChatGPT saves educators time and effort
Bulgaria. in generating appropriate assessments and
The research questions of the study are: assignments, reducing the burden of grading [19].
RQ1: Is ChatGPT capable of generating quiz ChatGPT can create quizzes with various types of
questions and tasks on the topic of Number Systems? questions, including open-ended questions that aim to
RQ2: Are generated quiz questions and practical assess learners’ understanding of basic concepts or to
tasks by ChatGPT suitable to use in learning? provoke reflection on various issues related to the
learning content [20]. ChatGPT can generate
2. Benefits and Risks of Integrating AI in questions and quizzes at various difficulty levels [21],
Teaching and Learning – a Literature Review multiple types of questions and their answers,
targeting different aspects of assessment [18], and
AI can significantly enrich and improve the personalized practical tasks to assess learners’ skills
learning and pedagogical experience [10]. AI [14].
applications are becoming a crucial factor for Personalized learning- The ability of generative
educational institutions to offer personalized learning, models to provide personalized learning is one of their
build intelligent educational systems [11], and provide greatest strengths [11]. AI can be used to identify
targeted feedback and support [12]. learning needs and generate personalized
Research over the past two years has demonstrated recommendations and individualized instruction that
the potential of ChatGPT to support educators in meet the unique needs of each learner [22]. ChatGPT
preparing and implementing learning activities. At the can be perceived as a partner or assistant, thanks to its
same time, ChatGPT faced society and educational interactive component, and is able to provide
institutions with new and unknown challenges [13]. personalized guidance and direction [23].
AI tools can generate content relevant to the
2.1. Potential Benefits student’s learning needs and provide them with
personalized learning experiences [12]. Providing
The potential advantages of using AI tools in learning content relevant to learners' needs and
education include the generation of learning and interests captures their attention and engagement [16]
assessment resources, personalization and adaptability and helps them understand complex concepts and
of learning, personalized feedback, and automated theories.
assessment.

TEM Journal – Volume 14 / Number 2 / 2025. 1015

 TEM Journal. Volume 14, Issue 2, pages 1014-1023, ISSN 2217-8309, DOI: 10.18421/TEM142-04, May 2025.

The speech-to-text conversion and text-generation On the other hand, the issues about the fairness and
capabilities of AI support learners with special transparency of the grades generated by ChatGPT are
educational needs, contributing to inclusive education increasing [27].
[23]. Inaccurate and incorrect learning content- The use
Personalized feedback is another aspect of of AI-based tools raises fear about the accuracy and
personalization of learning. Large language models reliability of the generated learning content. The risk
can analyze learners' written materials and responses, of incorrect information and the spread of
providing them with personalized feedback that disinformation is a serious concern [26]. The model
suggests resources aligned with their specific learning can generate wrong answers [22], and incorrect or
needs [14] and guides them in working on problems, even fabricated information, which can be
projects, or assignments [15], thereby saving teachers problematic for learners who rely on ChatGPT as their
time and effort. ChatGPT can provide personalized main source of information and knowledge [10].
feedback tailored to the needs of each learner, helping The precision of the generated content depends on
them build new learning experiences based on their various factors, including the variety and quality of the
existing knowledge [24].
training data, the accuracy of the input data, and the
AI can analyze learners' data and help educators
prompts provided by users [12]. In cases where the
identify areas where learners need additional support
prompts are unclear or imprecise, the models may not
[22].
generate accurate answers.
Evaluation- Over the years, AI has increasingly
been used to automate various aspects of assessment, Impeding the development of critical 21st-century
saving time and reducing teacher workload. Learners skills- Another significant challenge for both –
receive fast, accurate, and personalized feedback on learners and teachers is the risk of over-reliance on AI.
their results and performance. ChatGPT's real-time This could disrupt the formation of skills in critical
comprehension and response capabilities enable the analysis and thinking, assessing the quality and
generation of interactive quizzes with feedback authenticity of information, making informed
tailored to learners’ needs [25], helping to improve judgments, generating creative and original ideas, and
their results [19]. transforming learners into passive actors who accept
Teachers can use ChatGPT to create clear and the responses generated by ChatGPT [12]. Models can
concise rubrics that describe what learners need to do provide targeted feedback, but can not offer the
to succeed to generate explanations of how learners emotional support and interaction necessary for
are assessed and how assignments relate to learning teaching [7].
outcomes [20]. From the above, it can be concluded that AI-based
ChatGPT can help assess strengths and weaknesses tools, in particular ChatGPT, have the potential to
in learners' performance [14]. AI tools can support support teachers in their teaching activities. However,
teachers in identifying areaswhere learners experience teachers and students should not rely solely on these
difficulties, contributing to a more precise assessment tools to take on all their duties.
of their progress [10].
3. Creating Quiz Questions
2.2. Challenges
This paper presents the process of creating quiz
Generative AI models offer diverse opportunities
questions and practical tasks by ChatGPT on the topic
for education, but also pose serious challenges to
of Number systems, which is part of the curriculum
academic integrity and the authenticity of generated
for disciplines studied by students – future teachers of
content. Addiction and overreliance on AI-based tools
can lead to severe cognitive problems. informatics and information technologies at the
Ethical concerns- Ethical concerns such as the risk University in Bulgaria.
of bias and plagiarism are among the most frequently The topic "Number Systems" includes the
raised [26]. The generated information may be following main points: the essence and types of
politically biased, as well as on religion, race, and Number systems, positional and non-positional
gender [10]. number systems, their advantages and disadvantages,
AI's ability to generate texts could lead to the basic concepts of positional number systems, the
intellectual property abuse and plagiarism. Such rules for converting numbers from decimal to binary,
scenarios raise ethical concerns and undermine the octal, and hexadecimal systems and vice versa, and
academic integrity of education [10]. binary arithmetic.
One of the major concerns of educators is the The quizzes for self-assessment of acquired
possibility of exam cheating. Students can use knowledge and skills are available for each topic and
ChatGPT to complete their assignments and solve include closed and open-ended questions and tasks.
exam tasks [13].

1016 TEM Journal – Volume 14 / Number 2 / 2025.

 TEM Journal. Volume 14, Issue 2, pages 1014-1023, ISSN 2217-8309, DOI: 10.18421/TEM142-04, May 2025.

The process of creating quiz questions involved 3. Define the non-positional number system.
several steps: a) A system in which the value of a digit depends
Step 1. The initial prompt to ChatGPT was to on its position
create quiz questions on the topic of Number systems, b) A system using only positive numbers
specifying the desired topics to include in the c) A system in which the value of a digit does not
questions. Prompts and answers were in Bulgarian depend on its position
language. Types of non-positional number systems:
Prompt: Could you create quiz questions on the 4. What are the basic principles of non-positional
topic of number systems? The topics that are desirable number systems?
to include are types of number systems – positional a) The value of a digit depends on its position
and non-positional - types of non-positional number b) The value of a digit does not depend on its
systems, and basic concepts in positional number position
systems, including basis, order, and weight. c) Only negative numbers are used
The questions offered by ChatGPT were open- 5. What are some examples of non-positional
ended and divided into topics: number systems?
a) The Roman numeral system
ChatGPT answer: b) The binary number system
„Types of number systems: c) The decimal number system
1) What is the positional number system? Basic concepts in positional number systems:
2) The name of the positional number system with 6. What role does the base play in the positional
base 2 is...? number system?
3) Define the non-positional number system. a) Determines the number of available digits
Types of non-positional number systems: b) Determines the value of each digit relative to the
1) What are the basic principles of non-positional position
number systems? c) Determines the weight of each digit
2) What are some examples of non-positional 7. How is order defined in positional number
number systems? systems?
Basic concepts in positional number systems: a) The order of the digits in the number
1) What role does the base play in the positional b) The value of each digit relative to the position
number system? c) Determines the number of available digits
2) How is order defined in positional number 8. What is weight in positional number systems and
systems? what does it represent?
3) What is weight in positional number systems and a) The weight determines the number of digits
what does it represent?“ available
The generated questions are correct and cover the b) The weight is the value of each digit relative to
main aspects of the topic under consideration. the position
c) The weight is the order of the digits in the
Step 2. The next prompt was to transform the open- number“.
ended questions into multiple-choice type questions.
Prompt: If possible, can you transform open- The questions and their answers are correctly
ended questions into multiple-choice questions? generated. It is worth noting that there were identical
ChatGPT transformed the questions and redefined answers to questions 1 and 3, as well as the same
them by proposing three possible answers. answers for some other questions.
Step 3. In addition to theoretical questions,
ChatGPT answer: ChatGPT also generated practical tasks for converting
„Types of number systems: decimal numbers to binary and vice versa.
1. What is the positional number system? Prompt: ChatGPT, can you provide some
a) A system in which the value of a digit depends examples of converting decimal numbers to binary
on its position and vice versa - from binary to decimal?
b) A system using only positive numbers ChatGPT generated several examples of
c) A system in which the value of a digit does not converting numbers from the decimal system to the
depend on its position binary system and vice versa (Figure 1 and Figure 2).
2. The name of the base 2 positional number system
is...?
a) Binary
b) Decimal
c) Octal

TEM Journal – Volume 14 / Number 2 / 2025. 1017

 TEM Journal. Volume 14, Issue 2, pages 1014-1023, ISSN 2217-8309, DOI: 10.18421/TEM142-04, May 2025.

ChatGPT answer: ChatGPT answer:

„From decimal to binary number system Example 1:
Example 1: Add the binary numbers ‘101’ and ‘110’.
Convert ‘13’ to a binary There is a carry of 1 to the higher position.

1. 13 ÷ 2 = 6 with a remainder of 1.
2. 6 ÷ 2 = 3 with a remainder od 0.
3. 3 ÷ 2 = 1 with a remainder of 1.
4. 1 ÷ 2 = 0 with a remainder of 1.

Reading the remainders from bottom to top, get

‘1101’. So, the number ‘13’ in decimal becomes
‘1101’ in binary.
Example 2:
Convert ‘27’ to a binary.

1. 27 ÷2 = 13 with a remainder of 1.
2. 13 ÷ 2 = 6 with a remainder of 1. Figure 3. Example 1 – Binary addition
3. 6 ÷ 2 = 3 with a remainder of 0.
4. 3 ÷ 2 = 1 with a remainder of 1. Example 2:
5. 1 ÷ 2 = 0 with a remainder of 1. Add the binary numbers ‘1101’ and ‘111’.
There is a carry of 1 to the higher position.
Reading the remainders from bottom to top, we
get ‘11011’. So, the number ‘27’ in decimal
becomes ‘11011’ in binary.”
“From binary to decimal number system
Example 1: Convert ‘1011’ to a decimal (The
formula is shown on Figure 1).

Figure 1. Example 1 – Converting from binary to decimal

number system
Figure 4. Example 2 – Binary addition
Example 2: Convert ‘11010’ to a decimal (The The practical examples are simple and usually like
formula is shown on Figure 2).” those used in the classroom by teachers to practice
binary arithmetic. The answer in the first example was
correct. In the second example, an incorrect answer
was noticed.
Step 5. The identified inaccuracy in the second
Figure 2. Example 2 – Converting from binary to decimal
task was discussed with ChatGPT. The model
number system provided clarification on the step-by-step action.
Prompt: ChatGPT, is it possible to discuss
ChatGPT wrote down the formulas and obtained Example 2 in more detail?
correct results, demonstrating the application of ChatGPT explained the process of adding two
algorithms for converting numbers between binary binary numbers step by step.
and decimal systems. ChatGPT answer:
Step 4. The next prompt to ChatGPT was designed
to generate examples of binary arithmetic. „There are two binary numbers – ‘1101’ and
Prompt: ChatGPT, can you suggest some ‘111’. The addition begins from right to left, as is the
examples of binary arithmetic – addition operation? case in the decimal system.
ChatGPT-generated tasks and their answers are
shown in Figure 3 and Figure 4.

1018 TEM Journal – Volume 14 / Number 2 / 2025.

 TEM Journal. Volume 14, Issue 2, pages 1014-1023, ISSN 2217-8309, DOI: 10.18421/TEM142-04, May 2025.

1. In the first position from the right, there is the

addition of 1 and 1 (1 + 1 = 10 in binary). The
result is 0 and carry over 1 to the next significant
bit (Figure 5).
2. The addition continues with the next digits: 1
from the first number, and the carry-over from
the previous column is added with 1 from the
second number 1 (1 + 1 + 1 = 11 in binary). The
result is 1 and carry over 1 (Figure 6).
3. The addition continues: 1 from the first number,
1 from the second number, and the carry-over is
added, which gives 0 with a carryover 1 (1 + 1 +
1 = 11 in binary). The result is 0 and carry over Figure 9. Second attempt at Figure 10. Third attempt
1 (Figure 7). solving the example at solving the example
4. Finally is the addition of the last digits: 1 from ChatGPT explained again the process of adding
the first number, and the carry-over is added to two binary numbers step by step.
1 from the second number, which gives 0 with a
carry (1 + 1 = 10 in binary). The result is 0 and ChatGPT answer:
carry-over 1 (Figure 8). “Looks like I made a mistake again. I sincerely
5. The result of adding the numbers ‘1101’ and apologize. Let's do the math again.
‘111’ is‘10000’.“ 1. In the first position on the right, there is 1 + 1,
which is 0 with a carry of 1 (Figure 11).
2. Step 2: 1 from the first number, and the carry
is added to 1 from the second number, which
equals 0 with a carry of 1 (Figure 12).
3. Step 3: 1 from the first number and 1 from the
second number, which is added to the carry-
over from the previous column, giving 1 with a
carry of 1 (Figure 13).
4. Finally, 1 from the first number and a 1 from
the second number, which is added to the carry
Figure 5. Binary Figure 6. Binary from the previous column, giving a 0 with
addition - Step 1 addition - Step 2 carry 1 (Figure 14).”

Figure 7. Binary Figure 8. Binary

addition - Step 3 addition - Step 4
Figure 11. Step 1 of Figure 12. Step 2 of
binary addition binary addition
Due to repeated incorrect responses, ChatGPT was
invited to re-explain the operation of addiction.
Prompt: ChatGPT, can you repeat the operation
addiction because there is an inaccuracy.
After the explanation, ChatGPT provided another
incorrect answer shown on Figure 9.
ChatGPT was prompted to perform the operation
again. ChatGPT offered the original answer again,
admitting the same inaccuracy, but got a different
answer in the step-by-step explanation (Figure 10).
Figure 13. Step 3 of Figure 14. Step 4 of
binary addition binary addition

TEM Journal – Volume 14 / Number 2 / 2025. 1019

 TEM Journal. Volume 14, Issue 2, pages 1014-1023, ISSN 2217-8309, DOI: 10.18421/TEM142-04, May 2025.

The explanations were correct, but the final 4. Discussion

presentation of the answer was not, which can be a
serious problem for learners who may only focus on Initial research of the capabilities of ChatGPT was
the result without paying attention to the explanations related to checking and proving that generative
or become confused by the discrepancy between the models can handle and solve quizzes that teachers use
explanation and the answer. to assess learners’ knowledge. [28] discussed the
The correct answer, 10100, was presented to results of ChatGPT performance on the Computer
ChatGPT, and the model was asked for its opinion. Science Algorithms and Data Structures exam.
ChatGPT accepted the suggested answer. ChatGPT received slightly more than half the points,
Prompt: One possible way to check the result is to a performance the authors described as impressive.
convert the two binary numbers to decimal, perform Highlighted were also the limitations of the current
arithmetic operation addiction, and convert the version of the model, as the model's performance was
resulting decimal number to binary. Let’s try this in worse than the average performance of the students.
this example. Understanding the potential of ChatGPT and its
ChatGPT seamlessly converts binary numbers to capabilities to help teachers results in increasing use
decimals, adds them, and converts the decimals to of the tool to generate learning and assessment
binary (Figure 15). resources.
RQ1: Is ChatGPT capable of generating quiz
questions and tasks on the topic of number
systems?
One of the significant advantages of ChatGPT is
that it saves teachers’ time and effort in generating
questions, quizzes, and assignments. In the current
study, the generation of quiz questions and their
answers, practical tasks, and solutions took ChatGPT
minutes – less than the time a teacher spends on
preparing a quiz. Correcting one of the practical tasks
took longer. This finding is consistent with the results
Figure 15. ChatGPT calculations
of [29], who cited ChatGPT as an example, which
demonstrated a 100% increase in performance in
ChatGPT answer: "exam writing." Similar results were observed in [30],
where the effectiveness of ChatGPT was tested by
“After checking, the result of adding the binary
integrating the model into educational activities. It
numbers 1101 and 111 is 10100. Thanks for the
was found that by automating certain tasks and
checking idea!
processes, ChatGPT could save time. Similarly, [31]
This method of checking is often very useful,
especially when students feel confused or unsure of the highlighted that ChatGPT spent less overall time
result. Converting the numbers to different number creating medical exam questions. [32] stressed the
systems and performing the operations in other time-saving advantage, noting that the time required
systems can help confirm the correctness of the result. by ChatGPT-3.5 to create questions is much less than
This method can be useful because it allows you to the time invested by teachers in selecting questions
verify the result using an alternative approach, such and finalizing quiz design.
as switching between different number systems. It not The questions and answers generated by ChatGPT
only provides an opportunity to verify the correctness on the topic of number systems are relevant to the
of calculations but also allows students to practice learning content and clearly and correctly defined.
converting numbers between systems, a crucial skill in Similar results that ChatGPT can generate medical
learning number systems. exam questions with comparable performance to
However, this method can be more complicated experienced tutors were reported by [31]. A
and time-consuming, especially when the numbers are comparison between ChatGPT-generated and teacher-
larger, or the conversion process is challenging for generated questions revealed that there is no
students. So, it can be useful as an additional considerable difference in question quality, and
verification method or when students want to practice ChatGPT questions were inferior only in the domain
converting between different number systems.” of relevance.

1020 TEM Journal – Volume 14 / Number 2 / 2025.

 TEM Journal. Volume 14, Issue 2, pages 1014-1023, ISSN 2217-8309, DOI: 10.18421/TEM142-04, May 2025.

Confirmed by [32], the capabilities of ChatGPT- Based on these concerns, teachers may be advised
3.5 are for creating multiple-choice questions to use ChatGPT as a guide in preparing assessment
in an anatomy and kinesiology course by materials.
evaluating the wording, clarity, coherence, and The AI-based models cannot completely replace
simplicity of the questions. Their conclusion is that teachers in generating learning and assessment
generated assessment resources are comprehensible resources. Teachers are responsible for refining the
to students, and ChatGPT saves teachers time and content, designing the style, and adapting it to learning
effort. goals and learners’ levels.
The teacher’s role is decisive in formulating correct To integrate AI-based tools in teachers’ activities,
prompts for ChatGPT. Generating high-quality such as creating quiz questions, as well as possible,
multiple-choice questions is determined by the several important advice can be followed: clear
correctness of the prompts, as well as further prompts to AI-based tools; checking the correctness of
clarifications and revisions [33]. [21] reported questions and answers; corrective prompts to clear
ChatGPT ability to create quizzes of varying levels of inaccuracies (if existing).
difficulty on Sorting and Searching Algorithms, The correct and detailed wording of requests to
noting the significant difference between questions at generative models is very important. Teachers have to
different levels. flesh out the main points – topic, subtopics, concepts,
RQ2: Are generated quiz questions and notions, etc. in a given learning unit and clarify the
practical tasks by ChatGPT suitable to use in number and question type for multiple-choice
learning? questions to determine the possible answers (correct
The questions and examples generated by plus distractors). The requirement for AI tools to
ChatGPT were correctly defined according to the set generate many questions on a specific topic results in
parameters in the prompts, with few exceptions. similar questions.
Similar results were observed in [34], where physics A critical evaluation of texts generated by AI tools
tasks related to four different kinematic concepts were is essential to ensure accuracy while promoting
compared across two groups of users: one assisted by critical thinking skills [16]. Materials generated by
ChatGPT and the other using textbooks. it was generative models cannot be used without critical
reported comparability in terms of the correctness and evaluation for correctness and suitability [7]. The
overall quality of the generated questions but observed teacher’s role is essential, as AI cannot substitute their
that students who had used textbooks achieved greater judgment and expertise [22].
clarity. The existing inaccuracies and desired corrections
The teachers are responsible for finalizing and can be discussed with generative models; however, the
structuring the questions and assignments and final design of the questions and tasks remains the
ensuring their validity and reliability. The study's teachers’ responsibility.
findings revealed that, in certain instances, ChatGPT
can generate incorrect assignments. Similarly, [35] 5. Limitations of the Study
concluded that ChatGPT is a useful tool for quickly
preparing a variety of high-quality multiple-choice The present study has several limitations. First,
questions, although it cannot be relied upon blindly. ChatGPT has generated questions and tasks on only
The potential limitations may include a lack of domain one learning unit from the curriculum. For this reason,
expertise, difficulties in understanding the context, the evaluation and general conclusions regarding
and an inability to verify answers and generate visual ChatGPT's ability to generate content-varied
aids. Further to that, [13] stressed that ChatGPT- questions cannot be made, but rather on how accurate
generated assessment tasks may not cover all intended the questions and answers are.
learning objectives. Second, the generated questions are evaluated by
The generative models, particularly ChatGPT, the teacher and refined, cleared of inaccuracies. To
show impressive capabilities for creating educational draw deeper conclusions regarding the capabilities of
and learning resources, but cannot replace teachers. ChatGPT to generate quality quiz questions and tasks,
Their role is essential in evaluating, improving, it is necessary to compare students’ results of teacher-
adapting, and applying appropriate AI-generated generated quizzes and AI-generated ones. On the other
materials [7]. Teachers need to understand the hand, the opinions of students regarding the clarity,
limitations of such models and intervene appropriately complexity of the questions and tasks, and several
when AI cannot successfully cope, thereby other criteria are also important and should be
overcoming the potential dangers and challenges [18]. investigated.

TEM Journal – Volume 14 / Number 2 / 2025. 1021

 TEM Journal. Volume 14, Issue 2, pages 1014-1023, ISSN 2217-8309, DOI: 10.18421/TEM142-04, May 2025.

6. Conclusion [4]. Rudolph, J., Tan, S., & Tan, S. (2023). ChatGPT:
Bullshit spewer or the end of traditional assessments in
Generative AI is transforming education and higher education?. Journal of applied learning and
changing the roles of teachers. Used correctly, AI teaching, 6(1), 342-363. Doi: 10.37074/jalt.2023.6.1.9
[5]. Hong, W. C. H. (2023). The impact of ChatGPT on
tools can support teaching, enhance learning and make
foreign language teaching and learning: Opportunities in
them more efficient, However, educators have to education and research. Journal of educational
ensure the accuracy of the generated information technology and innovation, 5(1).
AI applications, such as ChatGPT, can automate [6]. Huang, J., & Li, S. (2023). Opportunities and
certain tasks and processes and save educators’ time challenges in the application of ChatGPT in foreign
and effort. Teachers can use ChatGPT as an advisor or language teaching. International Journal of Education
assistant in generating educational resources. and Social Science Research, 6(4), 75-89.
Assessing learners' knowledge and skills requires [7]. van den Berg, G., & du Plessis, E. (2023). ChatGPT
teachers’ time and effort to create appropriate and generative AI: Possibilities for its contribution to
resources tailored to learning objectives and the lesson planning, critical thinking and openness in
teacher education. Education Sciences, 13(10), 998.
learners’ level of knowledge. Integrating ChatGPT
[8]. Gilson, A., et al. (2022). How does ChatGPT perform
can support some assessment activities and reduce on the medical licensing exams? The implications of
teachers' workload. large language models for medical education and
On the other side, for both learners and teachers, knowledge assessment. MedRxiv, 2022-12.
the overuse of AI tools can negatively impact their [9]. OpenAI. (2022). Introducing ChatGPT. OpenAI.
problem-solving and critical-thinking skills. Retrieved from: https://openai.com/blog/chatgpt/
The results of the current study showed that [accessed: 18 August 2024]
creating quiz questions and tasks is based on a [10]. Grassini, S. (2023). Shaping the future of education:
discussion with AI-based tools to reveal the logic of Exploring the potential and consequences of AI and
their generation and formulation. ChatGPT in educational settings. Education
sciences, 13(7), 692.
In the current research, ChatGPT has demonstrated
[11]. Gill, S. S., et al. (2024). Transformative effects of
its ability to generate various types of questions, ChatGPT on modern education: Emerging Era of AI
including practical tasks related to the topic of Chatbots. Internet of Things and Cyber-Physical
Number systems. The presence of inaccuracies Systems, 4, 19-23.
suggests that generative models are still in the process [12]. Fuchs, K. (2023). Exploring the opportunities and
of development. The research outcomes have shown challenges of NLP models in higher education: is Chat
that teachers have to integrate ChatGPT into their GPT a blessing or a curse?. Frontiers in education, 8,
activities very responsibly, taking into account the 1166682. Frontiers Media SA.
possible challenges and threats. [13]. Lo, C. K. (2023). What is the impact of ChatGPT on
education? A rapid review of the literature. Education
Acknowledgements sciences, 13(4), 410.
[14]. Kasneci, E., et al. (2023). ChatGPT for good? On
This research was funded by European Union- opportunities and challenges of large language models
NextGenerationEU, in the frames of the National Recovery for education. Learning and individual differences, 103,
and Resilience Plan of the Republic of Bulgaria, first pillar 102274.
"Innovative Bulgaria", through the Bulgarian Ministry of [15]. Atlas, S. (2023). ChatGPT for higher education and
Education and Science (MES), Project № BG-RRP-2.004- professional development: A guide to conversational
0006-C02 “Development of research and innovation at AI. Digitalcommons@URI. Retrieved from:
Trakia University in service of health and sustainable well- https://digitalcommons.uri.edu/cba_facpubs/548
being”, subproject „Digital technologies and artificial [accessed: 21 August 2024]
intelligence for multimodal learning – a transgressive [16]. Kostka, I., & Toncelli, R. (2023). Exploring
educational perspective for pedagogical specialists“ № applications of ChatGPT to English language teaching:
Н001-2023.47/23.01.2024. Opportunities, challenges, and recommendations. Tesl-
References: Ej, 27(3), n3.
[17]. Baskara, R. (2023). Exploring the implications of
[1]. Alruthaya, A., Nguyen, T. T., & Lokuge, S. (2021). ChatGPT for language learning in higher
The application of digital technology and the learning education. Indonesian Journal of English Language
characteristics of Generation Z in higher Teaching and Applied Linguistics, 7(2), 343-358.
education. arXiv preprint arXiv:2111.05991. [18]. Koraishi, O. (2023). Teaching English in the age of
[2]. Jauhiainen, J. S., & Guerra, A. G. (2023). Generative AI: Embracing ChatGPT to optimize EFL materials and
AI and ChatGPT in school children’s education: assessment. Language Education and Technology, 3(1).
Evidence from a school lesson. Sustainability, 15(18), [19]. Sok, S., & Heng, K. (2023). ChatGPT for education
14025. and research: A review of benefits and
[3]. Sims, A. (2023). ChatGPT and the future of university risks. Cambodian Journal of Educational
assessment. Times higher education. Research, 3(1), 110-121.

1022 TEM Journal – Volume 14 / Number 2 / 2025.

 TEM Journal. Volume 14, Issue 2, pages 1014-1023, ISSN 2217-8309, DOI: 10.18421/TEM142-04, May 2025.

[20]. Herft, A. (2023). A teacher's prompt guide to [29]. Terwiesch, C. (2023). Would Chat GPT3 get a
ChatGPT aligned with'what works best'. CESE NSW Wharton MBA? A prediction based on its performance
“What Works Best in Practice. in the operations management course. University of
[21]. Rahman, M. M., & Watanobe, Y. (2023). ChatGPT Pennsylvania, Wharton School.
for education and research: Opportunities, threats, and [30]. Baidoo-Anu, D., & Ansah, L. O. (2023). Education in
strategies. Applied sciences, 13(9), 5783. the era of generative artificial intelligence (AI):
[22]. Zhai, X. (2022). ChatGPT user experience: Understanding the potential benefits of ChatGPT in
Implications for education. SSRN 4312418. promoting teaching and learning. Journal of AI, 7(1),
[23]. Fütterer, T., et al. (2023). ChatGPT in education: 52-62.
global reactions to AI innovations. Scientific [31]. Cheung, B. H. H., et al. (2023). ChatGPT versus
reports, 13(1), 15310. human in generating medical graduate exam multiple
[24]. Rasul, T., et al. (2023). The role of ChatGPT in higher choice questions—A multinational prospective study
education: Benefits, challenges, and future research (Hong Kong SAR, Singapore, Ireland, and the United
directions. Journal of Applied Learning and Kingdom). PloS one, 18(8), e0290691.
Teaching, 6(1), 41-56. [32]. Rivera-Rosas, C. N., et al. (2024). Exploring the
[25]. Javaid, M., et al. (2023). Unlocking the opportunities potential of ChatGPT to create multiple-choice question
through ChatGPT Tool towards ameliorating the exams. Educación Médica, 25(4), 100930.
education system. BenchCouncil Transactions on [33]. Kıyak, Y. S. (2023). A ChatGPT prompt for writing
Benchmarks, Standards and Evaluations, 3(2), 100115. case-based multiple-choice questions. Revista Española
[26]. Sallam, M. (2023). The utility of ChatGPT as an de Educación Médica, 4(3).
example of large language models in healthcare [34]. Küchemann, S., Steinert, S., Revenga, N.,
education, research and practice: Systematic review on Schweinberger, M., Dinc, Y., Avila, K. E., & Kuhn, J.
the future perspectives and potential (2023). Can ChatGPT support prospective teachers in
limitations. MedRxiv. physics task development?. Physical Review Physics
[27]. de Winter, J. C., Dodou, D., & Stienen, A. H. (2023). Education Research, 19(2), 020128.
ChatGPT in education: Empowering educators through [35]. Khilnani, A. K. (2023). Potential of large language
methods for recognition and assessment. Informatics, model (ChatGPT) in constructing multiple choice
10(4), 87. Multidisciplinary Digital Publishing Institute. questions. GAIMS Journal of Medical Sciences, 3(2), 1-
[28]. Bordt, S., & von Luxburg, U. (2023). Chatgpt 3.
participates in a computer science exam. arXiv preprint
arXiv:2303.09461.

TEM Journal – Volume 14 / Number 2 / 2025. 1023