(IJCST-V11I4P16) :nikhil Sontakke, Sejal Utekar, Shivansh Rastogi, Shriraj Sonawane
(IJCST-V11I4P16) :nikhil Sontakke, Sejal Utekar, Shivansh Rastogi, Shriraj Sonawane
ABSTRACT
Due to the widespread use of smartphones with high-quality digital cameras and easy access to a wide range of software apps
for recording, editing, and sharing videos and images, as well as the deep learning AI platforms, a new phenomenon of 'faking'
videos has emerged. Deepfake algorithms can create fake images and videos that are virtually indistinguishable from authentic
ones. Therefore, technologies that can detect and assess the integrity of digital visual media are crucial. Deepfakes, also known
as deep learning-based fake videos, have become a major concern in recent years due to their ability to manipulate and alter
images and videos in a way that is virtually indistinguishable from the original. These deepfake videos can be used for
malicious purposes such as spreading misinformation, impersonating individuals, and creating fake news. Deepfake detection
technologies use various approaches such as facial recognition, motion analysis, and audio-visual synchronization to identify
and flag fake videos. However, the rapid advancement of deepfake technologies has made it increasingly difficult to detect
these videos with high accuracy. In this paper, we aim to provide a comprehensive review of the current state of deepfake
creation and detection technologies. We examine the various deep learning-based approaches used for creating deepfakes, as
well as the techniques used for detecting them. Additionally, we analyze the limitations and challenges of current deepfake
detection methods and discuss future research directions in this field. Overall, the paper highlights the importance of continued
research and development in deepfake detection technologies in order to combat the negative impact of deepfakes on society
and ensure the integrity of digital visual media.
Keywords: - Deep Learning, Python, Deepfake, Videos, Digital Forensics, Manipulating, Detecting, Classifying, Segmenting,
Machine Learning.
behavior of individuals is artificially altered using deep processing. Deepfakes employs deep learning technology to
learning techniques. The use of deepfake technology has the modify photographs and videos of people to the point where
potential to cause significant harm in areas such as politics, humans are unable to distinguish them from the genuine thing.
entertainment, and personal relationships. In response, Many studies have been undertaken in recent years to better
researchers have developed various algorithms and techniques understand how deepfake function, and many deep learning-
using artificial intelligence (AI) to detect deepfakes and based algorithms have been presented to detect deepfake
preserve the integrity of digital media. This paper aims to videos or photos. They conducted a thorough review of
provide an overview of the current state-of-the-art in deepfake deepfake production and detection technologies utilizing deep
detection, including the most widely used algorithms and learning methodologies in this paper. They also provided a
approaches in the field. The goal of this paper is to provide a thorough examination of various technologies and their use in
comprehensive introduction to deepfake detection using AI the identification of deepfake [3].
and to highlight the challenges and opportunities in this The Deepfake phenomena has exploded in popularity in
rapidly evolving field of research. recent years as a result of the ability to make very realistic
We examined various deepfake strategies for the images using deep learning methods, mostly adhoc Generative
development and detection of deepfakes in our article. Adversarial Networks (GAN). They concentrate their research
on the study of Deepfakes of human faces with the goal of
developing a novel detection approach that can detect a
II. LITERATURE REVIEW forensics trail buried in photos, similar to a fingerprint left in
Thanh Thi Nguyen, Cuong M. Nguyen, Dung Tien the image generating process. They introduced a technique
Nguyen, Duc Thanh Nguyen and Saeid Nahavandi mentioned that extracts a set of local characteristics specially targeted to
that Deep learning has been used to handle a variety of represent the underlying neural generation process using an
complicated challenges, including large data analytics, Expectation Maximization (EM) algorithm. Experimental
computer vision, and human-level control. Deep learning experiments with naive classifiers on five alternative
technologies, on the other hand, have been used to develop architectures (GDWCT, STARGAN, ATTGAN,
software that poses a risk to privacy, democracy, and national STYLEGAN, STYLEGAN2) on the CELEBA dataset as
security. "deepfake'' is a recent example of a deep learning- ground-truth for non-fakes were used for ad-hoc validation
powered application. Deepfake algorithms can make fake [6].
photos and videos that people can't tell apart from the real
thing. As a result, the development of tools that can detect and III. METHODOLOGIES
analyze the integrity of digital visual material is critical. Their Deepfake is a methodology for creating false photos and
study included a survey of deepfake-creation algorithms and, videos that employs the concepts of Generative Adversarial
more crucially, deepfake detection methods proposed in the Networks (GANs). We'll start with an overview of the current
literature to date. They hold in-depth conversations on the applications and technologies for creating deepfake images
difficulties, research trends, and future prospects of deepfake and videos in this part. Then, to address this issue, we describe
technologies [1]. different deep learning detection strategies.
Koopman, Marissa, Andrea Macarulla Rodriguez, and Zeno
Geradts in their paper stated that deep fake poses a threat to A. DeepFake Generation Methodologies:
global security and integrity of multimedia, the Deepfake Deep fakes can be generated and detected using a variety of
algorithm allows a user to photorealistically swap the face of models. GAN (Generative Adversarial Networks) is a model
one actor in a video with the face of another. This raises that generates Deep Fakes . GANs, or Generative Adversarial
forensic issues in terms of video evidence dependability. Networks, is a type of generative modeling that employs deep
Photo response non uniformity (PRNU) analysis is examined learning techniques such as convolutional neural networks.
for its effectiveness at identifying Deepfake video tampering
as part of a solution. The PRNU study reveals a substantial Generative modeling belongs to the unsupervised learning
difference between authentic and Deepfake videos in mean category in machine learning this model can then be used to
normalized cross correlation scores [4]. discover and learn regularities or patterns in input data so that
Lyu, Siwei stated that the status of films and audios as it can be applied to the input data of the system and the model
definitive evidence of events has begun to be challenged by may be used to produce or output new examples that could
high-quality fake videos and audios generated by AI have been drawn from the original dataset.
algorithms (deep fakes). They explored research opportunities As generative models, GANs are exciting and rapidly
in this area and highlighted a number of these problems in advancing, promising to provide realistic examples across a
their publication [5]. wide range of problem domains, most notably in image-to-
Guarnera, Luca, Oliver Giudice, and Sebastiano Battiato in image translation tasks, such as converting images of winter
their paper mentioned deep learning is a powerful and or summer to day and night, and in generating photorealistic
versatile technology that has been widely used in domains photos of objects, scenes, and people that even humans cannot
such as computer vision, machine vision, and natural language discern as fake.
supervised vs. unsupervised learning and discriminative vs. known as hidden variables, are variables that are relevant to a
generative modeling are discussed in the context of GANs. domain but are not easily visible.
GANs are a system for automatically training a generative A latent space is a compressed or high-level idea of
model by treating an unsupervised problem as supervised and observable raw data, such as the distribution of input data. In
employing both a generative and a discriminative model. the case of GANs, the generator model assigns meaning to
GANs offer a route to advanced domain-specific data points in a given latent space, allowing new points to be
augmentation as well as a solution to problems that demand drawn from the latent space as input and utilized to produce
generative solutions, such as image-to-image translation. new and varied output examples.
The GAN model architecture is made up of two sub-models
i.e a generator model for creating new instances and a
discriminator model for determining whether the generated
examples are fake, generated by the generator model, or real
generated from the domain. Generator is the model used to
produce fresh credible instances from the area of the problem
and Discriminator Model is used for determining if instances
are genuine (from the domain) or not (generated).
F
ig. 4. Working of CNN model
TABLE I TABLE II
ANALYSIS OF MAJOR DEEPFAKE ALGORITHMS ANALYSIS OF VARIANTS OF DEEPFAKE DETECTION ALGORITHMS
Variants DCGAN LeNet, LSTM Many more trials and tests will be carried out in the future
AlexNet, and as advancements occur in this technology we may be able
VggNet
to use more efficient models to detect deepfake photos and
videos in order to reduce crime in our community and, more
Use Cases Image Image Text broadly, the world and strengthen global security.
generation, recognition translation
Video and , natural
generation classificati language
REFERENCES
on, face processing [1] Nguyen, Thanh Thi, Cuong M. Nguyen, Dung Tien
detection, , Nguyen, Duc Thanh Nguyen, and Saeid Nahavandi.
medical conversati "Deep learning for deepfakes creation and detection: A
analysis, onal survey." arXiv preprint arXiv:1909.11573 (2019).
drug intelligenc [2] Koopman, Marissa, Andrea Macarulla Rodriguez, and
discovery e, Zeno Geradts. "Detection of deepfake video
sentiment
analysis.
manipulation." In The 20th Irish machine vision and
image processing conference (IMVIP), pp. 133-136.
2018.
[3] Almars, A. (2021) Deepfakes Detection Techniques
Using Deep Learning: A Survey. Journal of Computer
and Communications, 9, 20-35. doi:
10.4236/jcc.2021.95003..
[4] Lyu, Siwei. "Deepfake detection: Current challenges and
next steps." In 2020 IEEE International Conference on
Multimedia & Expo Workshops (ICMEW), pp. 1-6.
IEEE, 2020.
[5] Guarnera, Luca, Oliver Giudice, and Sebastiano Battiato.
"Deepfake detection by analyzing convolutional traces."
In Proceedings of the IEEE/CVF Conference on [10] Cao, Q., Shen, L., Xie, W., Parkhi, O.M. and Zisserman,
Computer Vision and Pattern Recognition Workshops, A. (2018) Vggface2: A Dataset for Recognising Faces
pp. 666-667. 2020. across Pose and Age. 2018 13th IEEE International
[6] Karras, T., Laine, S. and Aila, T. (2019) A Style-Based Conference on Automatic Face & Gesture Recognition
Generator Architecture for Generative Adversarial (FG 2018), Xi’an, 15-19 May 2018, 67-74.
Networks. Proceedings of the IEEE/CVF Conference on https://doi.org/10.1109/FG.2018.00020
Computer Vision and Pattern Recognition, Long Beach, [11] Korshunov, P. and Marcel, S. (2018) Deepfakes: A New
15-20 June 2019, 4401-4410. Threat to Face Recognition? Assessment and Detection.
https://doi.org/10.1109/CVPR.2019.00453 [12] Li, Y., Chang, M.-C. and Lyu, S. (2018) In Ictu Oculi:
[7] 100,000 Faces Generated by AI, 2018. Exposing AI Generated Fake Face Videos by Detecting
https://generated.photos Eye Blinking. 2018 IEEE International Workshop on
[8] Dang, H., Liu, F., Stehouwer, J., Liu, X. and Jain, A.K. Information Forensics and Security (WIFS), Hong Kong,
(2020) On the Detection of Digital Face Manipulation. 11-13 December 2018, 1-7.
Proceedings of the IEEE/CVF Conference on Computer https://doi.org/10.1109/WIFS.2018.8630787
Vision and Pattern Recognition, Seattle, 13-19 June [13] Aarti Karandikar, Vedita Deshpande, Sanjana Singh,
2020, 5781-5790. Sayali Nagbhidkar, Saurabh Agrawal: Deepfake Video
https://doi.org/10.1109/CVPR42600.2020.00582 Detection Using Convolutional Neural Network April
[9] Yi, D., Lei, Z., Liao, S. and Li, S.Z. (2014) Learning 2020 International Journal of Advanced Trends in
Face Representation from Scratch. Computer Science and Engineering 9(2):1311-1315