0% found this document useful (0 votes)
6 views

Deepfake Image and Video Detection Using Deep Learning Algorithms

The document discusses the use of deep learning algorithms for detecting deepfake images and videos, highlighting the challenges posed by the increasing realism of deepfakes. Various detection methods, including GANs and autoencoders, are explored, with some achieving accuracy rates of up to 97.2%. The paper emphasizes the importance of developing effective detection techniques to mitigate the risks associated with deepfake technology in various sectors.

Uploaded by

Atiya Aymen
Copyright
© © All Rights Reserved
Available Formats
Download as PDF, TXT or read online on Scribd
0% found this document useful (0 votes)
6 views

Deepfake Image and Video Detection Using Deep Learning Algorithms

The document discusses the use of deep learning algorithms for detecting deepfake images and videos, highlighting the challenges posed by the increasing realism of deepfakes. Various detection methods, including GANs and autoencoders, are explored, with some achieving accuracy rates of up to 97.2%. The paper emphasizes the importance of developing effective detection techniques to mitigate the risks associated with deepfake technology in various sectors.

Uploaded by

Atiya Aymen
Copyright
© © All Rights Reserved
Available Formats
Download as PDF, TXT or read online on Scribd
You are on page 1/ 5

Proceedings of the International Conference on Multi-Agent Systems for Collaborative Intelligence (ICMSCI-2025)

IEEE Xplore Part Number: CFP25VH0-ART; ISBN: 979-8-3315-0982-8

Deepfake Image and Video Detection using Deep


Learning Algorithms

Srivanth Srinivasan Nischitha P Akshita Chavan


Artificial Intelligence & Machine Artificial Intelligence & Artificial Intelligence &
Learning Engineering, Machine Learning Engineering Machine Learning Engineering
2025 International Conference on Multi-Agent Systems for Collaborative Intelligence (ICMSCI) | 979-8-3315-0982-8/25/$31.00 ©2025 IEEE | DOI: 10.1109/ICMSCI62561.2025.10893930

RV College of Engineering® , RV College of Engineering® RV College of Engineering®


Bengaluru, India Bengaluru, India Bengaluru, India

Mohana
Computer Science & Engineering
(Cyber Security)
RV College of Engineering®
Bengaluru, India
[email protected]

Abstract— Deep learning (DL) algorithms are swiftly finding deepfakes raises fearfulness on spreading false information.
applications in computer vision and natural language Various approaches, including feature-based, temporal-
processing. Nonetheless, they can also be employed for creating based, and deep feature-based detection methods, have been
convincing deepfakes, which are challenging to distinguish from explored to analyze and classify images and video recordings.
reality. The advancements in image and video technology and
tools, especially on social media platforms, potentially lead to
Detecting deepfakes is essential to mitigate potential harm
misuse for malicious purposes like blackmail or defamation. To caused by their misuse and protect individuals from malicious
tackle this issue, several group of researchers tried upon activities.
spreading or creating awareness on real or fake data. The
proposed approach involves combining Deepfake generation II. LITERATURE SURVEY
using GANs and Autoencoders with a Deepfake detection Hafsa Ilyas et al [1] Proposed DL model called
method. The aim of this initiative is exclusively to combat InceptionResNet-BiLSTM to detect Deepfake in video
disinformation and online fraud for the welfare of the general sequence. The model combines InceptionResNetV2 for
population. Deepfakes, products of AI, have become
feature extraction and a bidirectional LSTM for classification.
increasingly realistic, rendering it nearly difficult to distinguish
the content. Auto-encoders with sufficient time can achieve It achieves high accuracy in detecting deepfakes on diverse
about 92% accuracy. As the generator improves, the datasets and outperforms existing methods. The model is Face
discriminator performance worsens as it struggles to Forensics++ and FakeAVCeleb datasets, showing promising
differentiate real or fake data. A perfect generator results in results in both cross-set and close-set evaluations. Lalitha S et
50% accuracy. With advancements in computational capacity al [2] explains about a model that combines CNN and GAN
and data availability, the proposed DDM (Deepfake Detection to recognize Deepfake videos. The model uses CNN to
Model) has achieved greater accuracy rate of up to 92.3%. extract video properties and a GAN to pinpoint deepfakes. A
GAN comprises a generator and discriminator, and the
Keywords—Deep-fake, Deep learning, GAN (Generative
aforementioned generator produces false images from video
Adversarial Nets), Autoencoders, CNN (Convolutional Neural
Network), DNN (Deep Neural Networks), Computer Vision(CV). frames. The paper focuses on training the GAN with different
setups and techniques and achieves 97.2% accuracy in
detecting Deepfake videos. Yushaa Shafqat Malik et al[3]
explores concepts of image animation using Deepfakes and
I. INTRODUCTION
spotting Deepfake generated animations. The authors suggest
Deepfake technology has been growing additional prevalent, a framework for animating objects onto driving videos
making it difficult to differentiate real and manipulated without prior evidence on object. They achieve realistic
videos. This paper strives to portray a complete analysis of results by training their dataset on images and video
DL models and techniques for detecting deepfakes using recordings of objects category. The paper also discusses
GANs. The proposed work examines and discusses the execution of a Deepfake detector technology using
potential for further advancements in DL knowledge to XceptionNet, which achieves high accuracy. However, the
enhance the detection of deepfakes, such as exploring authors find that Deepfake generation can be perturbed to fool
generator-discriminator models with multiple neural network the detector, reducing its accuracy significantly. Jixin Zhang
structures with increased complexity. Development of more et al [4] presents a Deepfake detection method that utilizes
effective Deepfake detection methods and contribute to the techniques of ensemble learning and heterogeneous features.
protection against misuse of Deepfake technology. As AI Extracted features and characteristics are integrated into an
technology continues to advance, potential commercial ensemble feature vector and used to carve a Deepfake
applications of deepfakes are expanding, but the rise of detector using a back-propagation neural network.

979-8-3315-0982-8/25/$31.00 ©2025 IEEE 1933


uthorized licensed use limited to: AMRUTA INSTITUTE OF ENGINEERING & MANAGEMENT SCIENCES. Downloaded on March 17,2025 at 06:08:14 UTC from IEEE Xplore. Restrictions appl
Proceedings of the International Conference on Multi-Agent Systems for Collaborative Intelligence (ICMSCI-2025)
IEEE Xplore Part Number: CFP25VH0-ART; ISBN: 979-8-3315-0982-8

Shan Jia et al [5] talks about the problem of model attribution models, including CNN, RNN, and hybrid models, for
for Deepfake videos and proposes a spatial and temporal detecting Deepfake videos. The results reiterate that CNN
attention-based method called DMA-STA. This method models with SVM show superior performance to hybrid
achieves over 70% accuracy in identifying Deepfakes in a models. This paper also portrays various approaches and
dataset with videos from different models. It outperforms architectures used in Deepfake detection and displays a
existing methods and future projects includes developing and satisfactory overview of the datasets used for evaluation. Ali
improving its robustness to video compression. Manoj Kumar Berjawi et al [15] presents an optimization approach for
Das et al [6] discusses the use of DL techniques in deepfakes, Deepfake rooted video detection by introducing a pre-
emphasizing the importance of Deepfake detection in the processing phase that involves dataset cleansing and image
context of social media platforms. Authors propose a enhancement using CLAHE. Experiments demonstrate that
methodology for detecting fake faces in photographs using a this optimization improves accuracy. The proposed
deep neural network. The paper also reviews existing optimization can be valuable in detecting and mitigating the
literature on Deepfake detection and discusses efforts of effect of Deepfake video recordings, which are a growing
major tech companies in this field. This method is more concern in the area of cybersecurity.
efficient in categorizing images are real or fake, and the paper
III. DESIGN AND IMPLEMENTATION
concludes by highlighting potential threats posed by
manipulated images and videos to privacy and world peace.
Pu Sun et al [7] presents a proactive defence method called
FakeTracer by adding sustainable and erasable traces to
training data available. This method is effective in exposing
Deepfake faces and is robust against various perturbations.
Also highlighted other techniques and approaches for
Deepfake detection, including geometric features, frequency-
aware clues, and artificial fingerprinting. This article
discusses the impact of Deepfake technology, which creates
fake videos that closely resemble real ones, on various
industries and the potential risks and challenges it poses.
Samer Shorman et al [8] It emphasizes use of Deepfake
detection methods and need to address the cognitive impact
and uncertainty caused by deepfakes. Surendra singh chouhan
et al [9] discusses use of DL models and datasets for
Deepfake detection in videos and images. It explores GANs
and provides a comparative examination of various methods.
The paper also discusses limitations of existing datasets and Fig.1. Block diagram of real or fake image classification using GANs
models and aims to develop Deepfake detection technology
to prevent misuse of deepfakes. Anis Trabelsi et al [10]
discusses the problem of Deepfake detection and analyses the
top five solutions from DFDC. It explores the
complementarity between solutions and experiments with
ensemble methods to improve detection accuracy. The
authors also highlight the importance of interpretability and
explainability in Deepfake detection. Additionally, this paper
provides a list of references to related research papers and
articles on Deepfake detection and manipulation. Sio Jurnalis
Pipin et al [11] proposes a method to spot and identify
Deepfake in videos. PRNU analysis helps to overcome
performance evaluation inconsistencies and improves the
detection process. Norah M Alnaim et al [12] presents a
Deepfake face mask dataset (DFFMD) and proposes
Deepfake detection algorithms to approach hardships thrown
by the staunch increasing realism of Deepfake video
recordings. Evaluated efficiency of different DL models in
detecting Deepfake videos and discusses various approaches
and techniques for Deepfake detection. It also provides a
comprehensive survey of existing literature on Deepfake
detection and suggests future research directions. Jerry John
et al [13] explores different methods for detecting Deepfake
GANS, autoencoder.kes. This article discusses the utilization
of neural network architecture and references various
techniques and datasets used in Deepfake detection research.
Athirashree Das et al [14] presents an important survey on
Deepfake video using DL. It compares precision of different Fig.2.Flow chart of GAN Model for real or fake image classification.

979-8-3315-0982-8/25/$31.00 ©2025 IEEE 1934


uthorized licensed use limited to: AMRUTA INSTITUTE OF ENGINEERING & MANAGEMENT SCIENCES. Downloaded on March 17,2025 at 06:08:14 UTC from IEEE Xplore. Restrictions appl
Proceedings of the International Conference on Multi-Agent Systems for Collaborative Intelligence (ICMSCI-2025)
IEEE Xplore Part Number: CFP25VH0-ART; ISBN: 979-8-3315-0982-8

Figure 1 and 2 shows the block diagram and flowchart of is trained, it can possibly be utilized to generate deepfake
GAN Model for real or fake image classification. By training images. For creation of deepfake, the autoencoder is fed with
GAN model on dataset, it learns to differentiate real and fake a sample input image of person whose face will be swapped.
faces based on attributes extracted from the images. This The encoder compresses input images into the latent space
network successfully is able to identify patterns and representation. Then, instead of using the original latent
discrepancies that differentiate real faces from deepfake representation, a modified latent representation is created by
faces. The advantage is its efficiency in classifying fake or replacing original face features with the desired face features.
real images. It leverages the power of DNN and availability Finally, the decoder takes this modified latent representation
of surplus amounts of data to develop an effective network and reconstructs the image, resulting in a deepfake image with
structure. Overall, this methodology combines the a swapped face. Detailed flowchart for the proposed
capabilities of DNN with a carefully curated dataset to implementation as shown in figure 4. This process enables the
precisely detect and classify fake faces in photographs. generation of realistic-looking deepfake images by leveraging
the power of autoencoders to encode and decode facial
features. Nonetheless, it is important to acknowledge that
numerous other methods and architectures exist for the
creation of deepfakes, and autoencoders are just one
approach.
Software and Hardware Details
Name of software: DeepFaceLive
Language Used: Anaconda Python
Requirements:
● Any DirectX12 compatible graphics card
● 4GB RAM
● 32GB+ paging file
● Windows 10
Fig. 3. Encoder-Decoder Architecture (Auto encoder) ● Modern CPU with AVX instructions

IV. RESULTS AND ANALYSIS


Dataset
The model’s training process incorporated our own custom
dataset. Celebrity face dataset is employed for the generation
of Deepfake images. Table 1 shows the image statistics of
dataset.

TABLE I.DATASET STATISTICS

Fig. 4. Detailed Flowchart of the implementation


Figure 3 shows the encoder and decoder architecure of auto
encoder. For creation of deepfake using an autoencoder,
encoder-decoder architecture is trained on real images. The Fig.5.DeepFaceLive Interface
autoencoder learns to encode images into the latent space and
decode them back to their original form. Once an autoencoder

979-8-3315-0982-8/25/$31.00 ©2025 IEEE 1935


uthorized licensed use limited to: AMRUTA INSTITUTE OF ENGINEERING & MANAGEMENT SCIENCES. Downloaded on March 17,2025 at 06:08:14 UTC from IEEE Xplore. Restrictions appl
Proceedings of the International Conference on Multi-Agent Systems for Collaborative Intelligence (ICMSCI-2025)
IEEE Xplore Part Number: CFP25VH0-ART; ISBN: 979-8-3315-0982-8

Figures 5 to 10 shows the results of Deepfake on different


dataset. DeepFaceLive is essentially a face-swapper which
uses pre-made models. It is a tool that allows users to swap
their faces with others in real-time during video calls or PC
streaming. It utilizes sophisticated algorithms to analyze and
interpret facial features with precision. By examining various
data points such as eye distance, nose shape, and lip
curvature, DeepFaceLive generates a unique digital
representation for everyone using a webcam. The heart of
DeepFaceLive lies in a powerful neural network architecture
written in Python. This CNN excels at learning patterns and
intricacies specific to human faces. DeepFaceLive also
Fig.6. Facial features analyzed using a webcam. employs GANs for high-quality deepfakes that are
increasingly difficult to distinguish from reality. Machine
learning also plays a pivotal role in DeepFaceLive's ability to
achieve impressive results. Techniques like supervised
learning, transfer learning, and reinforcement learning are
utilized to enhance accuracy and realism for the user.

V. APPLICATIONS
Deepfake technology has numerous applications in various
sectors, including entertainment, advertising, education, art,
forensics, privacy, and political commentary. It can create
realistic visual effects, create engaging content, and help
Fig.7.Deepfake Result 1-Joker data set. identify manipulated evidence in forensic investigations. It
can also uplift awareness regarding privacy and security risks
and be utilized for political satire or social commentary.
However, ethical and legal implications must be addressed to
ensure responsible and beneficial applications. Deepfake
detection can help prevent fraudulent activities, authenticate
video authenticity, and prevent the spread of misinformation.
It also finds its effect in law enforcement to identify cases
involving digital evidence manipulation. Ultimately,
Deepfake detection contributes to the protection of
individuals, organizations, and society [16].
Fig.8. Deepfake Result 2-Mr Bean data set.
VI. RESEARCH AND IMPLEMENTATION
CHALLENGES
The field of Deepfake detection faces several open issues,
including the development of robust and reliable detection
methods, creation of larger and diverse datasets for training
and evaluating models, and exploring the potential of
combining multiple DL techniques, leveraging ensemble
methods. As Deepfake technology advances, it becomes
increasingly challenging to detect in deployed videos,
making it essential for ongoing research and development to
maintain a lead. the evolving capabilities of Deepfake
Fig.9. Deepfake Result 3-Jackie Chan data set. creation. Ethical and legal implications of Deepfake concepts
are also a concern, as inclusion of Deepfake principles for
malicious purposes raises concerns about privacy, consent,
and potential harm. Clear guidelines and regulations are
required to address these challenges and ensure responsible
use of Deepfake technology. Future directives in Deepfake
detection include upcoming of better advanced algorithms,
collaborations between researchers, industry experts, and
policymakers, and creating awareness among public
regarding deepfakes [17] [18]. In conclusion, addressing
open issues and future directives in the domain of deepfakes
requires a multidisciplinary approach involving researchers,
industry professionals, policymakers, and the public. By
directing their attention to these domains, researchers have
Fig.10. Deepfake Result 4-Meghan Markle data set.
the potential to provide valuable insights into contributing to

979-8-3315-0982-8/25/$31.00 ©2025 IEEE 1936


uthorized licensed use limited to: AMRUTA INSTITUTE OF ENGINEERING & MANAGEMENT SCIENCES. Downloaded on March 17,2025 at 06:08:14 UTC from IEEE Xplore. Restrictions appl
Proceedings of the International Conference on Multi-Agent Systems for Collaborative Intelligence (ICMSCI-2025)
IEEE Xplore Part Number: CFP25VH0-ART; ISBN: 979-8-3315-0982-8

the development of more effective and reliable deep fake capabilities of Deepfake creation and safeguard against its
detection systems. detrimental consequences.

VII. ADVANTAGES AND DISADVANTAGES REFERENCES


Deepfakes represent a technology that is possibly used in [1] Hafsa Ilyas et al “Deepfakes Examiner: An End-to-End Deep Learning
various fields, including entertainment, visual effects, Model for Deepfakes Videos Detection,” 16th International
Conference on Open Source Systems and Technologies (ICOSST),
education, and research. They allow for creative expression, 2022, pp. 1-6.
accessibility, and furthermore, the generation of fresh content [2] Lalitha S et al “DeepFake Detection Through Key Video Frame
without the necessity for expensive equipment or Extraction using GAN” International Conference on Automation,
professional expertise. They are utilized in entertainment for Computing and Renewable Systems (ICACRS),2022, pp. 859-863.
[3] Yushaa Shafqat Malik et al “Image Animations on Driving Videos with
creating funny videos or memes, as well as within the domain DeepFakes and Detecting DeepFakes Generated Animations,” IEEE
of the film industry, particularly in the pursuit of crafting 23rd International Multitopic Conference (INMIC), 2020, pp. 1-6.
lifelike visual effects or replacing actors with digital [4] Jixin Zhang et al “A Heterogeneous Feature Ensemble Learning based
counterparts. However, deepfakes also have disadvantages. Deepfake Detection Method” IEEE International Conference on
Communications, 2022, pp. 2084-2089.
Privacy concerns arise as they can create non-consensual
[5] Shan Jia et al “Model Attribution of Face-Swap Deepfake Videos,”
explicit content or impersonate individuals without consent, IEEE International Conference on Image Processing (ICIP), 2022, pp.
leading to severe emotional, psychological, and reputational 2356-2360.
consequences for victims. Ethical and legal implications also [6] Manoj Kumar Das et al “Deepfake Creation Using Gans and
arise from the use of deepfakes to be used for nefarious Autoencoder and Deepfake detection” International Conference on
intentions such as defamation, fraud, or political Vision Towards Emerging Trends in Communication and Networking
Technologies (ViTECoN), 2023, pp. 1-6.
manipulation. Misinformation and fake news can be spread
[7] Pu Sun et al “Faketracer: Exposing Deepfakes with Training Data
through deepfakes, as they can create convincing fabricated Contamination” IEEE International Conference on Image Processing
videos and images in a way that deceive people and (ICIP), 2022, pp. 1161-1165.
manipulate public opinion. Privacy and consent concerns [8] Samer Shorman et al “Artificial Intelligence into Multimedia
arise as they have the potential to be utilized for creating non- Deepfakes Creation and Detection” International Conference on IT
Innovation and Knowledge Discovery (ITIKD), 2023, pp. 1-5.
consensual explicit content or impersonating individuals,
[9] Surendra singh chouhan et al “Deepfake Detection in Videos and
leading to potential harm and damage to reputations. To Picture: Analysis of Deep Learning Models and Dataset,” IEEE
ensure responsible and ethical use of Deepfake technology, International Conference on Data Science and Information System
robust detection methods, regulations, and ethical guidelines (ICDSIS), 2022, pp. 1-5.
must be developed. While deepfakes have potential benefits [10] Anis Trabelsi et al “Improving Deepfake Detection by Mixing Top
in certain contexts, their misuse and potential harm cannot be Solutions of the DFDC” 30th European Signal Processing Conference
(EUSIPCO), 2022, pp. 643-647.
ignored. Therefore, it is crucial to develop detection methods,
[11] Sio Jurnalis Pipin et al “Deepfake Video Detection Using
regulations, and ethical guidelines to ensure responsible and Spatiotemporal Convolutional Network and Photo Response Non
ethical use of Deepfake technology. Uniformity,” IEEE International Conference of Computer Science and
Information Technology (ICOSNIKOM), 2022, pp. 1-6.
VIII. CONCLUSION [12] Norah M Alnaim et al “DFFMD: A Deepfake Face Mask Dataset for
The rise of deepfakes, an iteration of artificial intelligence, Infectious Disease Era With Deepfake Detection Algorithms,” IEEE
Access, vol. 11, pp. 16711-16722.
has significant implications for multimedia content creation
[13] Jerry John et al “Comparative Analysis on Different DeepFake
and detection. These manipulated images and videos created Detection Methods and Semi Supervised GAN Architecture for
using DL methods pose a threat to trust and credibility in DeepFake Detection,” Sixth International Conference on I-SMAC (IoT
online resources, including cinema, entertainment, and in Social, Mobile, Analytics and Cloud) 2022, pp. 516-521.
fashion domain. It also has ramifications for politics, criminal [14] Athirashree Das et al “A Survey on Deepfake Video Detection
Techniques Using Deep Learning,” International Conference on Next
justice, and public discourse. Detecting and combating Generation Intelligent Systems (ICNGIS), 2022, pp. 1-4.
deepfakes is crucial to mitigate their risks and protect [15] Ali Berjawi et al “Optimization of DeepFake Video Detection Using
individuals from potential harm. Various detection methods, Image Preprocessing,” International Conference on Advances in
including feature-based, temporal-based, and deep feature- Computational Tools for Engineering Applications (ACTEA),2023, pp.
based, have been explored by implementing techniques like 59-63.
CNN and DNN. Detecting deepfakes is essential to mitigate [16] Niranjan D R et al “Jenkins Pipelines: A Novel Approach to Machine
Learning Operations (MLOps),” International Conference on Edge
potential harm and protect individuals from malicious Computing and Applications (ICECAA), 2022, pp. 1292-1297.
activities. Auto-encoders with sufficient time can achieve [17] D. M. Shariff et al “Artificial (or) Fake Human Face Generator using
about 92% accuracy. As the generator improves, the Generative Adversarial Network (GAN) Machine Learning Model,”
discriminator performance worsens as it struggles to Fourth International Conference on Electrical, Computer and
Communication Technologies (ICECCT), 2021, pp. 1-5.
differentiate real and fake data. A perfect generator results in
[18] P. Pradhyumna et al “A Survey of Modern Deep Learning based
50% accuracy. With advancements in computational capacity Generative Adversarial Networks (GANs),” International Conference
and data availability, DDM have accomplished superior on Computing Methodologies and Communication (ICCMC), 2022, pp.
correctness rates of up to 92.3%. Therefore, ongoing research 1146-1152.
and development in AI and Deepfake detection technologies
are highly essential to maintain a competitive edge, evolving

979-8-3315-0982-8/25/$31.00 ©2025 IEEE 1937


uthorized licensed use limited to: AMRUTA INSTITUTE OF ENGINEERING & MANAGEMENT SCIENCES. Downloaded on March 17,2025 at 06:08:14 UTC from IEEE Xplore. Restrictions appl

You might also like