Visible to the public Media Forensics and DeepFakes: An Overview

TitleMedia Forensics and DeepFakes: An Overview
Publication TypeJournal Article
Year of Publication2020
AuthorsVerdoliva, L.
JournalIEEE Journal of Selected Topics in Signal Processing
Keywordsdata-driven forensic methods, Deep Learning, deep learning tools, Deepfakes, digital forensics, digital image forensics, elections, fake media, false multimedia content, forensic tools, Forensics, fraud, generative adversarial networks, Human Behavior, information forensics, Information integrity, learning (artificial intelligence), Media, Media Forensics, Metrics, multimedia computing, neural nets, pubcrawl, public opinion, real media, realistic fake images, resilience, Resiliency, Scalability, security threats, software packages, synthetic media, Video Forensics, Videos, visual media integrity verification
AbstractWith the rapid progress in recent years, techniques that generate and manipulate multimedia content can now provide a very advanced level of realism. The boundary between real and synthetic media has become very thin. On the one hand, this opens the door to a series of exciting applications in different fields such as creative arts, advertising, film production, and video games. On the other hand, it poses enormous security threats. Software packages freely available on the web allow any individual, without special skills, to create very realistic fake images and videos. These can be used to manipulate public opinion during elections, commit fraud, discredit or blackmail people. Therefore, there is an urgent need for automated tools capable of detecting false multimedia content and avoiding the spread of dangerous false information. This review paper aims to present an analysis of the methods for visual media integrity verification, that is, the detection of manipulated images and videos. Special emphasis will be placed on the emerging phenomenon of deepfakes, fake media created through deep learning tools, and on modern data-driven forensic methods to fight them. The analysis will help highlight the limits of current forensic tools, the most relevant issues, the upcoming challenges, and suggest future directions for research.
Citation Keyverdoliva_media_2020