As there is a rapid expansion of generative AI tools, which are easily available for use, it has led to growing cyber scams by bad actors misusing AI and committing cyber crimes such as Deepfake, voice cloning, cyberattacks targeting Individuals, critical infrastructure, and other organizations, and threats to data protection and privacy. Problems of synthetic media, especially AI-powered or synthetic Audio video content, have proliferated widely in recent times. These included issues with political manipulation, identity theft, disinformation, legal and ethical issues, security risks, difficulties with identification, and issues with media integrity. The misuse of deepfake technology by bad actors has raised serious concerns. Misuse of deepfake technology can lead to deception, blackmail, intimidation, sabotage, objectification, gaslighting, corporate fraud, and electoral integrity. They can also cause financial losses and undermine trust in organizations. They also pose risks to electoral integrity, posing potential harm to voters, candidates, and campaigns.
As technology advances, the ability to manipulate audio and visual content becomes increasingly sophisticated, leading to a blurred distinction between reality and fiction. Deepfake technology utilizes complex algorithms to generate convincingly realistic fake videos or audio recordings, posing a substantial threat when exploited for fraud. The scale of this threat is evident from the alarming statistics: in 2022, more than 65,000 deepfake frauds were registered, and the numbers continued to rise in 2023.
To effectively combat the growing threat posed by AI-powered deepfake technology, Individuals and institutions should place a high priority on developing critical thinking abilities, carefully examining visual and auditory cues for discrepancies, making use of tools like reverse image searches, keeping up with the latest developments in deepfake trends, and verify the information from reliable sources.
Understanding deepfake fraud
Deepfake technology utilises sophisticated algorithms to seamlessly superimpose one person’s likeness onto another’s, resulting in convincingly deceptive fake videos or audio recordings. While this technology offers creative potential, its misuse for fraudulent purposes raises significant ethical questions. In India, there have been notable instances where deepfakes have been used to impersonate public figures, fabricate evidence, or spread misinformation, thereby undermining trust in digital media and distorting public discourse.
Financial losses and implications
Beyond the erosion of trust, deepfake fraud in India has resulted in significant financial losses for businesses and individuals alike, echoing global concerns. According to Hong Kong authorities, a finance employee at a multinational corporation was duped into paying $25 million to fraudsters who used deepfake technology to impersonate the company’s top financial officer during a video conference call. Such incidents highlight the sophistication and detrimental impact of deepfake fraud on financial institutions worldwide.
According to a Reserve Bank of India (RBI) study, financial institutions in India reported a 25% increase in fraudulent activity employing deepfake technology in the previous year (RBI, 2023). These fraudulent activities range from impersonation scams targeting individuals’ bank accounts to sophisticated phishing attacks on corporate entities. The financial losses incurred due to deepfake fraud not only undermine economic stability but also erode confidence in digital transactions and online commerce.
Privacy and consent concerns
Privacy violations and issues of consent are prevalent in the realm of deepfake fraud in India, impacting individuals across various domains, including renowned personalities such as Sachin Tendulkar, the cricketing legend, and Rashmika Mandanna, a prominent actress. Instances have arisen where their images and voices have been manipulated without authorization, leading to the creation of deceptive deepfake content. These cases underscore the urgent need for robust legal protections and technological safeguards to address privacy violations and combat the proliferation of deepfake content in India.
Mitigating the impact
Addressing the ethical challenges of deepfake fraud in India requires a multifaceted approach. Education and awareness initiatives are crucial in empowering individuals to recognize and critically evaluate digital content. According to a Ministry of Information and Broadcasting report, the Indian government has launched a nationwide media literacy campaign to educate citizens about the risks of deepfake technology and how to identify manipulated content (Ministry of Information and Broadcasting, 2023). Moreover, technological advancements offer promise in combating deepfake fraud.
Recent government advisory on combatting deepfake fraud
In a recent development, the Indian government released an advisory on regulating AI, focusing on combating deepfakes and misinformation. The advisory emphasizes the need to identify synthetic content across formats and encourages platforms to utilize labels, unique identifiers, or metadata for transparency. These measures aim to enhance cyber resilience for both industries and individuals. However, effectively addressing deepfake challenges requires the implementation of more robust technologies and legal frameworks. Such additional measures are crucial for mitigating the risks of fraudulent activities and maintaining the integrity of digital content in today’s interconnected world.
Founder and Global President
Cyberpeace foundation
Conclusively, the deepfake technology presents profound ethical challenges, particularly concerning fraud. From undermining trust in digital media to threatening democracy and privacy rights, the implications of deepfake fraud are far-reaching and multifaceted. By embracing education, technological innovation, and legal reform, we can navigate the ethical complexities of the digital age and cultivate a more transparent, trustworthy, and ethical digital landscape.
Robust Security Measures are required on platforms that can help mitigate the risk posed by misuse of deepfake technology. Platforms need to keep in place a wide range of cybersecurity strategies or use advanced tools to combat the evolving misuse of AI, such as deepfake, disinformation, and misrepresentation caused by deepfake technology. Cybersecurity tools can be utilized to detect deepfakes. Additionally, legal and ethical standards need to be established to handle the challenges posed by the misuse of advanced technology.
