The Federal Bureau of Investigation (FBI) has issued a warning to the public regarding the increasing prevalence of synthetic content, commonly known as “deepfakes.”
Malicious actors are exploiting advancements in artificial intelligence (AI) technology to manipulate innocent photos and videos, targeting victims and using the manipulated content for explicit purposes.
This concerning trend has led to cases of sextortion and harassment, particularly affecting minors and non-consenting adults. The FBI emphasizes the need for caution and provides recommendations to protect oneself from falling victim to these malicious schemes.
Explicit Content Creation
Malicious actors employ various content manipulation technologies and services to exploit existing photos and videos obtained from social media accounts, the open internet, or victims themselves. By altering and customizing these materials, they create sexually-themed images that closely resemble the victim.
Subsequently, the manipulated content is circulated on social media platforms, public forums, or pornographic websites. Shockingly, many victims, including minors, remain unaware of the existence of these altered images until they are brought to their attention by someone else. In some cases, victims receive manipulated content directly from malicious actors, either for sextortion or harassment purposes. Once these images are shared online, victims face significant challenges in preventing further circulation or removing them from the internet.
Sextortion and Harassment
Sextortion, a criminal act that violates federal statutes, involves coercing victims into providing explicit photos or videos of themselves. Malicious actors then use these materials to blackmail victims, threatening to publicly share them or disclose them to the victim’s family and friends. The motivations behind such schemes can include a desire for more illicit content, financial gain, or simply bullying and harassing others. To achieve their goals, malicious actors leverage manipulated photos or videos to extort victims for ransom or compliance with their demands, such as requesting nude photos.
Increase in Reports and Victim Experiences
Since April 2023, the FBI has observed a notable rise in sextortion cases involving the use of synthetic images or videos created from content originally posted on victims’ social media accounts or web postings. Additionally, these malicious actors often acquire materials through direct requests or by capturing screenshots during video chats.
Based on recent victim reports, the offenders typically demand payment (e.g., money, gift cards) while threatening to share manipulated images or videos with the victims’ family members or social media friends. Alternatively, they may demand that victims provide additional real sexually-themed content.
Protective Recommendations
To combat this alarming trend and safeguard individuals from falling victim to malicious actors, the FBI provides several recommendations:
- Monitor children’s online activity and have open discussions about the risks associated with sharing personal content.
- Exercise discretion when posting images, videos, or personal information online, especially those involving children.
- Understand that once content is shared online, it can be manipulated and distributed without consent, making it challenging to remove entirely.
- Conduct regular online searches of personal information to identify any exposure or spread of data on the internet.
- Apply privacy settings on social media accounts, including setting profiles and friends lists as private to limit public exposure.
- Utilize reverse image search engines to identify any photos or videos that may have circulated on the internet without knowledge or consent.
- Exercise caution when interacting with unknown individuals online, particularly when asked for personal images.
- Refrain from providing money or valuable items to unfamiliar individuals as compliance does not guarantee the safety of sensitive photos or content.
- Remain cautious when engaging with known individuals online who display unusual behavior, as hacked social media accounts can be manipulated by malicious actors.
- Secure social media and online accounts using complex passwords or passphrases and enable multi-factor authentication.
- Research the privacy, data sharing, and data retention policies of social media platforms, apps, and websites before uploading and sharing personal content.
The FBI emphasizes the importance of exercising caution when sharing personal content online and interacting with individuals on the internet. By implementing the recommended protective measures, individuals can reduce the risk of falling victim to these malicious schemes and protect their privacy and personal security in the digital age.
