AI technology is being misused to create fake nude images of real people, causing a growing problem online.Â
To combat this, Microsoft has teamed up with StopNCII, an organization that helps victims by creating digital fingerprints of explicit images.
These fingerprints are used to remove such content from platforms like Bing.
Bing has started using StopNCII’s technology to block explicit images, joining other major platforms such as Facebook, Instagram, TikTok, and Reddit in this effort.
Previously, Microsoft offered a tool for reporting such content, but it was not enough to stop the spread.
In contrast, Google has tools for reporting and removing explicit content but has not partnered with StopNCII. This has led to criticism, especially as the number of reports rises in countries like South Korea.
The problem of deepfake porn affects adults and high school students alike. In the U.S., there is no federal law specifically addressing this issue, leading to a mix of state and local regulations.
 Recently, San Francisco prosecutors filed a lawsuit against 16 sites involved in creating these fake images, and 23 states have passed laws against nonconsensual deepfakes.
