The Delhi Police Cyber Crime Unit has registered a First Information Report (FIR) against social media platform X, formerly Twitter, in connection with an artificial intelligence (AI)-generated video featuring Prime Minister Narendra Modi and Election Commission of India (ECI) chief Gyanesh Kumar. The FIR cites the video's "potential to mislead," raising concerns over the misuse of advanced AI technologies on digital platforms.

The registration of the FIR underscores the escalating challenges faced by regulatory bodies and law enforcement in combating digitally manipulated content, particularly deepfakes, that can spread misinformation. The complaint against X focuses on the platform's role in the dissemination of the video, which allegedly presents a distorted or fabricated scenario involving prominent public figures.

Key details surrounding the incident include:

  • Platform Involved: X (formerly Twitter).
  • Content Type: An AI-generated video.
  • Individuals Featured: Prime Minister Narendra Modi and Election Commission of India chief Gyanesh Kumar.
  • Primary Concern: The content's "potential to mislead" viewers, as stated in the FIR.
  • Investigating Agency: Delhi Police Cyber Crime Unit.
  • Legal Action: FIR registered under relevant sections of the Information Technology Act and the Indian Penal Code, typically addressing issues related to misinformation, public mischief, and platform accountability.

The incident highlights a growing global concern regarding the ethical implications and potential misuse of generative AI tools, especially in political discourse and during electoral processes. Deepfake technology, which uses AI to create highly realistic but fabricated images, audio, and video, has become a significant challenge for content moderation teams and government agencies worldwide. The ease with which such content can be produced and distributed necessitates robust platform policies and stringent enforcement mechanisms.

This action by the Delhi Police comes amid broader discussions in India concerning the need for stronger regulations to manage deepfakes and other forms of synthetic media. The government has previously indicated its intent to introduce stricter guidelines for social media platforms to ensure accountability for harmful or misleading content. This FIR serves as a tangible step in addressing content deemed to violate existing legal frameworks.

The investigation into the matter is ongoing. The Delhi Police Cyber Crime Unit is expected to examine the origins of the video, its distribution trajectory on the X platform, and the extent of its reach. This case may set a precedent for future actions against social media platforms concerning their liability in the dissemination of AI-generated misleading content and could influence how these platforms moderate such material going forward.