[ad_1]
New Delhi. The faster the pace of Artificial Intelligence, the more serious the risk of its misuse is becoming. In late December 2025 and early January 2026, the controversy related to Grok, the chatbot of Elon Musk’s company xAI, raised the question of whether technology is crossing the limits of human dignity and consent. In the cases reported on the social media platform These photos were posted in public threads, resulting in a direct attack on the dignity, privacy and consent of the victimized women.
In the last week of last year, a trend started spreading rapidly on X. While replying to the pictures of women, users started giving prompts like removing clothes from the grok or showing them in bikini. Within no time, thousands of objectionable AI images spread on the platform. In some cases, the age of minor girls was estimated to be between 12 to 16 years, which made the matter more serious. On December 28, 2025, Grok faced heavy criticism after it generated sexualized images of two young girls, after which Grok had to publicly apologize.
xAI and Elon Musk’s stance
xAI acknowledged that Grok’s minimal censorship policy backfired in this case. The company said that now strict safeguards have been installed in image generation. Non-consensual, sexual, nude or any kind of harmful content will now be blocked directly. Elon Musk also publicly admitted that leaving AI completely open in the name of unfiltered truth was not the right balance. Now the company is focusing more on harm reduction and user safety.
What is the law and punishment against deepfakes in the world
Regarding deepfake, most of the countries have now started considering it not just as misuse of technology but as a serious crime. Especially when the matter is related to intimate photographs, videos or identification of women or any person without consent. After cases like Grok, laws, punishments and responsibilities of platforms are being clearly decided in different countries.
What are the laws and punishments in America?
In America, non-consensual intimate images and deepfakes have been considered a federal crime under the TAKE IT DOWN Act. According to this law, it is illegal to create and spread sexual or intimate deepfake images or videos of a person without his consent. If found guilty, there can be a heavy fine and jail sentence.
Apart from this, it has been made mandatory for social media platforms and websites to remove such content within 48 hours of receiving the complaint. If the platform does not do this then fine and legal action can also be taken against it. In many American states, there is a provision for separate criminal punishment for spreading deepfakes related to elections, in which the jail term can be increased.
Laws and penalties in the European Union
The European Union has prepared the strictest framework regarding deepfakes through the EU AI Act. Under this law, it is mandatory to clearly label deepfake content created by AI. If deepfakes are created without a person’s consent or are used in a sexual, misleading or harmful way, it is a direct violation of the law.
As punishment, companies can be fined up to 6 percent of their global turnover. There is a provision of heavy fine and in some cases even jail sentence on those who create and spread deepfakes at the individual level. It has been fixed for the platforms to immediately remove such content and install prevention tools.
How strict is it in China?
China has long implemented strict laws against deepfakes. It is important to clearly mark AI generated content there. If deepfakes are spread without labels, action is taken against both the creator and the platform.
If deepfakes tarnish someone’s image or cause social harm, the culprit can be punished with heavy fines, social media ban and in serious cases even jail sentence.
Punishment in Britain and Australia
In Britain, non-consensual deepfakes have been classified as a sexual crime. Creating or sharing an intimate deepfake image of someone without consent is a crime, punishable by both jail and fine.
Australia also has similar laws, where deepfakes that insult the dignity of women or any person face criminal charges. The culprit may have to face jail for several years and financial penalty.
French and Danish law
In France, damaging a person’s identity or image through deepfakes is considered a criminal act. Here there is a provision of heavy fine along with jail as punishment. In Denmark too, non-consensual deepfakes are seen directly under privacy and sexual crime laws.
What is the law in India now and what is the punishment?
At present, there is no separate law for deepfakes in India, but action is taken under the IT Act, laws related to dignity of women and data protection rules. Under the sections of the IT Act, there is a provision of jail and fine for creating and spreading objectionable and non-consensual content.
[ad_2]
