Community Smart Hub | 5-minute read
As the UK strengthens its response to harmful AI-generated images, a new update from Ofcom highlights why digital safety is about more than recognising whether a picture is real or fake.
Imagine discovering that someone has used artificial intelligence to create a convincing but completely false intimate image of you, a family member or someone in your community.
The image might look genuine. People might share it on WhatsApp, Facebook or other social platforms before questioning where it came from.
Even if the image is entirely fabricated, the consequences can be real: embarrassment, harassment, reputational damage, emotional distress and, in some cases, blackmail.
This is one of the challenges facing online communities as AI-generated images become increasingly realistic.
On 14 October 2026, the UK communications regulator, Ofcom, published an important update about its investigation into X and the Grok AI chatbot. The announcement provides a useful opportunity to understand what platforms are expected to do, what protections are changing and how individuals can respond safely.
What has happened?
Earlier this year, Ofcom opened an investigation following reports that Grok, an AI chatbot associated with X, had been used to create and distribute sexualised deepfake images of real people, including children.
A deepfake is an image, video or audio recording that has been artificially generated or manipulated to make something appear real when it is not.
In its latest update, Ofcom confirmed that it had gathered substantial evidence about how X assessed the risks of illegal content, handled reports from users and made decisions about removing potentially harmful material.
The regulator is now concentrating its investigation on whether X complied with its duties to protect UK users from illegal content.
Importantly, Ofcom has not yet concluded that X breached the law. Its investigation remains open.
Ofcom also reported that X had made changes to prevent accounts without the required age assurance from accessing content labelled as pornography. This addressed a separate weakness identified during the investigation.
Meanwhile, the company operating the standalone Grok service has introduced restrictions affecting the generation, viewing and sharing of pornographic content by people using UK IP addresses. Ofcom says it will continue monitoring these measures.
These developments represent changes to platform safeguards, but they do not mean that the wider problem of harmful deepfakes has been solved. Read Ofcom’s investigation record.
Why should communities care?
AI-generated intimate image abuse is not simply a technology problem.
It is a problem involving consent, trust, personal dignity and the speed at which information spreads online.
An image does not need to be genuine to cause harm.
When someone shares a manipulated photograph believing it is authentic, they may unintentionally contribute to harassment or abuse.
The scale of intimate image abuse is already concerning. According to SWGfL, which operates the UK’s Revenge Porn Helpline, the service received nearly 25,000 reports during 2025, an increase of 11% compared with the previous year.
These reports cover different forms of intimate image abuse, not exclusively AI-generated deepfakes. Nevertheless, they demonstrate the growing need for accessible support and effective reporting systems.
The challenge is particularly important for families, schools, community organisations and volunteers who help others navigate the internet.
People need more than warnings about AI.
They need practical skills to recognise suspicious content, question its authenticity and respond without causing additional harm.
Five practical steps everyone can take
1. Do not automatically believe or share sensational images.
A realistic photograph is not proof that an event occurred.
Before forwarding an image, consider where it originated, who is sharing it and whether the content could harm the person depicted.
If the image appears intimate or abusive, avoid circulating it altogether.
2. Remember that detecting a deepfake is not always straightforward.
AI-generated images can be highly convincing. Visual clues such as unusual facial features, distorted backgrounds or inconsistent lighting are not reliable proof that an image was created by AI.
Equally, an image that appears authentic may have been presented with a false caption or misleading context.
The safest response to potentially abusive intimate imagery is not to conduct your own forensic investigation. It is to avoid amplifying the content and use appropriate reporting channels.
3. Report suspected intimate image abuse.
Most major social media platforms provide mechanisms for reporting intimate images shared without consent.
Adults in the UK can seek specialist support from the Revenge Porn Helpline.
Children and young people can use Childline’s Report Remove service, which also accepts reports involving AI-generated images.
Suspected child sexual abuse imagery, including AI-generated material, can be reported to the Internet Watch Foundation. Do not download, save or redistribute such material.
4. Preserve useful information safely.
If you encounter suspected abuse, record non-graphic details such as the account name, platform, date and relevant website address where safe.
Do not unnecessarily retain or distribute intimate material. The police can advise what evidence is appropriate, particularly where children may be involved.
Anyone affected by intimate image abuse can report it to the police without first proving which specific offence may have occurred.
5. Support the person affected rather than blaming them.
Victims may experience fear, humiliation or anxiety about approaching authorities.
Listen without judgement, avoid repeating rumours and help them find appropriate support.
Responsibility belongs to those creating or distributing abusive material, not to the person whose image has been misused.
What does this mean for responsible AI?
Artificial intelligence offers significant benefits for education, healthcare, communication and productivity.
However, these benefits must be accompanied by responsible design, appropriate safeguards and informed users.
The latest Ofcom announcement demonstrates why technical measures and regulatory oversight matter.
But technology companies and regulators cannot address every challenge alone.
Digital literacy also plays a critical role.
Communities need to understand that:
- A convincing image is not necessarily authentic.
- A genuine image can still be shared with misleading information.
- Identifying whether AI was involved does not determine whether someone consented to the content.
- Reporting suspected abuse promptly can help limit further harm.
These are essential skills for anyone using social media, messaging platforms or AI-powered tools.
Putting these lessons into practice: the Community Smart Hub AI Trust Lab
At Community Smart Hub, we believe people learn digital safety most effectively when they can practise making decisions in realistic situations.
Our AI Trust Lab introduces practical exercises that help participants investigate suspicious messages, synthetic media and potentially misleading online information.
Consider this fictional scenario:
A photograph is shared in a local WhatsApp group. The sender claims it shows a well-known community member in an embarrassing situation and encourages everyone to forward it.
What should you do?
The safest first response is not to share the image.
Consider whether the material could be manipulated or misleading, but remember that its authenticity does not determine whether forwarding it would be harmful.
If the content appears intimate or abusive, use the appropriate reporting process rather than investigating or redistributing it.
This is the type of practical judgement we want people to develop through our workshops.
Our training focuses on recognising risk signals, verifying information through independent sources, understanding the limitations of available evidence and knowing when to report concerns.
These skills matter whether someone is protecting their family, supporting residents or working in a professional digital environment.
Building safer digital communities together
Ofcom’s latest update is a reminder that the responsibility for online safety does not rest with individuals alone.
Technology companies must design and operate safer services. Regulators must examine whether legal responsibilities are being met. Communities also need accessible education that helps people respond appropriately when something goes wrong.
AI-generated content will continue to evolve.
Our ability to respond should evolve with it.
At Community Smart Hub, our aim is to help people move beyond simply asking whether something is real or fake.
We want communities to ask better questions, make informed decisions and act responsibly when faced with suspicious or harmful content.
Because digital trust is not just about knowing what technology can create. It is about knowing what we should do with what we see.
Community Smart Hub — Building safer, more informed and digitally confident communities.
Further reading: Ofcom’s official update, 14 October 2026 | Police guidance on intimate image abuse and deepfakes
