Annual report jugendschutz.netAI on youth-oriented platforms: Providers create new gateways for risks

jugendschutz.net acts as the joint competence center of the federal government, the federal states and the state media authorities for the protection of children and young people on the Internet. The center researches dangers and risks in youth-related services. jugendschutz.net receives reports of violations of youth media protection via its online complaints office. jugendschutz.net works to ensure that violations of youth protection regulations are eliminated and that services are designed in such a way that children and young people can use them without worry. Violations on the Internet can be reported at: https://www.jugendschutz.net/verstoss-melden.

Key findings from the current Annual Report 2025

Research and analyses on artificial intelligence, influencing, social commerce, political extremism, sexualized violence and self-harm were at the heart of the 2025 work. Many existing risks are exacerbated by AI applications, which are freely available and very easy to use for criminal acts. Service providers are doing far too little to protect children and young people.

Stefan Glaser, Head of jugendschutz.net: "Unfortunately, the risk of being confronted with hate and sexualized violence, bullied, harassed or manipulated in popular services continues to exist. Providers are doing little to counter this. On the contrary: companies are creating further gateways with new functions and applications. AI in particular adds a new dimension to the problem: the artificial merges with the real and distorts the perception of reality. AI-generated influencers present supernaturally beautiful bodies that promote eating disorders. Manipulated images serve as a means of spreading extremist narratives or degradation. Chatbots develop a life of their own and lead children and young people into sexualized interactions. There is also the problem of manipulative service design: algorithms lead users deeper and deeper into dangerous areas by constantly suggesting the same content. One problem is the business models of the services. Operators need to do more than just pay lip service to ensuring that children and young people are protected when using these services. What is needed are effective measures that already have a risk-reducing effect when new functions and applications are introduced."

This text is based on the jugendschutz.net press release from May 19, 2026.