Your guide to selecting the best Trust and Safety tools Download the Buyer's Guide to Trust and Safety 2.0
Manage and orchestrate the entire Trust & Safety operation in one place - no coding required.
Take fast action on abuse. Our AI models contextually detect 14+ abuse areas - with unparalleled accuracy.
Watch our on-demand demo and see how ActiveOS and ActiveScore power Trust & Safety at scale.
The threat landscape is dynamic. Harness an intelligence-based approach to tackle the evolving risks to users on the web.
Don't wait for users to see abuse. Proactively detect it.
Prevent high-risk actors from striking again.
For a deep understanding of abuse
To catch the risks as they emerge
Disrupt the economy of abuse.
Mimic the bad actors - to stop them.
Online abuse has countless forms. Understand the types of risks Trust & Safety teams must keep users safe from on-platform.
Protect your most vulnerable users with a comprehensive set of child safety tools and services.
Stop online toxic & malicious activity in real time to keep your video streams and users safe from harm.
The world expects responsible use of AI. Implement adequate safeguards to your foundation model or AI application.
Implement the right AI-guardrails for your unique business needs, mitigate safety, privacy and security risks and stay in control of your data.
Our out-of-the-box solutions support platform transparency and compliance.
Keep up with T&S laws, from the Online Safety Bill to the Online Safety Act.
Over 70 elections will take place in 2024: don't let your platform be abused to harm election integrity.
Protect your brand integrity before the damage is done.
From privacy risks, to credential theft and malware, the cyber threats to users are continuously evolving.
Your guide on what to build and buy
This platform connects people through shared experiences and smart recommendations, helping users discover content that truly resonates with them. It also ensures a safe and engaging online environment.
A newly launched social discovery application, focused on helping users find new friends through polls, was planning to launch their services with safety features built in, at the product level.
With a Gen-Z user base, the company aimed to enable full creative expression while keeping illegal and other violative content out. This required precise, automated detection of specific abuse areas, and minimal false positives.
“Safety is key for our young audience, but so is expression - we needed to maximize both.”
Before approaching ActiveFence, the company did not have a Trust & Safety solution in place. While they wanted to ensure Trust & Safety, they didn’t want to add work to their small development team, and wanted a solution they could easily implement and maintain.
Moreover, without automations, they were reliant on manual moderation to keep users safe, an unscalable solution for a growing platform.
They looked for a solution that would enable their users to feel safe from day one, maximizing moderator productivity with minimal development resources.
By implementing ActiveFence’s complete Trust & Safety solution, the company was able to launch and scale, with safety built in to many of their product features.
One of their biggest concerns was ensuring that no CSAM, adult content, weapons, drugs, or other illegal content would be present on their systems. This is why they began using ActiveScore’s contextual AI models. The key differentiator for them was our novel CSAM model, which offers wider protection, beyond hash matching, to identify new child safety risks across images and text. In addition to CSAM, they implemented 11 additional models including adult and illegal content.
50% of spam was removed by actioning just 0.5% of users
To support moderators, they also launched with ActiveOS as their first content moderation solution. Knowing that they would be dealing with a high volume of threats, they immediately focused on setting up automations using Codeless Workflows. Automations allowed them to minimize moderator effort by automatically actioning content and bundling violations at the user level, to identify problematic users, and not just moderate at the content level.
For example, they set up a workflow for a 3-strikes policy, where users who had accumulated 3 individual violations, across abuse areas, were automatically removed from the platform. This was especially helpful in spam and adult content, where just 0.5% of users were responsible for 50% of the content.
Launching the product with safety built in enabled the company to safely grow its user base.
ActiveScore’s models ensure that their users are safe from high-priority violations, while automations minimize the number of items moderators have to review in order to do so. As a result, the team was able to remove hundreds of illegal posts before they reached users, and without moderator involvement.
By setting up the infrastructure and policies during the product development stage, the platform was able to focus on its own growth and to build features for scale, while ensuring a safe environment for their users.
“With ActiveFence, we’ve found a partner from day one to help safeguard our community.”
See how dating platforms use ActiveFence to protect users and build safer, trusted communities.
See how Niantic boosts user safety and engagement with ActiveFence’s cutting-edge technologies.
Discover how Udemy uses ActiveFence’s solutions to safeguard learners and educators worldwide.