Discover 3 key automations to optimize your moderation efforts Read 3 Essential Automations for Smarter Moderation
Manage and orchestrate the entire Trust & Safety operation in one place - no coding required.
Take fast action on abuse. Our AI models contextually detect 14+ abuse areas - with unparalleled accuracy.
Watch our on-demand demo and see how ActiveOS and ActiveScore power Trust & Safety at scale.
The threat landscape is dynamic. Harness an intelligence-based approach to tackle the evolving risks to users on the web.
Don't wait for users to see abuse. Proactively detect it.
Prevent high-risk actors from striking again.
For a deep understanding of abuse
To catch the risks as they emerge
Disrupt the economy of abuse.
Mimic the bad actors - to stop them.
Online abuse has countless forms. Understand the types of risks Trust & Safety teams must keep users safe from on-platform.
Protect your most vulnerable users with a comprehensive set of child safety tools and services.
Stop online toxic & malicious activity in real time to keep your video streams and users safe from harm.
The world expects responsible use of AI. Implement adequate safeguards to your foundation model or AI application.
Implement the right AI-guardrails for your unique business needs, mitigate safety, privacy and security risks and stay in control of your data.
Our out-of-the-box solutions support platform transparency and compliance.
Keep up with T&S laws, from the Online Safety Bill to the Online Safety Act.
Over 70 elections will take place in 2024: don't let your platform be abused to harm election integrity.
Protect your brand integrity before the damage is done.
From privacy risks, to credential theft and malware, the cyber threats to users are continuously evolving.
Your guide on what to build and buy
This platform transformed casual dating but faced challenges in user validation. See how ActiveOS helped streamline their moderation.
A global dating application had spent a significant amount of time, energy, and developer resources building in-house Trust & Safety tools. However, as the company’s user base expanded, they found that managing these tools was more than they bargained for.
Their queue management system was clunky, the internal models were hard to update, and they relied on multiple external vendors, resulting in significant tech debt.
“We reached the point where my team was reviewing 10K new users each week. We just couldn’t keep up.”
Additionally, with no automations, their moderators were manually reviewing all user signups. With thousands of new users every day, this inefficient process meant they were unable to meet SLAs.
Reliant on limited developer resources, they sought a way to consolidate their operations into one place, while avoiding the high cost and extended hours spent on enhancing a tool that is outside of their core business needs. They also wanted to improve moderator efficiency, and reduce manual moderation.
ActiveFence was brought on to address the company’s various pain points in one dedicated solution.
Using ActiveOS, the team was able to decommission its clunky, in-house tool and shift its moderation activities to a dedicated Trust & Safety platform that requires no developer resources on their end. Using features like our Policy Control Center and Codeless Workflows enabled the team to create and update content policies and enforcement processes in an agile way, without relying on internal R&D teams.
90% reduced time spent on new-user reviews
Replacing their patchwork of internally-built and outsourced detection models with nine of ActiveScore’s contextual AI models in one API, enabled the team to stay ahead of violations like harassment, self harm, and hate speech. Constantly updated and improved with intel insights and moderator feedback, ActiveScore enabled them to catch nuanced, novel violations that they previously had little visibility of.
The team also used various efficiency features that enabled them to move from a fully manual moderation process to largely automated, improving SLAs. They implemented Codeless Workflows and Custom Queues to automate and improve enforcement actions.
For example, a risk score was automatically assigned to new users based on their username and other metrics, a workflow then determined that users with a risk score over 70 were automatically blocked, those under 30 were automatically approved, while those falling in the middle were pushed to dedicated, prioritized queues for human review. This combination of automation and dedicated queues reduced the time spent on new user signups by 90%.
Using ActiveFence has allowed this dating app to safely scale while ensuring a positive experience for their users.
After an initial integration, the team was able to independently build and update policies, workflows, and reports, without relying on R&D resources. This resulted in a more agile, streamlined approach to content moderation.
Moreover, by using a combination of ActiveOS automations and customized queues, they increased automated actions and streamlined manual moderation, improving efficiency by 90%.
Finally, ActiveScore’s single integration allowed them to reduce the number of vendors they worked with, further improving team agility.
"It's got the automation features that we really wanted, which has been amazing for the team"
Find out how ActiveFence helps major social media platforms fight harmful content and maintain community trust.
Explore how The Trevor Project leverages ActiveFence’s tools to create a safe, supportive space for LGBTQ+ youth.
Discover how Udemy uses ActiveFence’s solutions to safeguard learners and educators worldwide.