OpenAI’s new content moderation API is now available in Cinder

Yesterday OpenAI released a new model for their Content Moderation API, omni-moderation-latest, and today it’s available within Cinder as part of our detection management module.

New labels are now available with the OpenAI Moderation API update

OpenAI’s new model offers significant improvements from their first release of the Moderation API. The new model introduces state of the art multimodal detection across text and image attributes, and it outperforms its predecessor model across 40+ languages. Text has 13 categories to classify against, and images have 6. 

This massive shift lowers the barrier for platforms of all sizes to access advanced Trust & Safety classification, making high-performance detection accessible at zero cost.

Improved policy predictions within Cinder, using OpenAI’s omni-moderation-latest.

Within Cinder, teams have the ability to tie labels of any detection classifier, including omni-moderation-latest, to their platform's policies, enabling platforms to have full control, visibility, and transparency into their application. 

What does this mean in practice? 

In an ever evolving AI & detection landscape, Cinder empowers companies to access best in class content detection, integrated to their use case and specific acceptable use policies in minutes, without having to write an additional line of code.

This means faster implementation of new policies, better optimization of internal and third-party classifiers, and faster reduction of harm for their users. Teams on Cinder can configure consistent actions based on policy predictions, and measure efficacy against their curated labeled data sets, without ever having to write a line of additional code or even leaving their ops platform.

Evaluate and compare detection models against labeled content in Cinder

Top companies such as OpenAI, StabilityAI, and CharacterAI rely on Cinder to keep their users safe. Want to see how Cinder can help keep your platform compliant and create a safer community for your users? We'd love to show you.

Book a meeting

Read More

Build vs. Buy: Trust & Safety Edition

Today, Trust & Safety teams have a robust set of vendor options and so face a question long-pondered by leaders in other areas of the business: whether to build or to buy.

The Trust & Safety Funnel: A Framework for Product, Operations, and Policy

By recognizing and understanding the interconnected roles that policy, product, and operations departments play, teams will be empowered to enhance cross-functional communication, anticipate and prepare for downstream changes, and work together more effectively.

Measuring Trust and Safety

Measuring the success (and limitations) of a Trust & Safety program is a complex process, particularly because many Trust & Safety departments are considered cost centers.