Knowledge Center

Content Moderation API & Available AI Labels

Suggest Edits

Overview and Aims

Given a text either original or from the hash of a post, we provide as output the topics, emotions, and sentiments that are most likely present within the text. Additionally, we can help you moderate by also flagging spam, LLM-generated content, hate-speech, violence, and other classifications for undesired and harmful content. The full list of labels is accessible in the API Reference. Alternatively, we are working towards custom labels and aim to provide support for you to train models on your own taxonomies. We conclude with guidelines from various credible publications to help you set the right expectations regarding the quantity and quality of data, as well as best practices to improve the chances of training an accurate model.

Understanding the Labels

We recognise that nuance and subjectivity are inherent to all these attributes in various levels. Setting aside any endeavour to reach consensus for the definitions, we report here what they represent in broad terms and give examples from their ground-truth datasets.

The examples given for the topics and emotions try to cover different aspects of each label, the intention is to emphasise the spectrum of nuances under each label. Important to keep in mind is that most examples actually hold more than one emotion/topic.

Emotion Label Descriptions

• Anger: Includes annoyance, rage.

  • Examples:
    • @user @usahockey USA was embarrassing to watch. When was the last time you guys won a game..? #horrible #joke
    • Can't believe I've lost my phone get me home
    • There's no excuse for making the same mistakes twice. Live & Learn or deal with the consequences of being unhappy #truthbomb

• Anticipation: Includes interest, vigilance.

  • Examples:
    • Israel's recent overtures towards West Africa seems to be attracting some elements of suspicion...an unnecessary suspicion though.
    • @user @user That's actually awful! You are in for a treat when you get home tho!!
    • How long?? @connor9mcintyre 😢😢😢 #Phelan #brilliance

• Disgust: Includes disinterest, dislike, loathing.

  • Examples:
    • The bathroom sink just spat a spider at me. I turned on the faucet, and a sizable spider flew up out of the drain. #spiders #fb
    • I need to start doing something with myself. #lazy
    • @user @Examiner Agree with @Examiner or you are of a lower intelligence would be your message there then? #dreadful

• Fear: Includes apprehension, anxiety, terror.

  • Examples:
    • @adgpi @NorthernComd_IA It is a grave #provocation 2 #Jawan #Martyr Plz ensure 20 #jawans killed Across LoC,Govt Says Army given #FreeHand?
    • #depression is a condition which will affect an estimated one in five of the population at some point in their lives
    • @user I think we underestimate them at our peril. IMHO Bannon, Ryan, McConnell, ect. will accomplish terrible things if allowed to.

• Joy: Includes serenity, ecstasy.

  • Examples:
    • I'm a proud father to a mustache #babystache #adorable #newborn
    • @user My pleasure my dear. 😘
    • 🔝 #love #instagood #photooftheday @user #photoeveryday #cute #picture #beautiful #followme #happy #follow #fashion #pic #picoftheday

• Love: Includes affection.

  • Examples:
    • @user @foxandfriends You are a man after God's heart and I am proud that you are my president. #BlessedAndGrateful #awesomeness
    • Why have I only just started watching glee this week I am now addicted 🙄 #glee #GLEEK

• Optimism: Includes hopefulness, confidence.

  • Examples:
    • Remain attached to God during your happiness and during your sadness.
    • “Worry is a down payment on a problem you may never have'. Joyce Meyer. #motivation #leadership #worry

• Pessimism: Includes cynicism, no confidence.

  • Examples:
    • Haven't been on a holiday abroad in two years how depressing is that btw☹️
    • If you let your insecurities get the best of you, you will hurt someone unwillingly. I've learned that! #tired #blah
    • So happy I get paid tomorrow so I can sort my bloody hair out before holiday

• Sadness: Includes pensiveness, grief.

  • Examples:
    • Don't grieve over things so badly..
    • @user Try explaining to Joe Public these charities do not simply give offenders 'treats' #despair
    • Sometimes i just wanna give up on everything i have but then i realize that if i give up and start fresh my hard work wont show.

• Surprise: Includes distraction, amazement.

  • Examples:
    • @AdamZHerman shocked as well. but bc I cheer for another club in the swiss league…
    • @user so I scrolled back up on the '17 GC because I missed it earlier and man you toooooooooo funny 😂😂😂😂😂 hilarious headassss!!!
    • my name is sara, im 20 years old and i cant believe boiling an onion is making me cry

• Trust: Includes acceptance, liking, admiration.

  • Examples:
    • I fw @ralofamgoon he don't hesitate to speak his mind
    • 2nd time this week I received services for free. It pays to be nice! #kindness #friendliness #bekind #smile
Topic Label Descriptions

  • Arts & Culture: Content that focuses on the creation and appreciation of various art forms, which evinces some degree of talent, training, or professionalism.

    • Examples:
      • Enjoyed @Mark_Kermode s review of IT CHAPTER TWO in @user . But why no mention of screenwriter Gary Dauberman? #theresareasontheydontjustfilmthebook #noscriptnofilm
      • Oh my word! Look at this! Photographer captures a tui forming in the clouds over Aoraki, via @nzherald {URL}

  • Business & Entrepreneurs: Content that relates to money, the economy, and wealth creation broadly. Including job tips, career advice, and day in the life.
    - Examples:
    - Click below to see my 24-hour #Bitcoin price prediction on the Pynk Beta !! Comment below to tell me your prediction... CrowdWisdom $BTCUSD $BTC #AI #Fintech
    - New article: TSA reports its busiest day since March over Labor Day Weekend has been published on Fintech Zoom - {URL} @user #Fintech #Blockchain #Crypto

  • Celebrity & Pop Culture: Stars and celebrities, their lives, funny moments, relationships, and fan communities.
    - Examples:
    - Check out Northshire Live: Todd Snyder Bundini: Don t Believe the Hype {URL} @Eventbrite @user @user
    - Hii Everyone I m new to stan Twitter. Please help & rt to find Mutuals. I Stan- @Taylor_Swift @KATY_PERRY @Ariana_Grande @The_Cursed_Madonna @MONTERO

  • Diaries & Daily Life: Slice of life, everyday content that illustrates personal opinions, feelings, occasions, and lifestyles.
    - Examples:
    - Looks like everyone on Twitter be waking up. Sorry Mr @user if my drunk rambles don t make sense. Been live tweeting Pokemon for the last 6 hours
    - Atlanta Activist Spent $200,000 In Black Lives Matter Donations On Personal Expenses, FBI Says {URL} via @Daily_Caller

  • Family: Family dynamics, in-jokes, and everyday moments.
    - Examples:
    - Join me in supporting We ve recorded your name; now take the next step. Please fund the fight for family leave. via @ActBoo {URL}
    - the hood done spoke @user and they saying how amazing of a little sister you truly are. you my real homie and you’re an amazing person frfr. i truly do appreciate you

  • Fashion & Style: Content about fashion, the industry, outfits, looks, shows, street style, collections, and designers. Both amateur and professional.
    - Examples:
    - These @aritzia contour bodysuits in every colours for the perfect base layering piece this winter ✌ . . . . . . . . . #outfitsinmotion #ootdfashion #whatiwore #streetstyle #highwaisted #bloggerstyle… {URL}
    - A moment to Remember ... Solemnization of #aimanrose . Special grooming for the Beautiful Bride @user . Thank you for stunning up the look . . Dress by @user . Make up by @user … {URL}

  • Film, TV & Video: Traditional media and entertainment, including film and tv, as well as content about Netflix and other streaming shows.
    - Examples:
    - “All Gold Everything (Remix (Explicit) {URL} via @YouTube , @Dwayne_Johnson “killed_country!?,” and, this legal remember^\”
    - Seriously @Sky_News , I m watching the service of rememberance and your voice over guy decides now might be a good time to mention the upcoming GE? REALLY? Couldn t just let the service be shown so we can all remember those lives lost

  • Fitness & Health: Healthy living and the components thereof, including nutrition, exercise, progress, and wellness.
    - Examples:
    - {URL} If you re struggling with Depression or suicidal thoughts please hear this message from @Louie_Giglio ! You may not be ok, but Jesus is! Remember: you are important, you are valued, your life matters!!
    - See Remember the Titans actor Ethan Suplee s incredible body transformation {URL} via @Yahoo

  • Food & Dining: Cooking, restaurants, food visuals, reviews, secret spots, food deals, technique, and ASMR. Anything related to food and food culture.
    - Examples:
    - The avocado spread at @Starbucks_Coffee has changed my life, but why don’t any airport locations have this or peanut butter? They are the perfect addition to add some protein to my vegan breakfast! #pleasegetpeanutbutter #andavospread
    - Sometimes you just have to feed those basic cravings and topping it with #leontastemakers “ToMango” Ketchup hits the spot! #vegan #chips with botanistabout @user yah.caitlame @ London, United Kingdom {URL}

  • Gaming: Games both real and virtual, the competition, culture, and gameplay itself.
    - Examples:
    - Please @Nintendo_of_Europe @Nintendo I really hope you make a remake from Paper Mario The Thousand Door. I really loved this game. I wanna play it again, or better lot of peopel wanna play it <3
    - Varsity boys finish their storm delayed game from yesterday with a victory 5-2 vs @user

  • Learning & Educational: Instructive, informative, educational content that teaches a fact, skill, or topic.
    - Examples:
    - Worth a read on @Medium : “The Greatest Sales Page I’ve Ever Seen” {URL}
    - Public Relations For Kids With Kristina Morgan | #KiddieNomics Kids Financial Literacy Fridays Thx Kristina Morgan for sharing your knowledge with the KiddieNomics Community. Checkout the full video {URL} via @YouTube #financialliteracy #PublicRelations

  • Music: Music performance, discussion, experiences and the like.
    - Examples:
    - New Album By @user dope!! Go Listen @user @user @user @user @user @user @user @user @user Sore with your family and friends, Share Your Thoughts!!! @Sony_Music @Def_Jam_Recordings {URL}
    - Holidays aren’t really my thing but @Trisha_Paytas dropped her new album today so it’s a goooood day. Everyone check out Rebirth. It’s so good, I’ll be listening allllll day.

  • News & Social Concern: Awareness, activism, dialogue, and discussion of social and societal issues and injustices, contents that focus on coverage of newsworthy events, political and otherwise.
    - Examples:
    - Tulsa landmark home to Woody Guthrie s rants against his landlord: President Trump s father {URL} via @user
    - Supreme court , parliament : I want to pass a strong law against animal cruelty in india . {URL} via @Change_org_India

  • Other Hobbies: Pastimes, recreation, and subcultures around hobbies and personal interests.
    - Examples:
    - brightttt i just wanna sayyyy I LOVE YOUUUU ❤️❤️❤️❤️ @bright
    - Glad to know our Odisha recovering from to the bad times. Braving Fani #BandeUtkalaJanani #ListenToTheSea @CMO_Odisha @Naveen_Patnaik

  • Relationships: Relationship dynamics, jokes, relatable moments, and the like between friend groups and romantic partners.
    - Examples:
    - Eid Mubarak to allll who are celebrating around the world this weekend ...... @Muslim_World_League @user @All_India_Muslim_Personal_Law_Board @MCB
    - Oh! Sending the inimitable @RawBeautyKristi the bestest vibes ever on her happiest of happy news.

  • Science & Technology: Content cutting-edge technology, natural phenomena, as well as knowledge and theories about the future and the universe.
    - Examples:
    - Earning #cryptocurrency for selling my stuff on @Listia ! Join me using code CDFQLK for an extra 100 XNK. I just listed this: L461 1/24 SCALE #94 MAC TONIGHT MCDONALDS DIE CAST NASCAR 1997 EDITION {URL}
    - Twitter Kills Off SMS Notifications & Posting In Most Countries And Deletes SMS Followers Without Providing Any Warning @Twitter @Twitter_Support @jack {URL}

  • Sports: All depictions of sports.
    - Examples:
    - Alamo City Fight Night: Daniel Da Beast Baiz vs. Ysreal Barboza {URL} via @YouTube My boy Baiz had the 4th and 5th round. Give it to him!!!
    - I think for next week we need to bring our secret weapon to the game for the Steelers Browns game!!!!! @Caroline_Collins you need to be at Heinz Field next Sunday!!!!! I honestly cannot wait for the rematch Caroline!!!!

  • Travel & Adventure: Vacations, travel tips, lodgins, means of conveyence, and the experience of travel.
    - Examples:
    - 4 hour delay on the way to atl and 25 minute delay sitting waiting for the grounds crew on the way back. Wonderful traveling this holiday season @user @Delta #3kids #allthegerms
    - #ChristmasinRome @Hallmark_Channel @Sam_Page @user Wow those are amazing bright christmas lights outside the Hotel.

  • Youth & Student Life: Moments and memes of life at school and in the classroom, including teachers, events, and the like.
    - Examples:
    - ❄️So much fun at @Disney_On_Ice {scroll ⬅️} today!! We got to see our favorite Disney characters, eat giant Olaf Snowcones... plus I ran into one of my besties! What could be better #weekend #gifted #disney… {URL}
    - I was hesitant about publishing #smallhearts, but after todays school shooting, I feel more justified. Remember the victims, not the monster. #SaugusHighShooting #books @Kindle @user

Sentiment Label Descriptions

Relative to the previous two classification tasks, sentiment is much more straightforward as the distinction between positive, neutral, and negative sentiments is much less subtle. It is approached as multi-class, meaning that only one sentiment may be given to a specific text.

  • Positive: Expresses a favorable, happy, or approving sentiment.

    • Example: I love this new phone! It’s amazing.

  • Neutral: Does not convey a clear positive or negative sentiment; often factual or indifferent.

    • Example: The meeting is scheduled for 3 PM tomorrow.

  • Negative: Expresses an unfavorable, unhappy, or disapproving sentiment.

    • Example: I am very disappointed with the service today.

Moderation Label Descriptions

We provide moderation labels belonging to three main categories: spam, LLM-generated content, and undesired content.

Let us start from the definition of what is LLM-generated, as it is the most straightforward. Contrary to all the other labels, the llm_generated label is directly defined from its provenance. In building the ground-truth required for its dataset, each instance was a question that was answered twice: once by a human and once by ChatGPT. Here is an example to illustrate this:

  • Question: Why I can not fabricate a religion that prevents me from going to school , then cite my first amendment rights when I am charged ? Prevents me from going to school by having , for example , supposed prayer times that coincide with school hours . Thanks ! Please explain like I'm five.
    • Human answer: Because you're a minor and your parents get to make that choice for you . Specifically to keep you from doing dumb shit like this . Now go to bed , you are going to school tomorrow ."
    • ChatGPT answer (first sentences): The First Amendment to the United States Constitution protects the freedom of religion, which means that you have the right to believe and practice whatever religion you choose. However, this freedom is not absolute and can be limited in certain circumstances to protect the rights and safety of others.

Updated 6 months ago

What’s Next