USC Viterbi School of Engineering Logo – Viterbi School website
USC Logo – USC website
  • Students
  • Alumni
  • Parents
  • Corporate
  • Giving
  • Faculty
  • Search icon
About
Academics
Admission
Research
Innovation
Image
About
Academics
Admission
Research
Innovation
Image
Image

New Twitter, Now With More Hate

Julia Cohen | April 20, 2023 

A USC computer scientist and his team have found that in less than six months, hate speech has significantly increased on Twitter.

Photo credit: Jose Manuel Gelpi

Key Takeaways

In an analysis of Twitter using natural language processing and AI techniques, researchers found that in the period of time since October 2022:

  • Hateful users have become more hateful.
  • Hate has increased overall.
  • There has been no meaningful change in the quantity of bots.

Computer scientist Keith Burghardt at the Information Sciences Institute (ISI), a research institute of the USC Viterbi School of Engineering, has been studying social media for five years, and specifically studying online hate for the last year. 

Among other things, he has quantified how hateful online communities in Reddit increase the hate speech of new members; developed techniques to detect hateful subreddits and determine how subreddit members’ early interactions affect their activity within the group; and found ways to understand how online extremism occurs and predict anti-vaccine users on Twitter.

His latest paper, Auditing Elon Musk’s Impact on Hate Speech and Bots, quantifies hate and bots on Twitter. It has been peer-reviewed and accepted as a poster paper in the 2023 International AAAI Conference on Web and Social Media (ICWSM).

When Elon Musk purchased Twitter on October 27th, 2022, two of his stated goals were to have less restrictive content moderation and to remove spam bots. In this paper, Burghardt and his fellow researchers set out to look at the impact of the former, and the success of the latter.

Less Moderation Means More Hate

Previous research has shown that lighter moderation is associated with increased hate speech on social media platforms, therefore Burghardt’s team hypothesized that hate speech on Twitter would increase following Musk’s acquisition. The question was how to quantify this. 

“We first had to create a set of words that we could determine as being hateful. Our aim was to find words that were relatively high precision, meaning that if people are using these words, it’s unlikely they’re being used in a non hateful manner,” said Burghardt. He and his team originally created this methodology to understand hate speech on Reddit. Here, they have applied the same methodology to Twitter. It provided them with 49 hate keywords (WARNING: Contains offensive terms).  

“In addition, to weed out non-hateful or sexual uses of these words,” Burghardt said, “we only considered tweets that an AI tool, Perspective API, judged were toxic and not sexual in nature.” Since the presence of a hate keyword doesn’t necessarily mean a tweet is hateful, the team used Perspective API (application programming interface), a free and publicly available API that uses machine learning to identify toxic conversations. Though originally trained on New York Times data, it has been verified on a variety of social media platforms including Twitter. The team filtered the hateful users’ tweets on Perspective API’s toxicity metric, which defines a toxic comment as “a rude, disrespectful, or unreasonable comment that is likely to make people leave a discussion.” 

Using this methodology, the team extracted timelines of a sample of users who posted hateful tweets one month before and after Musk’s purchase and measured their daily rates of hate speech during the same time period. This gave them a measure of the degree to which already hateful tweeters changed their level of hate.

They found that the proportion of hate words in hateful users’ tweets increased after Musk bought Twitter. And the average daily hate speech of hateful users nearly doubled.

Hateful users increased their hate speech after Musk bought Twitter.

Then, they measured the overall volume of hateful tweets throughout 2022. To ensure fluctuations in hate speech were not reflective of fluctuations in overall user activity, they also sampled a baseline set of tweets collected during the same time intervals using benign keywords (e.g., “thing”).

They found that the daily average overall usage of hate keywords on Twitter nearly doubled after Musk bought Twitter.

Overall hate speech on Twitter increased after Musk bought the platform. (The spike in March, 2022 coincides with the Canada convoy protests.)

Now, About Those Bots…

Musk highlighted a reduction in bot accounts as one of his goals for the platform. As such, Burghardt and his fellow researchers hypothesized that the prevalence of bots would decrease after his purchase of Twitter. 

While bots are not necessarily connected to hate speech, this was a continuation of the audit they were performing, assessing and quantifying the stated goals Musk had for the social media platform. 

It should be noted however, that it has been shown that bots pose risks to social media platforms by spreading misinformation and hate.

The team used the Botometer API, developed, among others, by Emilio Ferrara, team leader at ISI and a professor of communication and computer science at USC Annenberg and at the USC Viterbi Department of Computer Science. The Botometer considers over 1,000 features to predict if a Twitter account is a bot and what type of bot (e.g., spam bot versus a fake follower).

The team collected Botometer scores of a sample of random accounts both before and after Musk bought Twitter. Burghardt said, “We found some types of bots became more prevalent, some types became a little less prevalent. But overall there was no significant change in the amount of bots.”

What’s Next?

“I’ve always been interested in understanding influence. That led to trying to understand if there are ways that people become influenced to do things that are harmful,” said Burghardt. This audit of Twitter is a piece of that work, as are his other current projects:  predicting if users will join hate groups; and how external events can push people to have extremist views.

Burghardt will be presenting Auditing Elon Musk’s Impact on Hate Speech and Bots as a poster paper in the 2023 International AAAI Conference on Web and Social Media (ICWSM), June 5 – 8, 2023 in Limassol, Cyprus. 

This will be the 17th annual ICWSM, one of the premier conferences for computational social science and cutting-edge research related to online social media. The conference is held in association with the Association for the Advancement of Artificial Intelligence (AAAI).

Published on April 20th, 2023

Last updated on May 16th, 2024

Related Stories

ISI podcast Banner“Researchers have to ask themselves how AI can be used for nefarious purposes” Pixelated forest background with the words "LEVEL UP!" written in a blue rectangle surrounded by sparkles. Nine gold coins often found in video games are lined up on the ground underneath the "LEVEL UP!" text box.2024 AIAS Foundation Scholars: Self-Actualization and Community Within The Gaming Industry Prof. Mahdi Soltanolkotabi with a low-field MR machine in the USC Dynamic Imaging Science Center. (USC Photo/Xenia Xu)Mahdi Soltanolkotabi Receives NIH Director’s New Innovator Award for Reliable AI for MRI Rusty Jehangir empowers thousands to pursue underwater robotics and exploration with startup Blue RoboticsBeneath the Waves
USC Viterbi School of Engineering Logo – Viterbi School website
Contact Us
Visit Us
Other USC Links
  • History
  • Awards
    • Foreign Academy Members and Fellows
Information For
  • Students
  • Corporate
  • Giving
  • Faculty
Recent USC Viterbi News
Jun. 11, 2025

Can AI Be Your Therapist? Not Quite Yet, Says New USC Study

Jun. 06, 2025

Reimagining Energy

Jun. 06, 2025

USC Viterbi School and BITS Pilani Forge Global Partnership to Advance Research and Education

Read More News
© USC Viterbi
Privacy Notice | Notice of Non-Discrimination | Digital Accessibility | Smoke-Free Policy
ABOUT THE SCHOOL

  • About Andrew Viterbi
  • Awards
  • Facts and Numbers
  • Faculty Directory
  • Ginsburg Hall
  • History
  • Leadership
  • USC Michelson Center
FROM THE DEAN

  • Dean's Message
  • Dean's Report
  • Initiatives and Priorities
  • Engineering +
  • Strategic Plan
NEWS | MEDIA | EVENTS

  • Events
  • Keynote Lecture Series
  • Media Contact & Press Releases
  • Media Coverage
  • News
  • Newsletter
  • Podcasts
  • Public Image Archive
  • Publications
  • Social Media
  • Video
EXPERIENCE

  • Contact Us
  • Visiting
SCHOOL OF
ADVANCED COMPUTING

DEPARTMENTS AND PROGRAMS

  • Thomas Lord Department of Computer Science
  • Ming Hsieh Department of Electrical and Computer Engineering
  • Division of Computing Education (DCE)
  • Technology and Applied Computing Program (TAC)
  • Interdisciplinary Data Science Program (IDS)
AFFILIATED RESEARCH CENTERS AND INSTITUTES

  • Information Science Institute (ISI)
  • Institute for Creative Technologies (ICT)
ADVANCED COMPUTING AFFINITY GROUPS (ACAGs)

  • More to come soon
DEPARTMENTS AND
ACADEMIC PROGRAMS

  • Aerospace and Mechanical Engineering
  • Astronautical Engineering
  • Alfred E. Mann Department of Biomedical Engineering
  • Mork Family Department of Chemical Engineering and Materials Science
  • Sonny Astani Department of Civil and Environmental Engineering
  • Thomas Lord Department of Computer Science
  • Ming Hsieh Department of Electrical and Computer Engineering
  • Daniel J. Epstein Department of Industrial and Systems Engineering
  • Engineering in Society Program
  • Technology and Applied Computing Program (TAC)
EXECUTIVE AND
CONTINUING EDUCATION

  • Aviation Safety and Security Program
  • Corporate and Professional Programs
ONLINE ACCESS

  • Graduate Programs - DEN@Viterbi
SPECIALIZED GRADUATE
PROGRAMS

  • Financial Engineering Program
  • Green Technologies Program
  • Interdisciplinary Data Science Program (IDS)
  • Progressive Degree Program
  • Systems Architecting and Engineering Program
RESOURCES AND
INITIATIVES

  • Academic Integrity
  • Accreditation
  • Awards
  • Awards Office
  • John Brooks Slaughter Center
  • Globalization
  • Faculty Directory
  • iPodia
  • K-12 Outreach
  • USC Experts Directory
  • Women in Science and Engineering
FIRST YEAR APPLICANTS
MASTER'S APPLICANTS
PHD APPLICANTS
TRANSFER APPLICANTS
RESEARCH ENVIRONMENT

  • Search Faculty Research Areas
  • Departments, Research Institutes and Centers
  • Research Infrastructure
  • Research Initiatives
  • Research Vision
  • Student Research
  • Summer Undergraduate Research Experience
TECHNOLOGY INNOVATION AND ENTREPRENEURSHIP

  • NSF I-Corps Hub: West Region
  • Office of Technology Innovation and Entrepreneurship
  • USC Stevens Center for Innovation
ABOUT THE SCHOOL

  • About Andrew Viterbi
  • Awards
  • Facts and Numbers
  • Faculty Directory
  • Ginsburg Hall
  • History
  • Leadership
  • USC Michelson Center
FROM THE DEAN

  • Dean's Message
  • Dean's Report
  • Initiatives and Priorities
  • Engineering +
  • Strategic Plan
NEWS | MEDIA | EVENTS

  • Events
  • Keynote Lecture Series
  • Media Contact & Press Releases
  • Media Coverage
  • News
  • Newsletter
  • Podcasts
  • Public Image Archive
  • Publications
  • Social Media
  • Video
EXPERIENCE

  • Contact Us
  • Visiting
SCHOOL OF
ADVANCED COMPUTING

DEPARTMENTS AND PROGRAMS

  • Thomas Lord Department of Computer Science
  • Ming Hsieh Department of Electrical and Computer Engineering
  • Division of Computing Education (DCE)
  • Technology and Applied Computing Program (TAC)
  • Interdisciplinary Data Science Program (IDS)
AFFILIATED RESEARCH CENTERS AND INSTITUTES

  • Information Science Institute (ISI)
  • Institute for Creative Technologies (ICT)
ADVANCED COMPUTING AFFINITY GROUPS (ACAGs)

  • More to come soon
DEPARTMENTS AND
ACADEMIC PROGRAMS

  • Aerospace and Mechanical Engineering
  • Astronautical Engineering
  • Alfred E. Mann Department of Biomedical Engineering
  • Mork Family Department of Chemical Engineering and Materials Science
  • Sonny Astani Department of Civil and Environmental Engineering
  • Thomas Lord Department of Computer Science
  • Ming Hsieh Department of Electrical and Computer Engineering
  • Daniel J. Epstein Department of Industrial and Systems Engineering
  • Engineering in Society Program
  • Technology and Applied Computing Program (TAC)
EXECUTIVE AND
CONTINUING EDUCATION

  • Aviation Safety and Security Program
  • Corporate and Professional Programs
ONLINE ACCESS

  • Graduate Programs - DEN@Viterbi
SPECIALIZED GRADUATE
PROGRAMS

  • Financial Engineering Program
  • Green Technologies Program
  • Interdisciplinary Data Science Program (IDS)
  • Progressive Degree Program
  • Systems Architecting and Engineering Program
RESOURCES AND
INITIATIVES

  • Academic Integrity
  • Accreditation
  • Awards
  • Awards Office
  • John Brooks Slaughter Center
  • Globalization
  • Faculty Directory
  • iPodia
  • K-12 Outreach
  • USC Experts Directory
  • Women in Science and Engineering
FIRST YEAR APPLICANTS
MASTER'S APPLICANTS
PHD APPLICANTS
TRANSFER APPLICANTS
RESEARCH ENVIRONMENT

  • Search Faculty Research Areas
  • Departments, Research Institutes and Centers
  • Research Infrastructure
  • Research Initiatives
  • Research Vision
  • Student Research
  • Summer Undergraduate Research Experience
TECHNOLOGY INNOVATION AND ENTREPRENEURSHIP

  • NSF I-Corps Hub: West Region
  • Office of Technology Innovation and Entrepreneurship
  • USC Stevens Center for Innovation
  • About
    • About the School
      • About Andrew Viterbi
      • Awards
      • Facts and Numbers
      • Faculty Directory
      • History
      • Ginsburg Hall
      • Leadership
      • USC Michelson Center
    • From the Dean
      • Dean’s Message
      • Dean’s Report
      • Initiatives and Priorities
      • Engineering +
      • Strategic Plan
    • News | Media | Events
      • Events
      • Keynote Lecture Series
      • Media Contact & Press Releases
      • Media Coverage
      • News
      • Newsletter
      • Podcasts
      • Public Image Archive
      • Publications
      • Social Media
      • Video
    • Experience
      • Contact Us
      • Visiting
  • Academics
    • School of Advanced Computing
      • Departments and Programs
        • Thomas Lord Department of Computer Science
        • Ming Hsieh Department of Electrical and Computer Engineering
      • Division of Computing Education (DCE)
        • Technology and Applied Computing Program (TAC)
        • Interdisciplinary Data Science Program (IDS)
      • Affiliated Research Centers and Institutes
        • Information Science Institute (ISI)
        • Institute for Creative Technologies (ICT)
      • Advanced Computing Affinity Groups (ACAGs)
        • More to Come Soon
    • Departments and Academic Programs
      • Aerospace and Mechanical Engineering
      • Astronautical Engineering
      • Alfred E. Mann Department of Biomedical Engineering
      • Mork Family Department of Chemical Engineering and Materials Science
      • Sonny Astani Department of Civil and Environmental Engineering
      • Thomas Lord Department of Computer Science
      • Ming Hsieh Department of Electrical and Computer Engineering
      • Daniel J. Epstein Department of Industrial and Systems Engineering
      • Engineering in Society Program
      • Technology and Applied Computing Program (TAC)
    • Executive and Continuing Education
      • Aviation Safety and Security Program
      • Corporate and Professional Programs
    • Online Access
      • Graduate Programs – DEN@Viterbi
    • Specialized Graduate Programs
      • Financial Engineering Program
      • Green Technologies Program
      • Interdisciplinary Data Science Program (IDS)
      • Progressive Degree Program
      • Systems Architecting and Engineering Program
    • Resources and Initiatives
      • Academic Integrity
      • Accreditation
      • Awards
      • Awards Office
      • John Brooks Slaughter Center
      • Globalization
      • Faculty Directory
      • iPodia
      • K-12 Outreach
      • USC Experts Directory
      • Women in Science and Engineering
  • Admission
    • First Year Applicants
    • Master’s Applicants
    • PHD Applicants
    • Transfer Applicants
  • Research
    • Search Faculty Research Areas
    • Departments, Research Institutes and Centers
    • Research Infrastructure
    • Research Initiatives
    • Research Vision
    • Student Research
    • Summer Undergraduate Research Experience
  • Innovation
    • NSF I-Corps Hub: West Region
    • Office of Technology Innovation and Entrepreneurship
    • USC Stevens Center for Innovation
  • Students
  • Alumni
  • Parents
  • Corporate
  • Giving
  • Faculty