FBI Flagged Jokes and Satirical Accounts to Twitter for Censorship

More evidence of the agency’s pervasive and secret online speech policing.

FBI Director Christopher Wray smiles while seated in front of a carved wooden FBI seal.

If you’re tired of censorship and surveillance, subscribe to Reclaim The Net.

The sixth batch of Twitter Files, published on Twitter by journalist Matt Taibbi, has revealed that the Federal Bureau of Investigation (FBI) and Department of Homeland Security (DHS) were regularly flagging content to Twitter for censorship between January 2020 and November 2022 and that some of the flagged content contained jokes and satirical comments.

According to Taibbi, there were more than 150 emails between the FBI and former Head of Twitter Trust and Safety chief Yoel Roth and a “surprisingly high number” of these emails were FBI requests for Twitter to “take action on election misinformation, even involving joke tweets from low-follower accounts.”

Taibi noted that the FBI’s social media-focused task force is known as FTIF and was created in the wake of the 2016 election. Since its inception, this task force has grown to 80 agents and corresponded with Twitter to “identify alleged foreign influence and election tampering of all kinds.”

Taibbi shared several examples of the FBI’s censorship requests and said Twitter employees would often look for reasons to suspend accounts after receiving these requests.

These censorship request emails reveal that the FBI would target both large and small accounts and sometimes issue preservation letters and request location information for the flagged accounts. Some of the large accounts that were flagged include those of Right Side Broadcasting Network (RSBN) (which has over 873,000 followers) and actor Billy Baldwin (which has over 204,000 followers). However, accounts with as few as 15 followers were also flagged to Twitter by the FBI.

A tweet by Matt Taibbi showing an FBI email asking Twitter contacts to review four user accounts.
Image
Matt Taibbi tweet displaying an internal FBI email listing Twitter accounts flagged to the platform for additional action.
Matt Taibbi tweet showing an email from FBI Agent Elvis Chan flagging accounts to Twitter for terms of service violations.
Email from FBI agent Elvis Chan asking Twitter to take action against accounts allegedly disseminating false election info.

Some of the accounts that were flagged by the FBI mostly shared jokes and were satirical in nature.

Matt Taibbi tweet displaying internal Twitter communications about reviewing and suspending satirical user accounts.
An internal Twitter email discussing election related potential TOS violations and account suspensions mentioning the FBI.
A tweet reading: I want to remind republicans to vote tomorrow, Wednesday November 9.
A tweet featuring an image of a small wooden boat overloaded with a large red shipping container.
Tweet by Matt Taibbi showing internal FBI requests sent to Twitter flagging Claire Foster satire tweets.
Email from FBI San Francisco to Twitter flagging posts from accounts byrum_wade and ClaireFosterPHD.
Two tweets by Dr. Foster @ClaireFosterPHD joking about altering election counts as a ballot counter.

Most of the accounts that were flagged by the FBI in these emails subsequently had some action taken against them by Twitter.

Tweet by Matt Taibbi showing an email from Patrick Conlon to the FBI listing Twitter accounts actioned for violations.

One email shared by Taibbi shows the FBI flagging tweets that told people to “Get out there and vote Wednesday!” when election day was Tuesday. According to Taibbi, these tweets had low engagement.

Tweet by Matt Taibbi sharing an internal Twitter email listing tweets reported by the FBI as possible violative content.

Screenshots of Twitter’s internal Slack show that at one point, the FBI had sent so many “possible violative content reports” that employees described reviewing them as a “monumental undertaking.”

A tweet by Matt Taibbi sharing internal Slack messages regarding FBI reports sent to Twitter personnel for review.
Internal message asking for help reviewing tweets forwarded in an FBI Report on Possible Violative Content.
Redacted message dated November 3, 2020, stating, "Thank you all so much for your help. A monumental undertaking!

Another revelation from this batch of Twitter Files is that the FBI had a “Teleporter” platform which it could use to send direct censorship requests to Twitter.

A tweet by Matt Taibbi sharing an email from FBI Agent Elvis Chan to Twitter's Yoel Roth regarding Teleporter reports.

In addition to the FBI, the documents also show Twitter employees discussing censorship requests that they’ve received from the DHS and state governments. One document shows a Twitter employee recommending “bouncing” (suppressing) content based on “the evidence we received from DHS etc” while another shows Twitter executives discussing a censorship request from California officials that targeted a Trump tweet.

A tweet by Matt Taibbi sharing internal communications about bouncing content based on evidence from DHS.
Tweet by Matt Taibbi sharing internal Twitter communications about action taken on a Donald Trump tweet.
Internal messages discussing a Donald Trump tweet reported by CASOSVote regarding California election procedures.
Donald Trump tweet claiming California hired a Democrat firm to count and harvest votes.

Outside of direct government censorship requests, one of the documents published by Taibbi shows the Election Integrity Project (EIP) at Stanford flagging a tweet from UncoverDC Editor-in-Chief Tracy Beanz. While this censorship request didn’t come from the government, it did cite information from the Center for Internet Security (CIS) — a federal government contractor.

Tweet by Matt Taibbi showing internal messages regarding an Election Integrity Project report on Pennsylvania elections.

Not only did federal agencies consistently send accounts and tweets to Twitter for censorship between January 2020 and November 2022 but one email shows a Twitter executive stating that she had “explicitly asked if there were any impediments with the ability of the government to share classified information or other relevant information with industry.” The executive continued that the “FBI was adamant that no impediments to information sharing exist.”

Matt Taibbi tweet showing an internal Twitter email from Stacia Cardille to Jim Baker discussing government agency syncs.

Alongside flagging tweets and accounts for censorship, the FBI also flagged its “products” to Twitter. These so-called products were DHS bulletins stressing the need for greater collaboration between law enforcement and “private sector partners.”

Tweet from Matt Taibbi sharing internal Twitter emails regarding FBI and DHS bulletins sent to executives.
Internal email from Stacia Cardille to Yoel Roth, Patrick Conlon, and Jim Baker forwarding FBI products.
Matt Taibbi tweet about DHS concerns over social media and information gaps with an embedded document excerpt.
Excerpt of a document mentioning law enforcement collaboration with private sector partners to detect DVE trends.

Several of the accounts that were targeted by the FBI expressed shock after discovering that their satirical tweets were being policed by the federal agency.

“Anyone who cannot discern obvious satire from reality has no place making decisions for others or working for the feds,” @ClaireFosterPHD told Taibbi.

@lexitollah added: “My thoughts initially include 1. Seems like prima facie 1A violation 2. Holy cow, me, an account with the reach of an amoeba 3. What else are they looking at?”

@Tiberius444 said: “I can’t believe the FBI is policing jokes on Twitter. That’s crazy.”

If you’re tired of censorship and surveillance, subscribe to Reclaim The Net.

Explore more on these topics