Reddit AI Search Picks Already-Popular Comments, Audit Finds
An independent audit finds Reddit's AI search heavily favors comments that were already upvoted, raising questions about whether AI answer engines entrench popularity bias.
On this page
Reddit's AI Search Rewards Formal, Popular Comments — Then Erases the Voice That Made Them Trustworthy
A preprint from University of Illinois Urbana-Champaign researchers, first reported by Search Engine Journal on 2026-09-17, audited Reddit's AI search by running 10,000 questions through it three times, producing 30,000 answers traced back through 14.68 million comments. The headline finding: comments scored one standard deviation more formal had 49% higher odds of being selected, while comments coded for personal experience or supportive tone had lower odds (0.789 and 0.924 respectively). Once the researchers controlled for a comment's score, position and age, those effects shrank but didn't disappear (1.213 for formality, 0.860 for experiential language). Separately, across 1,000 queries, first-person words like "I" and "my" fell from 3.3% of the source comments to just 0.06% of Reddit's written answers.
What did the audit actually measure?
It measured which already-popular, formally worded comments Reddit's AI feature quotes, not whether AI-written answers are detectable or accurate.
The 20 advice and support subreddits sampled skew toward threads where formality and directive language ("should," "must," odds ratio 1.070) plausibly signal usefulness. Selected comments were disproportionately direct replies to the original post — 92% of picks, versus 53% of all comments — and comments with a score at or below zero made up 0.53% of selections against 5.1% of the pool. That's a retrieval-ranking story, closer to search relevance than to anything about AI-generated text itself.
Why should anyone optimizing for AI answer engines care?
Because the pattern mirrors what this site has already flagged in Google's AI Mode and AI Overviews: systems built to summarize crowd knowledge default to formal, already-authoritative language and discard the texture that made a source feel human.
Stripping first-person markers from 3.3% down to 0.06% doesn't just flatten tone — it turns testimony into generalized advice attributed to nobody. If you or your clients write for Reddit threads hoping to get cited by AI search, this audit suggests upvote velocity and formal phrasing matter more than lived detail, even though the authors explicitly warn their study is "observational and should not be interpreted causally."
Does this change how AI detection or humanizer tools should be evaluated?
Not directly, but it's a reminder that answer engines already homogenize voice before a detector ever sees the text.
Detection tools like GPTZero or Originality.ai are tuned to flag machine-typical prose — flat register, low first-person density, hedged generality. Reddit's own summarization layer is now producing exactly that profile from human-written comments, at scale, as a byproduct of ranking. Anyone using detector output on AI-search answers, rather than on the underlying comments, should expect false signals: the flattening comes from selection and rewriting, not necessarily generation.
Should buyers trust Reddit's own citation numbers?
Treat them the way you'd treat any vendor metric: as unverified until someone outside the company measures it the same way.
This audit is independent and unusually well-instrumented — 14.68 million comments traced is a serious sample — but it's a preprint, not peer-reviewed, and it covers only advice/support subreddits. Ask your own AEO or SEO vendor which subreddit categories, if any, their citation-tracking claims are based on before extrapolating this to commerce or technical subreddits.
Frequently asked questions
Did the study show Reddit's AI is biased toward AI-written comments?
No. The audit measured formality, vote rank and personal-experience language, not whether source comments were human- or AI-written.
Is this preprint peer-reviewed?
No — Search Engine Journal notes it has not undergone peer review, so the effect sizes should be read as preliminary.
Source: Search Engine Journal, "Reddit AI Search Picks Already-Popular Comments, Audit Finds".
The original story
An audit of Reddit AI search found formal, highly upvoted comments were selected more often, while experiential language appeared less often. The post Reddit AI Search Picks Already-Popular Comments, Audit Finds appeared first on Search Engine Journal.