areeves87
areeves87
/ popular_reddit_comment_removal.sql
Created
September 10, 2018 16:18
Counts the number of popular (score 90%ile) reddit comments in active subreddits from the June 2018 reddit comment database hosted on google bigquery
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| WITH active_subreddits AS (SELECT subreddit, COUNT(subreddit) AS comments | |
| FROM `fh-bigquery.reddit_comments.2018_06` | |
| GROUP BY subreddit | |
| HAVING comments > 1000), | |
| p90_threshold AS (SELECT subreddit, score, | |
| CASE WHEN body = '[removed]' THEN 1 ELSE 0 END AS removed, | |
| PERCENTILE_DISC(score, 0.9) OVER(PARTITION BY subreddit) AS percentile_90 | |
| FROM `fh-bigquery.reddit_comments.2018_06`), | |
| events AS (SELECT subreddit, removed, percentile_90, | |
| CASE WHEN score > 1 THEN 1 ELSE 0 END AS up, |