Numerai is a hedge fund that crowdsources its model-building through data science competitions. It does this by publishing a dataset with blinded and encrypted variables so that data scientists can build predictive models without having full access to Numerai’s proprietary data. Competitors can stake Numeraire, a token built on Ethereum, to signal confidence in their […]
Analysis with R
Learning Spanish with R and Tableau: The Most Common Spanish Words Visualized
I am trying to learn a bit of Spanish very quickly. I’m going to Peru in a few months and I think it would be fun to see how much I can learn for that trip. I have never formally studied Spanish but am familiar with Romance languages and so I feel like I’m learning […]
Growth in Government Requests for Facebook Data
The relationship between government and Facebook is increasingly complicated. I recently worked on a project with Big Finish Digital, a new advertising agency, looking at the rise in government requests for Facebook data around the world. The founders of Big Finish are interested in data privacy and the ethics around data in advertising, and gave […]
Sentiment Analysis of Media Coverage of Facebook
I recently worked on data for a story with Charlie Warzel at Buzzfeed about media coverage of Facebook over time. I am really interested in the decline of public opinion towards Big Tech, and wanted to quantify it. Getting Data from the NYT API I started by using the New York Times API to pull […]
Taylor Swift’s Newfound Infatuation with Alcohol
Update: A few people reached out asking me to re-run this analysis for Ms. Swift’s latest album, Lover. I did and was somewhat surprised to see that the alcohol references weren’t a passing phase. I followed the same methodology as I did for the below, but this time put the data into Tableau Public for […]
Topic Analysis of Tim Ferriss’ Podcast Using Rvest
March 28, 2018 Text Analysis of Tim Ferriss Podcast Episodes Using R I recently came across a great respository of transcripts from Tim Ferriss’ podcast, courtesy of transcripts.io. I don’t actually listen to Ferriss’ podcast (too heavily monetized for my taste), but I know that many do and he gets great guests. I thought I’d […]
Analyzing Facebook Messages in R
Facebook Profile Data Analysis It’s fun to see data about yourself. So upon learning that you can download all of your facebook data, I think it’s natural to want to analyze it. Facebook makes it quite easy to download all of your data, but analyzing it is harder. You get a .zip file with a […]