Category Archives: Tools

About the tools that run on scraperwiki.com

Scrape anyone’s Twitter followers

Words are important, people more so. Following our popular tool which makes it easy to scrape and download tweets, we’re pleased to announce a new one to get any Twitter account’s followers. To use it, log into ScraperWiki, choose “Create a new … Continue reading

Posted in Tools, Uncategorized | Leave a comment

Mastering space and time with jQuery deferreds

Recently Zarino and I were pairing on making improvements to a new scraping tool on ScraperWiki. We were working on some code that allows the person using the tool to pick out parts of some scraped data in order to … Continue reading

Posted in developer, Tools | Tagged , , , | Leave a comment

Uploading a (structured) spreadsheet

We’ve made a new tool to help you upload a structured spreadsheet. That is to say, one that contains a table with headers. I’m trying it out with an old spreadsheet of expenses from when I worked at mySociety. If your … Continue reading

Posted in beta, Tools | Leave a comment

Sharing in 6 dimensions

Hands up everyone who’s ever used Google Docs. Okay, hands down. Have you ever noticed how many different ways there are to ‘share’ a document with someone else? We have. We use Google Docs at lot internally to store and … Continue reading

Posted in thoughts, Tools | Tagged , , | 4 Comments

What Does It All Mean? Find out with Summarise This Data

Every time I generate a new dataset, the first thing I want is a high-level overview of what’s going on. I can’t digest millions of individual rows of data – I need a way to zoom-out and get the bigger … Continue reading

Posted in Data Science, Tools | 2 Comments

Open your data with ScraperWiki

Open data activists, start your engines. Following on from last week’s announcement about publishing open data from ScraperWiki, we’re now excited to unveil the first iteration of the “Open your data” tool, for publishing ScraperWiki datasets to any open data … Continue reading

Posted in opendata, Tools | Tagged , , | 2 Comments

Data analysis using the Query with SQL tool

Ferdinand Magellan, the Renaissance’s most prodigious explorer. He almost certainly knew lingua franca – but did he know SQL?It’s Summer 1513. Rome is the centre of the Renaissance world, and Spanish, Italian, and Portuguese merchant ships criss-cross the oceans, ferrying … Continue reading

Posted in beta, Tools, Uncategorized | 1 Comment