Author Archives: Francis Irving

Scrape anyone’s Twitter followers

Words are important, people more so. Following our popular tool which makes it easy to scrape and download tweets, we’re pleased to announce a new one to get any Twitter account’s followers. To use it, log into ScraperWiki, choose “Create a new … Continue reading

Posted in Tools, Uncategorized | Leave a comment

9 things you need to know about the “Code in your browser” tool

ScraperWiki has always made it as easy as possible to code scripts to get data from web pages. Our new platform is no exception. The new browser-based coding environment is a tool like any other. Here are 9 things you should know about … Continue reading

Posted in developer | 2 Comments

Uploading a (structured) spreadsheet

We’ve made a new tool to help you upload a structured spreadsheet. That is to say, one that contains a table with headers. I’m trying it out with an old spreadsheet of expenses from when I worked at mySociety. If your … Continue reading

Posted in beta, Tools | Leave a comment

What’s a CTO actually do? (and a job advert)

It can be hard to tell what somebody else’s job actually is. If you’ve never done it, you don’t know what really matters. Job adverts with bulleted lists of skills give some indication, yet somehow don’t get to the heart … Continue reading

Posted in jobs | Leave a comment

10 technical things you didn’t know about the new ScraperWiki

1. Scrapers are now completely language neutral. Not just Python and Ruby – but anything open source that can make or read an SQLite file, from R to Clojure. 2. Scrapers can have as many files as they like. So … Continue reading

Posted in beta, developer | 1 Comment

Job: Product Marketing Manager

Our new platform and associated data science services are going well, so we’re hiring an ambitious marketeer to help us communicate better what we’re doing. Full job advert and how to apply here It’s our first full time marketing role, so since … Continue reading

Posted in jobs | 2 Comments

Quick start guide: Make your first data tool

The new ScraperWiki is all about tools, like a hammer rather than a washing machine. For data scientists and developers we’ve made a new quick start guide, that takes you through making your first tool. We’re looking forward to seeing … Continue reading

Posted in beta, developer, Tools | 1 Comment