Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

For simple web scraping, I find that kimonolabs.com does a perfectly fine job.


I love what they are doing with kimono and import.io

There's no free lunch lets put it that way. It's free, it's simple but limiting for doing anything heavier. It covers only a small portion of the websites. You can't crawl all the links in a website and hard to scrape data from dynamic webpages etc. Also I found that some websites wouldn't even load making it impossible to define the fields to scrape.


I tend to stick with KimonoLabs, but I did try http://parsehub.com for a while. It's a lot more complicated, but it allows you to scrape dynamic sites.


Excellent choices. We try to take the pros and cons from each of those services and make it better. Basically, Scrape.it aims to be simple to use like Kimono and able to handle complex websites as well.

You can scrape websites like Kayak and Airbnb as well by following the Scrape.it Tool.

We also have a dedicated number of hours every month to create the jobs for you so you could just tell us the websites you want to scrape.

We then monitor the jobs so that they will continue working without interruptions (ip throttle, website layout changes).




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: