Framework Libraries Used in Web Scraping javascript ayakashi 160 1.0.0-beta8.3 (3 months ago) Apr 18 2019 node-crawler 6,334 1.4.0 (24 days ago) Sep 10 2012 ruby spidr 735 0.7.0 (22 days ago) Jul 25 2009 wombat 1,278 3.0.0 (5 months ago) Dec 27 2011 r rvest 1,384 1.0.3 (1 year, 3 months ago) Nov 22 2014 go gocrawl 2,000 (1 year, 8 months ago) Nov 20 2016 ferret 5,192 (5 months ago) Jul 23 2019 dataflowkit 564 2023-01-14 (8 days ago) Feb 09 2017 geziyor 1,831 2023-01-18 (5 days ago) Jun 06 2019 pholcus 7,248 v1.3.4 (2 years ago) Jul 26 2019 colly 18,672 v2.1.0 (2 years ago) May 14 2018 python dude 327 0.1.2 (2 years ago) Feb 20 2022 photon 9,316 1.1.9 (4 years ago) Aug 24 2018 ruia 1,641 0.8.5 (4 months ago) Oct 17 2018 gerapy 2,895 0.9.12 (27 days ago) Jul 04 2017 scrapydweb 2,649 1.4.0 (3 years ago) Sep 30 2018 autoscraper 4,845 1.1.14 (6 months ago) Jul 26 2019 scrapyd 2,576 1.3.0 (1 year, 11 days ago) Sep 04 2013 scrapy 45,593 2.7.1 (2 months ago) Jul 26 2019 php crwlr-crawler 63 v0.7.0 (10 days ago) Apr 18 2022 php-spider 1,282 v0.6.3 (9 months ago) Mar 16 2013 phpscraper 338 1.0.2 (a month ago) May 04 2020 roach 1,101 1.1.1 (4 months ago) Dec 27 2021 panther 2,679 v2.0.1 (1 year, 1 month ago) Jul 17 2018