Bookmarks
Tag cloud
Picture wall
Daily
RSS Feed
  • RSS Feed
  • Daily Feed
  • Weekly Feed
  • Monthly Feed
Filters

Links per page

  • 20 links
  • 50 links
  • 100 links

Filters

Untagged links
Scrapy | A Fast and Powerful Scraping and Web Crawling Framework https://scrapy.org/
Mon 19 Mar 2018 10:43:04 PM PDT archive.org

A python module framework for writing web spiders. Aims to make it easy to write bespoke crawlers to solve specific problems, like scanning an unusual blog for content. Write rules specific to the use case. plugin architecture, cross-platform.

web plugin python module framework spiders
4684 links, including 339 private
Shaarli - The personal, minimalist, super-fast, database free, bookmarking service by the Shaarli community - Theme by kalvn