Pretty good call graphs for dynamic languages

Proxy server to bypass Cloudflare protection

Download the entire Wayback Machine archive for a given URL.

Mermaid diagrams in yours sphinx powered docs

Redis-based components for Scrapy.

HTTP API for Scrapy spiders

A Flask boilerplate for scraping work using scrapy

Product Extractor is designed to get main information about a product of zamorskiepodarki.com/

Autodoc for PG SQL files

A Sphinx extension for displaying SqlAlchemy model

Automatically turn your SQLalchemy Data Models into a Nice SVG Diagram

This is a sample Scrapy project for educational purposes

MongoDB pipeline for Scrapy. This module supports both MongoDB in standalone setups and replica sets. scrapy-mongodb will insert the items to MongoDB as soon as your spider finds data to extract.

Scrapy middleware to handle javascript pages using selenium

A service daemon to run Scrapy spiders

Multifarious Scrapy examples. Spiders for alexa / amazon / douban / douyu / github / linkedin etc.

Scrapy, a fast high-level web crawling & scraping framework for Python.

A lightning-fast search engine API bringing AI-powered hybrid search to your sites and applications.