Scrapy boilerplate for building and managing production web crawlers

A Scrapy boilerplate that provides a structured starting point for Python web-crawling projects. It supplies a project layout with per-class module organization, SQLAlchemy ORM integration, RabbitMQ support via pika, proxy middleware, and Docker/docker-compose configurations for containerized spider execution.
0