Found the right boilerplate? Let's turn it into an MVP

Scrapy Boilerplate

Scrapy boilerplate for building and managing production web crawlers

placeholder screenshot

A Scrapy boilerplate that provides a structured starting point for Python web-crawling projects. It supplies a project layout with per-class module organization, SQLAlchemy ORM integration, RabbitMQ support via pika, proxy middleware, and Docker/docker-compose configurations for containerized spider execution.

Features

ORM Database Integration
Message Queue Support
Proxy Middleware Support
Container Deployment
Per-Class Modules
Environment-Based Configuration

Pricing

Free plan available

0

FAQs

Similar Boilerplates

Supastarter screenshot

Supastarter

👨🏻‍💻 by Jonathan Wilke Paid
supastarter comes with all the features you need to build a scalable SaaS. We save you the time building the boilerplate and let you focus your core features. Utilizing the power of serverless it is also the perfect stack for bootstrappers and indie hackers!
Makerkit screenshot

Makerkit

👨🏻‍💻 by Giancarlo Buomprisco Paid
Build unlimited SaaS products with any SaaS Starter Kit. Save months of work and focus on building a profitable business.
Shadcnblocks screenshot

Shadcnblocks

👨🏻‍💻 by Ausrobdev Freemium
The ultimate block set for Shadcn UI & Tailwind
UseSAASkit screenshot

UseSAASkit

👨🏻‍💻 by UseSAASkit Paid
Launch your AI startup in a week
Cruip screenshot

Cruip

👨🏻‍💻 by Cruip Paid
Tailwind CSS templates for your next project
Shipped screenshot

Shipped

👨🏻‍💻 by Luca Restagno Paid
Launch your startup in days, not months. The Next.js Startup Boilerplate for busy founders, with all you need to build and launch your startup soon.
Developer
👨🏻‍💻 Groupbwt
Github Stars
48
Last Commit Date
2025-02-12 (fetched 4 months ago)
Repo URL
groupbwt/scrapy-boilerplate
Technologies
Tags
Share