01 · Data system
Collection and processing with Scrapy, Django, and Celery.
Led development of an engine for collecting and processing web data. The system combined Scrapy, Django, and Celery across data collection, backend services, and asynchronous processing.
02 · Production
Services, workers, queues, and infrastructure.
Owned production components across Django, Celery, Redis, PostgreSQL, ECS, Lambda, SQS, and CloudWatch.
- Worked on ECS worker scaling and queue processing.
- Worked on proxy infrastructure.
- Maintained components across the application and AWS infrastructure.
03 · Delivery
Automated deployment and operational workflows.
Rebuilt GitLab CI/CD pipelines with Docker and Terraform to automate deployments, database migrations, and worker and service management.
04 · Published scope
Only confirmed work is described here.
This case study records the implementation scope and technologies that can be stated responsibly. It does not publish a client name, performance metric, screenshot, or testimonial.