Software Engineer
Zyte
Jan 2021 - Nov 2023 (2 years 11 months)
• Co-designed, built, and operated a distributed Amazon extraction system at 43M+ requests/day with 97.7% success rate on AWS, owning architecture, reliability, and cost optimization across complex third-party integrations.
• Diagnosed non-content traffic routing issues and redesigned the request flow to bypass proxy usage for CDNs, fonts, and static assets, reducing spend by ~$25K/month, an 88% reduction.
• Built production data pipelines on AWS for enterprise and frontier AI lab clients, owning extraction, deduplication, filtering, and normalization across heterogeneous text, video, image, and Q&A sources.
• Designed and shipped production crawlers resilient to constantly evolving third-party defensive layers, including major anti-bot sys