Senior Software Engineer public Remote experience
CyberDesk
Jan 2026 - Current (9 months)
• Architected and built a high-throughput data ingestion pipeline in TypeScript and Python, designed to ingest over 1 TB of data into DuckDB to power downstream analytics and reporting.
• Designed end-to-end ELT workflows on AWS using S3 for storage, Kinesis Data Firehose for real-time streaming, and ECS/Lambda for scalable compute orchestration.
• Implemented data quality validation, schema enforcement, and observability tooling to ensure reliability and consistency of ingestion workflows at scale.
• Optimized pipeline throughput via partitioning strategies and incremental load patterns, reducing latency and compute cost.
• Partnered with product and data teams to define ingestion requirements and data contracts, enabli