Data Engineer
SmartCone Technologies Inc
Nov 2016 - Dec 2017 (1 year 2 months)
SmartCone Technologies develops IoT solutions for smart city infrastructure, including traffic cones and sensors. As a Data Engineer, I designed data models and pipelines for real-time sensor data collection and analysis.
• Built real-time data ingestion pipelines using Python and AWS Kinesis to process sensor data from 1,000+ IoT devices, achieving sub-second latency for critical alerts.
• Designed normalized data models in DynamoDB and Elasticsearch to support geospatial queries and historical trend analysis for urban planning clients.
• Developed custom parsers for binary sensor output formats, enabling integration of 5 different hardware vendors into a unified data platform.
• Created Jupyter Notebooks for explorator