Seattle, WA, US
Summary
Engineered core components for AWS Glue Job Execution Service, focusing on compute provisioning and infrastructure scalability for serverless data workloads across distributed systems at scale.
Highlights
Developed core components of AWS Glue Job Execution Service (JES) in Java, optimizing compute provisioning for serverless data workloads across distributed systems at scale.
Designed and implemented a telemetry-driven Availability Zone (AZ) selection service using AWS Lambda, DynamoDB, and CloudWatch, reducing Warm Pool refresh overhead by 20% and enhancing infrastructure provisioning scalability.
Implemented a fault-tolerant dynamic AZ picker with weighted round-robin routing and multi-level failover, reducing fallback frequency by 40% and strengthening service reliability.
Built a real-time load-testing framework to simulate burst traffic across 100K+ EC2 instances, identifying critical bottlenecks and validating system performance under peak production load.