Qianyun Zhang
Software Development Engineer
Seattle,WA
Summary
Experienced Engineer specializing in the design and development of large-scale, high-performance Distributed Systems. Specialized in AI-driven Applications, including Real-time/Batch Inference, ML Model Lifecycle Management, and ML Ops. Expertise extends to Database and Framework Migration. Demonstrated proficiency in orchestrating cross-functional collaborations and project management. Eager to apply skills to drive innovation and contribute to team success.
Overview
7
7
years of professional experience
6
6
years of post-secondary education
Work History
Software Development Engineer
AWS - IAM
08.2022 - Current
- Led the design, implementation and launch of a centralized IAM limits management platform with an auto-approval workflow. Collaborated with 3 dependency teams to fill up feature gaps and had 12 IAM internal teams onboarded onto the platform. Significantly reduced customers' quota request time from 1-2 weeks to less than 1min.
- Designed and led the implementation of IAM Organizations limits data migration, transferring 800k limits data from another team's DynamoDB to ours.
Software Development Engineer
AWS - AI/ML
03.2019 - 08.2022
- Invented a new “Character Based Throttling” mechanism on Real-time Inference APIs, which allows 80% customers (with small documents as input) run with 4x traffic than before and increased total weekly traffic by 3.5 times (~20M->~70M units).
- Led service scaling project, increasing sync APIs' throughput from 10 to 100 TPS on average, with peak performance at 500 TPS. Achieved 2 times increase in team's revenue and meeting the needs of whale-size customers.
- Designed and led 2 teams' Console framework migration and codebase splitting project. Successfully transitioned Console to a serverless architecture, cut down deployment pipelines from 15+ to 1 and reduce ops loads from ~10hr to less than 10min per week. And the strategic migration plan led to the project being completed ahead of schedule by 2 months for each team.
- Led the design and rollout of Async inference architecture, enabling customers to run entity detection tasks on large datasets. This included multi-model serving, Async APIs and an Async workflow to initiate BatchTransform jobs. Collaborated cross-functionally with 5 related teams.
- Designed and led the migration of Model Serving architecture from EC2 to SageMaker. Designed and implemented the strategy to spin up web server in Docker to serve models on SageMaker. Guided team in migrating all 12 sync models. The project provided auto-scaling and minimized ops overhead to maintain infrastructure.
- Designed and led the Private Link solution to secure customers data transition between customersʼ VPC and the service to avoid exposing traffic to the public internet.
- Designed and implemented an annotation tool to assist annotator in labeling gold-standard data, generating daily progress reports, and facilitating anomaly comparison between annotators.
Software Development Engineer
Amazon
06.2017 - 03.2019
- Designed and developed forecast profile publishing system for 120+ Amazon Retail teams to decide capacity usage, which supports forecast profiles searching, reporting and notification.
- Designed and migrated data scientists’ forecast-generation work from local scripts to a service running on AWS ecosystem, which eliminated all manual work, made generation steps full CD and scalable, and cut down the running time from 3 days to < 1 hour.
- Reduced team’s major API’s latency by 70% by adding local cache to decrease read requests from S3 and parallelizing the write requests to S3.
Education
Master of Science - Electrical Engineering
New York University
New York, NY 08.2015 - 05.2017
Bachelor of Science - Electrical Engineering
Shanghai University
08.2011 - 05.2015
Skills
Distributed System, AL/ML Infra, Database Migration
Cross-functional Collaborations, Software Development Life Cycle, Project Management
Java, Python, Typescript, Ruby
AWS (Lambda, Sagemaker, ECS, DynamoDB, ElasticSearch, StepFunction, SQS, SNS, Athena, etc)
Timeline
Software Development Engineer
AWS - IAM
08.2022 - Current
Software Development Engineer
AWS - AI/ML
03.2019 - 08.2022
Software Development Engineer
Amazon
06.2017 - 03.2019
Master of Science - Electrical Engineering
New York University
08.2015 - 05.2017
Bachelor of Science - Electrical Engineering
Shanghai University
08.2011 - 05.2015