Summary
Overview
Work History
Education
Skills
Websites
Personal Information
Languages
Timeline
Generic

Mike Chen

Austin,TX

Summary

Experienced Software Engineer with a proven track record in automation and delivering impactful results. Proficient in Python, Java, and object-oriented design, I excel in developing solutions that enhance operational efficiencies. My expertise extends to thriving in high-pressure and challenging environments, where I combine my energetic and adaptable approach with strong time management, organizational, and communication skills to drive project success.

Overview

6
6
years of professional experience

Work History

Data Engineer

General Motors
10.2023 - Current
  • Developed scalable data ingestion pipelines in Databricks using Python, pulling data from Azure ADFS and Amazon S3 into the Bronze layer.
  • Implemented robust merge strategies for multi-source data integration—supporting both append and merge operations—to ensure data consistency and accuracy.
  • Applied advanced data transformation techniques (e.g., cdf, decryption, type casting, scrubbing) to prepare and refine data in the Silver layer.
  • Integrated DataDog monitoring to track end-to-end pipeline performance, enabling proactive notifications and rapid issue resolution.
  • Developed a tool leveraging Spark Streaming and Structured Streaming to create a generalized framework for ingesting large datasets in near real-time
  • This framework enhances data processing capabilities and efficiency, enabling scalable and dynamic data handling across diverse applications

Lead Developer

General Motors
01.2021 - 10.2023
  • Designed an innovative automation tool that streamlines the scheduling and deployment of scripts, enhancing operational workflows
  • Equipped with advanced monitoring capabilities and a real-time status dashboard, the tool allows users to efficiently set and manage execution parameters
  • This integration ensures optimal operational efficiency and reliability, while providing transparent oversight of task performance and system health

Software Engineer

General Motors
07.2019 - 01.2021
  • Led the design and development of a custom CI/CD framework using cloud-native Python, enhancing process automation and efficiency
  • Developed cloud-native Python applications for deployment across diverse platforms
  • Designed a standardized deployment process
  • Led the development of the most utilized internal Dev/QA tool
  • Developed and implemented a hands-off automation solution for database migrations, saving over 4,000 labor hours

Education

Master - Electrical and Computer Engineering

Texas A&M University
05.2019

Skills

  • Python
  • Java
  • SQL
  • Databricks
  • Microsoft Azure
  • Amazon AWS
  • Hadoop
  • Kubernetes
  • Apache Kafka
  • Hadoop File System
  • Data integration
  • Data migration
  • NoSQL databases
  • Tensorflow

Personal Information

Title: Senior Software developer in DevOps and Data engineering

Languages

Chinese (Mandarin)
Native or Bilingual
English
Full Professional

Timeline

Data Engineer

General Motors
10.2023 - Current

Lead Developer

General Motors
01.2021 - 10.2023

Software Engineer

General Motors
07.2019 - 01.2021

Master - Electrical and Computer Engineering

Texas A&M University

Similar Profiles

CREATE PROFILE
Mike Chen