The primary focus of my work is on big data processing. Additionally, I work on front-end and back-end development, as well as app development. In my spare time, I engage in full-stack related projects and have a keen interest in all kinds of technology.
Overview
4
4
years of professional experience
Work History
Real-time Computing Engineer
Zhoupu Data Co., Ltd
12.2021 - 04.2023
Second development and maintenance of a multi-tenant Canal real-time collection platform
Improvement of the FlinkCDC replenishment process, explored replacing Canal with Flink CDC for collection
Development and construction of real-time data warehouses (development of real-time wide tables, real-time dimension tables)
Development of real-time data platform tools (Flink process operations, Canal process operations, real-time lineage development)
API construction for data services (aggregation of real-time indicators for business functions)
Data Development Engineer
Weiera Technology Co., Ltd.
10.2020 - 12.2021
Constructed a full-domain marketing user profile label system, responsible for building and maintaining data warehouses in 7 domains.
Developed a data quality rule system and data exploration documentation, standardized development work.
Constructed a standardized data warehouse indicator system, developed a data warehouse lexicon.
Supported small and micro AI intelligence business operations and algorithm data needs.
Wrote various technical solutions and data flow charts, accumulated learning documentation.
Data Development Engineer
Zhongsoft International Co., Ltd.
06.2019 - 10.2020
Initially responsible for processing data related to meteorology, code tables, performance, etc.
Data synchronization: Collected data synchronously from city-wide medical sources
Responsible for the integration and maintenance of the medical data platform
Participated in the handling of massive medical data, designed data warehouses, modeled, analyzed, and created statistics
Involved in the construction of the data middle platform, data governance, major development of user profiles
Supported 100% of data service applications, providing data support to various hospitals and business offices
Analyzed and optimized the performance of various systems within the data platform, continuously improving system efficiency
Responsible for compiling technical documentation related to the project
Confirmed requirements with clients, conducted continuous delivery on-site, rich experience in delivery.
Education
Master of Science - Computer Science
Illinois Institute of Technology
Chicago, IL
12.2024
Bachelor of Science - Materials Forming And Control Engineering
Nanjing Institute of Technology
Nanjing
06.2019
Skills
Proficient in Java, Rust, C, C, Scala, Swift, Python, SQL
I enjoy running and listening to music, and I like to participate in marathon races to collect medals. Recently, I also took part in Chicago's Shamrock Shuffle.
Timeline
Real-time Computing Engineer
Zhoupu Data Co., Ltd
12.2021 - 04.2023
Data Development Engineer
Weiera Technology Co., Ltd.
10.2020 - 12.2021
Data Development Engineer
Zhongsoft International Co., Ltd.
06.2019 - 10.2020
Master of Science - Computer Science
Illinois Institute of Technology
Bachelor of Science - Materials Forming And Control Engineering
Freelance Data Engineer / Data Analyst at Freelance Data Engineer / Data AnalystFreelance Data Engineer / Data Analyst at Freelance Data Engineer / Data Analyst