Summary
Overview
Work History
Education
Skills
Projects
Timeline
Generic

Madhu Tileti

Beaumont,TX

Summary

Data Engineer with 5+ years of experience in Data Engineering, Data Pipeline Design, Development, and Implementation. Skilled in Spark, Scala, Python, Azure, AWS, ETL processes, and data visualization tools like Tableau and Power BI. Strong background in SDLC, Agile methodologies, and data modeling.

Overview

6
6
years of professional experience

Work History

Data Engineer

Emigrant Bank
New York, NY
06.2023 - Current
  • Designed and maintained Azure SQL Database, Azure Data Factory, and other Azure services
  • Developed Spark applications using Scala and PySpark for data extraction and transformation, reducing processing times by 25%
  • Automated ETL processes with Apache Airflow, improving job success rates by 15%
  • Created reports and dashboards using Tableau and Power BI
  • Utilized Kafka for real-time data ingestion and processing

Data Engineer

Wintrust Financial
Rosemont, IL
04.2022 - 05.2023
  • Migrated traditional systems to Azure, using tools like Azure SQL Database and Azure Data Factory
  • Enhanced ETL processes with Spark and PySpark, achieving a 40% improvement in data processing speed
  • Developed cost-effective data solutions on Azure, saving 15% on storage expenses
  • Created data pipelines for processing large datasets, reducing load times by 20%
  • Built real-time analytics solutions with Spark Streaming, increasing operational efficiency by 20%

Data Engineer

Chewy.com
Dania Beach, FL
09.2021 - 03.2022
  • Gathered business requirements and designed various data products
  • Developed Spark jobs in Scala and Python for data cleaning and preprocessing
  • Implemented data validation routines using Spark and MapReduce, improving data quality by 30%
  • Built AWS data pipelines for real-time data processing, reducing data latency by 50%
  • Created action filters, parameters, and calculated sets for dashboards using Power BI

Data Engineer

Symbioun Software Pvt. Ltd.
India
07.2018 - 08.2021
  • Developed real-time data pipelines using Spark, improving processing efficiency by 35%
  • Built logistic regression models to predict subscription response rates, enhancing prediction accuracy by 25%
  • Created data pipelines and ETL processes with Python and Spark, reducing data preparation time by 30%
  • Optimized MapReduce jobs for efficient HDFS usage
  • Used Tableau for data analysis and report generation

Education

Master of Science - Computer Science

Lamar University
12.2023

Skills

  • Snowflake
  • AWS RDS
  • MySQL
  • Microsoft SQL
  • PostgreSQL
  • MongoDB
  • Hadoop HBase
  • Apache Cassandra
  • Python
  • SQL
  • Scala
  • Java
  • Azure
  • AWS
  • CSV
  • JSON
  • Jenkins
  • Hadoop
  • Hive
  • Apache Spark
  • Pig
  • MapReduce
  • Sqoop
  • Linux
  • Unix
  • Windows
  • Tableau
  • Power BI

Projects

Bank Data Ingestion and Analysis System, Emigrant Bank:

Developed an automated ETL pipeline using Azure Data Factory and Databricks for ingesting and processing financial data from various sources., Implemented Spark applications for data transformation and aggregation, reducing processing times by 25%., Designed and maintained Azure Data Factory pipelines, improving data ingestion efficiency by 20%., Utilized Apache Airflow to schedule and monitor ETL jobs, reducing manual workload by 30%.

 Real-Time Financial Analytics Platform, Wintrust Financial:

Migrated legacy data processing jobs to Spark, resulting in a 25% reduction in infrastructure costs., Built real-time analytics solutions with Spark Streaming, enabling faster decision-making and a 20% increase in operational efficiency., Developed cost-effective data solutions using Azure services, saving the company 15% on data storage expenses., Created interactive reports and dashboards using Tableau and Power BI for financial data analysis.

Timeline

Data Engineer

Emigrant Bank
06.2023 - Current

Data Engineer

Wintrust Financial
04.2022 - 05.2023

Data Engineer

Chewy.com
09.2021 - 03.2022

Data Engineer

Symbioun Software Pvt. Ltd.
07.2018 - 08.2021

Master of Science - Computer Science

Lamar University

Similar Profiles

CREATE PROFILE
Madhu Tileti