Summary
Overview
Work History
Education
Skills
Timeline
Generic

Vardhan Babburi

Eden Prairie,MN

Summary

With over three years of experience as a Cloud Data Engineer, I excel in crafting, executing, and refining cloud-based data solutions. My proficiency extends across AWS, Azure, and GCP, encompassing data pipeline development using Spark, Kafka, and Airflow, as well as data warehousing solutions such as Redshift, BigQuery, and Snowflake. I'm adept in SQL, Python, and various visualization tools, driven by a passion for leveraging data insights to fuel decision-making

Overview

4
4
years of professional experience

Work History

DATA ENGINEER

Zirlen Technologies
01.2021 - Current
    • Implemented solutions for ingesting data from various sources and processing the Data-at-Rest utilizing Big Data technologies such as Hadoop, Map Reduce Frameworks, HBase, Hive
    • Able to assess business rules, collaborate with stakeholders, and perform source-to-target data mapping, design, and review identified valuable data sources and automated collection processes
    • Worked with building data warehouse structures, creating facts, dimensions, aggregate tables, by dimensional modeling, and Star and Snowflake schemas
    • Responsible for loading Data pipelines from web servers using Kafka and Spark Streaming API
    • Solved complex problems with multilayered datasets as well as optimized existing machine learning libraries and frameworks.

JUNIOR DATA ENGINEER

COMPETENT SYSTEMS
01.2020 - 01.2021
    • Worked with application and data science teams to support the development of custom data solutions
    • Supported the database design, development, implementation, information storage and retrieval, data flow, and analysis activities
    • Translated a set of requirements and data into a usable database schema by creating or recreating ad hoc queries, scripts, and macros, updated existing queries, created new ones to manipulate data into a master file
    • Supported development of databases, database parser software, database loading software, and database structures that fit into the overall architecture of the system under development
    • Collaborated with data scientists and product engineers to develop and deploy solutions to customer problems
    • Created innovative data capabilities and product features
    • Engaged with the technical community to present results externally, and keep up to date on recent advances
    • Built data pipelines that ingest a variety of manufacturing process metrics and context for in-product data.

Education

MS DATA SCIENCE -

MINNESOTA STATE UNIVERSITY
MINNESOTA, US

B. Tech ELECTRONICS AND COMMUNICATION ENGINEERING -

KL University
ANDHRA, INDIA

Skills

  • PYTHON SQOOP
  • SQOOP
  • HIVE
  • SPARK
  • AWS
  • KAFKA
  • AIRFLOW
  • NOSQL
  • POWER BI
  • DATA GOVERNANCE
  • GCP
  • AZURE
  • JENKINS
  • ANSIBLE
  • PROMOTHEUS
  • KIBANA
  • GRAFANA
  • DOCKER
  • KUBERNETES

Timeline

DATA ENGINEER

Zirlen Technologies
01.2021 - Current

JUNIOR DATA ENGINEER

COMPETENT SYSTEMS
01.2020 - 01.2021

MS DATA SCIENCE -

MINNESOTA STATE UNIVERSITY

B. Tech ELECTRONICS AND COMMUNICATION ENGINEERING -

KL University

Similar Profiles

CREATE PROFILE
Vardhan Babburi