Summary
Overview
Work History
Education
Certification
Timeline
Skills Toolset
Generic

KOUSHIK TIRUMANYAM

Peoria,IL

Summary

Experienced Data Engineer with Master's in Computer Science; adept in building scalable data architectures and enhancing data processes with tools like AWS, Snowflake, Azure, PySpark, and Databricks. Demonstrates strong analytical skills in automating workflows and creating dynamic dashboards for data-driven decision-making. Proficient in developing Spark Applications using RDD,spark-sql,PySpark. Certified AWS Developer Associate with comprehensive hands-on experience in utilizing a wide array of AWS services like S3, DynamoDB, IoT Greengrass, EMR,ECS,IAM,EC2 and Lambda functions to enhance and optimize cloud infrastructure and applications. Skilled in monitoring and orchestrating cloud operations through effective use of Cloud Watch events, ensuring robust, efficient, and secure deployments. Proficient in leveraging Python for advanced data analysis and automation, coupled with extensive experience in using Snowflake for cloud-based data warehousing

Overview

6
6
years of professional experience
1
1
Certificate

Work History

Data Engineer

Virtusense
08.2022 - Current
  • Leveraged Snowflake to process JSON ,xml,text data from AWS S3, enabling efficient data analysis.
  • Architected AWS Lambda function to process logs from approximately 2000 IoT devices from S3 buckets, improving data accessibility and integration by 98 percent.
  • Enhanced operational insights by designing dashboards in Amazon QuickSights to analyze performance metrics, resulting in data driven decision-making,enabling organization to improve overall performance.
  • Engineered Python automation script to streamline product feature testing,improving efficiency and ensuring thorough evaluation reducing 95 percent of effort.
  • Created Airflow DAG workflow to automate download of software releases, update device firmware, execute Python automation scripts, and seamlessly deliver results via email.
  • Spearheaded cross-functional initiative to streamline data governance processes, collaborating with stakeholders from various departments to identify pain points and propose solutions thus improving data quality.

Data Engineer

Web Affinity Technologies
08.2018 - 07.2021
  • Developed real-time data processing and analysis pipeline using Databricks and Apache Spark to ingest, transform, and analyze streaming data from various sources.
  • Implemented AWS Elastic Container Service (ECS) scheduler to automate application deployment in cloud using Docker Automation techniques.
  • Utilized Airflow for scheduling and executing data ingestion pipelines, streamlining data processing workflows.
  • Orchestrated design and deployment of end-to-end data pipelines on Snowflake, seamlessly integrating batch and streaming data for real-time analytics and decision-making, resulting in 40 percent reduction in data processing time.
  • Implemented Spark Scripts using Py spark and Spark SQL, enabling faster data processing from Hive tables, resulting in 50 percent reduction in processing time and improved data accessibility.

Education

Master of Computer Science -

Bradley University
Peoria, IL
12.2022

Bachelor of Electronics and Communication -

JNTU College of Engineering
Andhra Pradesh,India
10.2017

Certification

  • AWS Certified Developer Associate: https://www.credly.com/badges/94de6a7f-b36d-469e-9728-f050de47b1ba/public_url

Timeline

Data Engineer

Virtusense
08.2022 - Current

Data Engineer

Web Affinity Technologies
08.2018 - 07.2021

Master of Computer Science -

Bradley University

Bachelor of Electronics and Communication -

JNTU College of Engineering

Skills Toolset

  • MySQL
  • Python
  • Amazon Web Services(AWS-S3,Lambda,EMR,IOT Greengrass,Athena,Glue,Dynamodb)
  • Databricks
  • Snowflake
  • PostgreSQL
  • Airflow
  • Data Analysis
  • Hadoop
  • Hive
  • PySpark
  • MongoDB
  • Linux
  • Azure(Blob storage,DataFactory,Power BI)

Similar Profiles

CREATE PROFILE
KOUSHIK TIRUMANYAM