Summary
Overview
Work History
Education
Skills
Certification
Languages
Timeline
Generic

Karthik Manchikanti

Monroe,NC

Summary

Having 10+ years professional career in IT - System Analysis, Design and Development, Migration, Production support and Maintenance projects. Very good experience in full Software Development Life Cycle (SDLC), Agile Methodology, Azure Cloud services (PaaS and IaaS), Azure DevOps, Bigdata, Hadoop eco system, Data Warehousing concepts and Abinitio. 6+ Years Experience in Azure Data Implementation services and Bigdata Spark Ecosystem (Azure SQL, Blob storage, Azure Synapse Analytics, Azure Data Lake Storage, Azure Databricks, Event Hubs, Azure Data Factory, Logic App,IOT devices, Cosmos DB, Postgre SQL, Azure DevOps,Spark Scala, Sqoop and PySpark) Certified professional of DP-200 & DP-201 Designing and implementing an Azure Data solution. Very Good experience in migrating the end-to-end Oracle, Netezza DWH and AbInitio ETL applications into Azure. Good experience in creating Generic Framework pipelines and Transformations using ADF, PySpark and Azure Databricks Notebook. Good Experience in migrating the MySQL, SQL server on-premises DBs to Azure Cloud using Azure DMS and SSMS. Extensive experience in building the ETL/ELT (Extract Loading and Transform) pipelines using ADF,PySpark and Azure Databricks with different file formats(csv, Json , delta, Parquet, Avro and text files) Expertise with the tools in Hadoop Ecosystem including Hive, HDFS, MapReduce, Sqoop, Spark and Yarn. Hands-on experience in designing and maintaining Online Transaction Processing (OLTP) databases. Knowledgeable in schema design for transactional databases to ensure data integrity and consistency. Skilled in managing and optimizing databases to handle high transaction volumes in real-time. Can work parallelly in both GCP and Azure clouds coherently. Have Extensive Experience in IT data analytics projects, Hands on experience in migrating on premise ETLs to Google Cloud Platform (GCP) using cloud native tools such as BIG query, Cloud Data Proc, Google Cloud Storage, Composer. Good experience in building Databricks Lake house, creating data frames and data ingestion modules to ingest the data into HDFS from heterogeneous data sources using PySpark and Sqoop. Very good experience in Data Bricks Cluster Configuration & Azure Synapse Cost Management, creating HDInsight cluster and Storage Account with End-to-End environment for running the jobs. Expertise in data warehousing concepts, ELT/ETL programming using ADF, Abinitio and other data warehouse lifecycle tasks such as data analysis, transforming, debugging/testing, and data loading across target systems. Good experience of full life cycle implementation of DWBI application, Star Schema and Snowflake model. Having strong interpersonal, problem solving & team skills, quick learner, able to meet deadlines, ability to interact with people at various levels. Experience in using build/deploy tools such as Jenkins and Azure Devops CI/CD Extensive experience in Onsite-Offshore model in terms of estimation, work allocation, code review, System Integration Testing, User Acceptance testing, deployment planning and Postproduction warranty support. Extensive knowledge of business process and functioning of Health Care, Telecom, Mortgage, Financial, Retail and Insurance sectors. Proficient in performance tuning of SQL queries for OLTP environments. Very good experience in Coordinating different teams to troubleshoot the critical issues without impacting the BAU process.

Overview

10
10
years of professional experience
1
1
Certification

Work History

Senior Data Engineer

Direct Tv
11.2023 - Current
  • Led end-to-end migration of commercial data from Teradata to Snowflake, overseeing a team of data engineers and collaborating with stakeholders to ensure a seamless transition.
  • Implemented a comprehensive migration strategy utilizing Databricks jobs for data extraction, transformation, and loading, resulting in a 40% reduction in migration time compared to initial estimates.
  • Orchestrated Databricks workflows to efficiently pull terabytes of structured and semi-structured data from Teradata, applying optimized ETL processes for data transformation before loading into Snowflake.
  • Designed Snowflake database schemas and optimized data storage structures, contributing to a 30% improvement in query performance post-migration.
  • Collaborated closely with business analysts to understand data requirements and facilitated the creation of optimized views in Snowflake, enabling faster data access and reducing redundancy by 25%.
  • Implemented rigorous data validation processes to ensure accuracy and consistency throughout the migration, reducing data discrepancies by 90% and enhancing overall data quality.

· Developed Spark applications using Databricks, pyspark and Spark-SQL for data extraction, transformation, and aggregation from multiple file formats for analyzing & transforming the data to uncover insights into the customer usage patterns.

· Developed Spark applications using Databricks, Python and Spark and Spark-SQL for data extraction, transformation, and aggregation from multiple file formats for analyzing & transforming the data to uncover insights into the customer usage patterns.

  • Resolved critical migration challenges by identifying and mitigating issues related to data consistency, schema mapping, and performance bottlenecks, ensuring minimal disruption to business operations.
  • Documented migration processes, best practices, and SOPs, providing comprehensive guidelines for future migrations and enabling seamless knowledge transfer within the team.
  • Conducted training sessions for internal teams on Snowflake functionalities and best practices, fostering a culture of continuous learning and skill development.
  • Created a pipeline to pull the data from Teradata to snowflake using data bricks data frame architecture.

Senior Data Engineer

BMO Harris bank (Bank of the west)
10.2022 - 09.2023
  • Interacting with stakeholders and Business analysts to understand the data and platform requirements in detail.

Senior data Engineer

Geico
Hyderabad
08.2018 - 09.2022
  • Interacting with stakeholders and Business analysts to understand the data and platform requirements in detail.

Developer

Citi bank (AML)
Hyderabad
08.2016 - 07.2018
  • GIW is huge data warehouse that receives and process payments transactional for EMEA and NAM regions.

Associate Consultant

Barclays(IBM)
Hyderabad
06.2014 - 07.2016
  • Involved in migration all objects in the system to latest version of Co-Op (V2.0 toV3.2.7).

Education

Bachelor of Science - Electronics And Communication Engineering

Jawaharlal Nehru Technology University
Hyderabad
04-2014

Skills

  • Azure
  • AWS
  • PaaS
  • IaaS
  • ADLS
  • Databricks
  • Azure data factory
  • Cosmos DB
  • Azure Synapse
  • Postgre SQL
  • EventHubs
  • Logic App
  • Azure Key Vault
  • Azure Active directory
  • S3 bucket
  • EC2 instances
  • DMS
  • Athena
  • Glue
  • Azure Datalake
  • Redshift Spectrum
  • GCP Big Query
  • Google cloud storage
  • PySpark
  • TerraForm
  • PL/SQL
  • Python Programming
  • Hadoop Ecosystem
  • Data Warehousing
  • Data Pipeline Design
  • Data Modeling
  • Continuous integration
  • Data Quality Assurance
  • Data Security
  • Big Data Processing
  • Kafka Streaming
  • Scala Programming
  • SQL and Databases
  • Data Analysis
  • Big data technologies
  • Data Migration
  • Database Design
  • Database structures
  • Spark
  • Oracle
  • Snowflake
  • SQL server DB
  • Teradata
  • Ab-Initio
  • Talend
  • GitHub
  • Jenkins
  • UCD
  • Azure DevOps CI/CD
  • Autosys
  • Control-M

Certification

  • Databricks Associate
  • Azure AZ104
  • AWS Associate Architect

Languages

English
Full Professional

Timeline

Senior Data Engineer

Direct Tv
11.2023 - Current

Senior Data Engineer

BMO Harris bank (Bank of the west)
10.2022 - 09.2023

Senior data Engineer

Geico
08.2018 - 09.2022

Developer

Citi bank (AML)
08.2016 - 07.2018

Associate Consultant

Barclays(IBM)
06.2014 - 07.2016

Bachelor of Science - Electronics And Communication Engineering

Jawaharlal Nehru Technology University
Karthik Manchikanti