Santhosh Kumar Karnati
Summary
Results-driven data engineer with proven success in leading data migration projects and designing scalable cloud solutions. Expertise in Informatica and Python enhances ETL processes, ensuring efficient data flow and accessibility. Skilled in implementing data vault methodologies for effective data management.
Overview
14
14
years of professional experience
Work History
Sr DataEngineer/Team Lead
ECOM SOLTUIONS INC
Johnston
07.2015 - Current
- Led major data migration projects, transferring data from Siebel and legacy AS400, mainframe systems to Salesforce using Informatica PowerCenter.
- Architecting the Legacy Integrations between on-premise servers to AWS cloud and Snowflake database using Informatica Intelligent cloud services, Informatica power center and Shell/Python scripts.
- Implemented Data vault 2.0 for loading the data from Mainframe/DB’s/Files to Raw, Operational Vault and Business Vault using python framework.
- Developed dynamic ETL code generation using Python to streamline data processing.
- Building custom python frameworks to egress and ingress the data from Snowflake.
- Built custom python framework to ingest the data to Snowflake from external stage.
- Built and aligned new and existing integrations for multi-tenancy architecture.
- Used informatica PowerCenter to load the data to SFDC from multiple source systems.
- Used Informatica cloud to import the data from salesforce to Oracle DB.
- Worked on Power exchange to pull the data from mainframe to Oracle DB.
- Tuned performance of existing workflows to meet SLA requirements.
- Migrated Informatica components from 9.5 to 10.1,10.2,10.4.
- Created Autosys jobs for scheduling the workflows.
- Created Data Replication and Data synchronization jobs in Informatica cloud for SFDC for near real-time data availability for external source systems.
System Analyst
Radiant soft
Virginia Beach
03.2014 - 07.2015
- Played key role in gathering business requirements and designing data loading processes for Datamart.
- Worked on Power Center Designer client tools like Source Analyzer, Target Designer, Mapping Designer and Mapplet Designer.
- Upgraded Informatica PowerCenter from version 9.1 to 9.5 to enhance functionality.
- Moving the data from source systems to different schemas based on the dimensions and fact tables by using the slowly changing dimensions type two and type one.
- Created, scheduled, and executed sessions, worklets, commands, email tasks, and workflows to optimize data integration using Informatica workflow manager.
- Wrote UNIX Shell scripts for Informatica ETL Tool.
- Participated in performance tuning of ETL maps at mapping, session, source, and target levels.
- Tuned SQL Queries in Source qualifier Transformation for better performance.
- Created and executed unit test cases for various scenarios for all the mappings, workflows and scripts.
- Project included working on complete Oracle 11g with Oracle BI apps 7.9.6.2 that included Informatica, DAC and generation of reports in OBIEE.
- Executed data conversion processes from SQL Server to Oracle databases to ensure compatibility.
- Leveraged SharePoint for Enterprise Content Management, enhancing document organization and retrieval efficiency.
- Designed and implemented ECM strategies to optimize storage of organizational documents.
- Involved in writing scripts for loading data to target data warehouse for BTEQ, FLoad, and MultiLoad.
- Experience in writing custom java methods to extract the data.
- Utilized Java methods to extract and process data from XML files for analysis.
- Used Parameter files to reuse the mapping with different criteria to decrease the maintenance.
- Extensively used Informatica Debugger for testing the mapping logic during Unit Testing.
- Provided data to the reporting team for their daily, weekly and monthly reports.
- Used Autosys to schedule Informatica, SQL script and shell script jobs.
ETL Developer
LRTEK LLC
NJ
07.2013 - 02.2014
- Led efforts to understand business requirements, design, and load data into Datamart, ensuring data accuracy and accessibility.
- Moving the data from source systems to different schemas based on the dimensions and fact tables by using the slowly changing dimensions type two and type one.
- Informatica workflow manager was used to create, schedule, execute Sessions, Worklets, Command, E-Mail Tasks and Workflows.
- Wrote UNIX Shell scripts for Informatica ETL Tool.
- Facilitated performance tuning of ETL maps at mapping, session, source, and target levels to improve processing efficiency.
- Tuned SQL Queries in Source qualifier Transformation for better performance.
- Created and executed unit test cases for various scenarios for all the mappings, workflows and scripts.
- Experience in data conversion from SQL Server to Oracle.
- Involved in writing scripts for loading data to target data warehouse for BTEQ, FLoad, and Multiload.
- Experience in writing custom java methods to extract the data.
- Extracted structured data from XML files utilizing Java methods.
- Worked exclusively with the Teradata SQL Assistant to interface with the Teradata.
- Extensively used functions like Cast and Convert for data conversions.
- Used Parameter files to reuse the mapping with different criteria to decrease the maintenance.
- Extensively used Informatica Debugger for testing the mapping logic during Unit Testing.
- Delivered data to reporting team for daily, weekly, and monthly reports, enhancing decision-making capabilities.
- Used Autosys to schedule Informatica, SQL script and shell script jobs.
System Analyst
Trinuc LLC
Palatine
01.2013 - 06.2013
- Extracting data from several source systems like Oracle, Flat files, Netezza, DB2 etc. and loading data into Enterprise Data warehouse (Teradata).
- Wrote scripts to load data into the target data warehouse for BTEQ, FLoad, and Multiload.
- Developed complex procedures, functions, and triggers to implement effective ETL solutions through PL/SQL.
- Executed SQL tuning using Explain Plan, Tkprof, hints, and indexes to enhance query performance.
- Session performance was improved with pipeline partitioning and increasing block size, data cache size, sequence buffer length and target-based commit interval.
- Informatica workflow manager was used to create, schedule, execute Sessions, Worklets, Command, E-Mail Tasks and Workflows.
- Worked on Power Center Designer client tools like Source Analyzer, Target Designer, Mapping Designer and Mapplet Designer.
- Used Data Exchange for transforming structured and unstructured data.
- Created Mapplets with the help of Mapplet Designer and used those Mapplets in the Mappings.
- Created reusable transformations and mapplets by using Lookup, Aggregator, Normalizer, Update strategy, Expression, Joiner, Rank, Router, Filter, and Sequence Generator etc. in the Transformation Developer and Mapplet Designer respectively.
- Moving the data from source systems to different schemas based on the dimensions and fact tables by using the slowly changing dimensions type two and type one.
- Established infrastructure to ensure data quality and appropriate data linkage, enabling self-service reporting and expediting decision-making.
- Collaborated with the data modular team to create dimensions and fact tables in various schemas.
- Extensively used Informatica Debugger for testing the mapping logic during Unit Testing.
- Wrote UNIX Shell scripts for Informatica ETL Tool.
- Utilized Java custom methods for data extraction from source systems.
- Used Informatica Data Migration to decrease the risk and minimize the errors.
- Raised change requests and managed incidents related to program flaws in the development environment.
System Analyst
Clear Thought Solutions
NC
06.2012 - 12.2012
- Conducted requirement analysis, ETL design, and development to extract data stored in various sources like Oracle and SQL Server.
- Analyzed, designed and developed an environment that would facilitate the use of Informatica to transform data coming from Igrasp oltp to datamarts.
- Developed complex Informatica B2B mappings using transformations such as lookup, router, aggregator, expression, update strategy, and joiner to optimize data processing.
- Created connected, unconnected, and dynamic lookup transformations to enhance mapping performance.
- Created sessions, worklets, and workflows to automate mapping execution on a daily and biweekly schedule.
- Extensively used Parameter files, mapping variables in the process of development of the IDE, IDQ mappings for all the dimension tables.
- Developed and implemented the UNIX shell script for the start and stop procedures of the sessions.
- Implemented Slowly Changing Dimension type2 methodology in Informatica.
- Addressed performance issues in Informatica mappings by evaluating and tuning existing logic for improved execution efficiency.
- Tuned SQL Queries in Source qualifier Transformation for better performance.
- Created and executed unit test cases for various scenarios for all the mappings, workflows and scripts.
Education
Master’s - software engineering
Stratford University
West Falls church, VA, USADiploma - Software Engineering
NIIT
Hyderabad, IndiaBachelor of Technology - Electronics and Communications
JNTU
IndiaSkills
- Data SQL Query Optimizationgration
- ETL Tools
- AWS Data Pipeline
- Informatica Power Center
- Informatica PowerExchange
- Data Quality
- Data Lake Architecture
- Kafka
- Data Warehousing
- Data Modeling
- Physical Modeling
- Logical Modeling
- Relational Modeling
- Dimensional Modeling
- Star Schema
- Fact
- Dimensions
- Microstrategy WFLAKE
- Postgres
- BigQuery
- Oracle Database
- SQL Server
- Teradata
- Netezza
- Sybase
- DBMS
- SQL
- PL/SQL
- T-SQL
- Tools
- Automation Scripting
- UNIX Shell Scripting
- Python
- R Programming
- Scala
- Cloud services
- Amazon web Services
- Container Orchestration
- Apache Airflow
- Job Scheduling
- Database Automation
- Report software
- OBIEE
- Business Objects
- SQL
- Cognos
- Version Control
- Cloud MonitoringRational Doors
- Agile Project Management
- Tools
- Operating Systems
- UNIX
- LINUX
- UNIX
- LINUX
- Container Orchestration
- Apache Airflow
- Job Scheduling
- Cloud Monitoring
Timeline
Sr DataEngineer/Team Lead
ECOM SOLTUIONS INC
07.2015 - Current
System Analyst
Radiant soft
03.2014 - 07.2015
ETL Developer
LRTEK LLC
07.2013 - 02.2014
System Analyst
Trinuc LLC
01.2013 - 06.2013
System Analyst
Clear Thought Solutions
06.2012 - 12.2012
Master’s - software engineering
Stratford University
Diploma - Software Engineering
NIIT
Bachelor of Technology - Electronics and Communications
JNTU