Saicharan Reddy Ragannagari
DALLAS,TX
Summary
Professional Big Data Engineer with 4 years of industry experience including around 2.5 years of experience in Big Data technologies. Expertise in Hadoop/Spark development experience, automation tools and E2E life cycle of software design process. Outstanding communication skills, dedicated to maintain up-to-date IT skills and industry knowledge.
Overview
7
7
years of professional experience
1
1
Certification
Work History
Data Engineer
Alice Consulting LLC
02.2024 - Current
- Migrated the existing data from Mainframes/Teradata/SQL Server to Hadoop and perform ETL operations on it.
- Designed and Implemented Sqoop incremental imports, delta imports on tables without primary keys and dates from Teradata and appends directly into Hive Warehouse.
- Converted Pig scripts/components of the ETL process (transformations) to Spark API.
- Worked with Avro and Parquet file formats and used various compression techniques to leverage the storage in HDFS.
- Used the Mainframe SerDe's and Avro SerDe's for serialization and de-serialization in hive to parse the contents.
- Written various shell scripts for DI and other error handling and mailing systems (DUSTc).
- Designed and developed ETL workflow using Oozie and automated them using Autosys.
- Worked on on-call production issues - scrubbing, resolve hive query issues, workaround for defects within SLA duration.
Big Data Engineer
Capgemini
06.2019 - 11.2021
- Developed custom UDF's for pig scripts and hive queries to implement business logic/complex analysis on the data.
- Reduced the latency of spark jobs by tweaking the spark configurations and following other performance and Optimization techniques.
- Responsible for loading unstructured and semi-structured data into Hadoop by creating static and dynamic partitions.
- Used Sqoop to import/export data from various RDBMS (Teradata, Netezza, Oracle) to Hadoop cluster and vice versa.
- Configured the Oozie workflows to manage independent jobs and to automate Shell, Pig, Hive and Sqoop etc.
- jobs.
Software Engineer
Omega Healthcare
03.2018 - 04.2019
- Datastage 8.5, Serena, Unix, TOAD, Oracle 10G Sep'10 to Nov '12.
- Translating the business requirements into Datastage jobs.
- Tuned the long running jobs by improving the query performance and reduced the running time of the Datastage jobs.
- Worked with XML transformer and other complex transformations.
- Writing shell scripts to trigger the Data stage jobs.
- Scheduling the Datastage jobs using the ESP Scheduler.
- Pfizer - Cognos 10, TOAD, Unix Nov'12 to Jul '13.
- Develop and validate Reports and Dashborads.
- Scheduling Reports and grant permissions to the reports only to the appropriate users.
- Performed Report and Model Migration.
Education
Master of Science - Computer Engineering
The University of Texas At Dallas
Richardson, TX12.2023
Bachelor of Technology - Electronics and Communications Engineering
Jawaharlal Nehru Technological University
05.2019
Skills
- HDFS, MapReduce, Hive, Impala, Pig Latin, Sqoop, Oozie, YARN, Avro, Parquet,Kafka
- Apache Spark : Spark Core, Dataframes, Spark SQL, Spark Streaming, Scala
- Programming Languages : C, C, JAVA EE, SQL, PL/SQL
- Automation Tools : Python, Shell Scripting, BASH, Autosys
- ETL and Reporting tools : IBM Datastage, IBM Cognos , Crystal Reports
- Management Tools : Cloudera Manager, Hortonworks Ambari, Maven, SVN
Certification
Oracle Certified Java Programmer
Timeline
Data Engineer
Alice Consulting LLC
02.2024 - Current
Big Data Engineer
Capgemini
06.2019 - 11.2021
Software Engineer
Omega Healthcare
03.2018 - 04.2019
Master of Science - Computer Engineering
The University of Texas At Dallas
Bachelor of Technology - Electronics and Communications Engineering
Jawaharlal Nehru Technological University
Similar Profiles
AKSHITHA POKURIAKSHITHA POKURI
Full Stack Developer at Alice ConsultingFull Stack Developer at Alice Consulting
Harold JohnsonHarold Johnson
Maintenance Technician at Alice Wright Properties LLCMaintenance Technician at Alice Wright Properties LLC
COY PAPACHEKCOY PAPACHEK
Sales Representative at Brandon J. Alice & Associates LLC, GreaterSales Representative at Brandon J. Alice & Associates LLC, Greater