
Enthusiastic Data Engineer eager to contribute to team success through hard work, attention to detail and excellent organizational skills. Clear understanding Task and training in Big Data Related skills. Motivated to learn, grow and excel in Data Engineering Domain.
Apache Sqoop
Apache Hive
Spark
Scala
Apache HBase
Control-M
SQL
AWS
Project Name: BLAAD CLO
Roles and Contributions:
1. Ingested Data from multiple sources like MySQL, Oracle.
2. Created and worked on Sqoop jobs with incremental load.
3. Designed external tables in Hive.
4. Developed Spark code in Scala to process the data.
5. Performed best optimization technique throughout the code.
6. Creating HBase layer to facilitate fast reporting.
Project Name: Customer Mastering Program
Roles and Contributions:
1. Worked on Hive queries for creating and querying HIVE tables to retrieve useful analytical
information.
2. Creation and data loading in Hive tables and analysis of the data over them.
3. Dumb data to HBase from HDFS for all the policy records.
4. Analyzed the defect and provided fix whenever needed.
5. Used Sqoop to import large data from traditional RDMS to HDFS and also handled incremental Sqoop.
Used Control-M automate the jobs.