Venkata Bora

• Optimized data processing by implementing efficient ETL pipelines and streamlining database design.
• Collaborated on ETL (Extract, Transform, Load) tasks, maintaining data integrity and verifying pipeline stability.
• Fine-tuned query performance and optimized database structures for faster, more accurate data retrieval and reporting.
• Designed scalable and maintainable data models to support business intelligence initiatives and reporting needs.
• Automated routine tasks using Python, Pyspark,Airflow and GCP scripts, increasing team productivity and reducing manual errors.

• Designed and implemented ETL pipelines using AWS services such as AWS Glue and Amazon EMR to process and transform large-scale data sets
• Collaborated with cross-functional teams to define data transformation logic, data integration patterns, and schema evolution strategies
• Orchestrated Spark jobs using Apache Airflow, creating a scalable and automated ETL workflow for timely data processing

• Build data pipelines in airflow in GCP for ETL related jobs using different airflow operators
• Experience in GCP Dataproc, GCS, Cloud functions, BigQuery
• Designed and Co-ordinated with the Data Science team in implementing Advanced Analytical Models in Hadoop Cluster over large Datasets
• Designed and developed ETL Pipeline to extract Shipping Expeditor's API Data into the consumption layer using python
• Created data pipelines and scheduled using airflow to improve the data's reliability and quality while making sure to adhere Data Governance Policies
• Lead the efforts to conduct internal training sessions on GCP/Bigquery within the team

Skills: Gcp, Bigquery, DataFlow, Dataproc, Composer, Python, Pyspark, sparksql, airflow, Hive, Teradata, SqlServer

• SME, Designed and built pipelines to extract and process source files from workday and stored the data on HR data lake using Hive
• Supported HR Business Units by providing data ready to use for data analysts, data scientists for business insights, machine learning etc
• Developed ETL pipeline to extract and load data from ranger into sql server consumption layer using python
• Professional experience in building ETL pipelines to extract data using Spark

Skills: Hive, Teradata, SqlServer, Informix, Hdfs, atomic, Agile, Tableau, Pandas, shell/bash, visio, powerpoint, intellij, scala, Spark, PowerBi, Workday, Json, Xml

• Designed ETL Process from different sources into HDFS/Hive/Teradata using internal aorta(sqoop) framework
• Build ETL Pipelines to extract data from multiple sources/Pos files into Finance Datalake and build a unified consumption layer for business analytics

Skills: Hive, Teradata, SqlServer, Informix, atomic, Agile, Tableau, Pandas, shell/bash, visio, powerpoint, intellij, scala, Spark, PowerBi, Workday, Json, Xml

• Played an integral role in developing Client Proposal Integrator application to validate data from multiple systems, and authored Spark SQL scripts based on functional specifications
• Seamlessly imported and exported data into HDFS, HIVE using Sqoop
• Actively participated in creating Hive tables and writing multiple Hive queries to invoke and run MapReduce jobs in the backend

Skills: Pl Sql, Sql Server, shell/bash, visio, powerpoint

• Contributed to the development of Prepaid Card system for National Banks by methodically creating database objects such as tables, stored procedures etc
• Identified, examined, and resolved issues by modifying backend code as needed, and performed unit testing of core system and business functionality to ensure adherence to quality criteria

Skills: oracle, unix, pl sql