BATCHU VISHNAVI

Dynamic Data Engineer with 1.5 years of experience in Python, PySpark, and SQL. Demonstrated success in implementing data-driven solutions that achieve cost savings and enhance operational efficiency. Skilled in building and optimizing data pipelines while delivering actionable insights for impactful projects. Aiming to contribute expertise to a forward-thinking organization focused on business growth.

• Microsoft Certified: Azure Data Fundamentals (DP-900)
• Databricks DataEngineer Associate
• Databricks Lakehouse Fundamentals

Project 1: Restricted Party Screening(RePS)

Technology Stack: Azure Databricks, Azure Data Factory, ADLS Gen2, Blob Storage 

Role: Data Engineer

• The purpose of this project is to screen all the Suppliers and Parties (End Customers) with whom any kind of trade is happening across countries and would like to screen the trading relationship.
• Any matching or potentially matching list of Suppliers or Parties with that of the Government released list would be scrutinized and decisions would be taken accordingly whether to cut off any future trade or not.
• The Government list is maintained by a third-party entity called as E2Open (also called Trade Automation TA).
• Azure Databricks is our ETL platform to develop the code in Pyspark and spark SQL and Python.

Project 2: Customs Clearance Agents (CCA)
Technology Stack: Azure Databricks, Azure Data Factory,  ADLS Gen2, Blob Storage

Role: Data Engineer

• This project aims at calculating customs duties and payments done at the port of entries for the trade happening at international levels. It also aims to calculate potential duty and custom savings at agents’ and broker’s level.
• Apart from that, this project also aims at checking what percentage of the shipment were on time in different modes of transport (like air, water, and land) based on the defined thresholds.
• The primary users of the end reports will be field managers / point of contacts at regional and country level to understand the overall duty and customs being paid for each of the declaration numbers and lines.
• Some of the reports will also give them idea on the Potential Duty Savings had it they applied some of the existing policies and treaties between two countries participating in the trade.
• This report will also aim to identify blockages in the overall package (declaration number plus line) cycle in terms of checking if arrival times, declaration time and release times are within thresholds and in check for different modes of transports like air, water, land and overall.
• Developed ETL pipelines to manage constrained and unconstrained deployment data.
• Hands on experience on Azure data bricks, Azure data factory, Azure Blob, ADLS
• Implement data quality checks and validation mechanisms to identify and address data anomalies and inconsistencies and Ensure compliance with data governance policies and data security standards.