
Overall, 5 years of IT experience in Big Data and Cloud (Azure). Hands on experience in cloud based big data ETL/ELT application phases like data ingestion/loading, data curation, data analytics. Extensive experience in Azure cloud: Azure Data Factory v2, Azure Databricks, Azure Synapse Analytics, Azure Storage Account, ADLS gen2, Azure Logic App, etc. Expert in Spark components like Spark Core Programming and Spark SQL. Expert in using Mapping data flows to process complex JSON files and load into SQL Tables. Experience in the Implementation of Logic App. Have knowledge on Python programming. Involved in Design and Development of Spark based ETL jobs to process and enrich data from SAP source and store it into ADLS system. Involved in getting and refining requirements from Client and developing PySpark SQL notebooks to process the raw data. Developed common utility functions to promote code re-usability across multiple teams. Extensive experience on Performance tuning of Spark jobs to reduce the cost and time of processing. Experience with Azure DevOps (VSTS) to transit the code from Dev to higher environments. Implemented ACL in azure data lake store gen2. Resolved bugs and work stoppers environmental issues during QA testing, pre-production, and production. Excellent problem-solving skills with a strong technical background and result-oriented team player with excellent communication skills. Worked in Agile team and experience in providing the work progress update to customer on daily basis. Ability to work independently to recommend/develop solutions in global projects. Ability to adopt the changing needs of organizations to learn new technology and leverage new skill sets. Self-driven and self-motivated individual and lead the teams to achieve deliveries.
Emerson, Global Online Store(GOS), Azure Data Engineer, Microsoft Azure, ADF, ADB, ADLS Gen2, Azure Synapses, Azure DevOps, Pyspark, SQL, Power BI, Emerson is a leading global technology, software, and engineering company providing innovative solutions for customers in industrial and commercial markets. We help customers in the world’s most essential industries solve the biggest challenges of modern life. Every day, our global workforce fulfills our unified Purpose and lives out the Values we hold close as an organization: Integrity, Safety & Quality, Support Our People, Customer Focus, Continuous Improvement, Collaboration, and Innovation. Across the globe, we are united by a singular Purpose: We drive innovation that makes the world healthier, safer, smarter, and more sustainable., Connect to business team and gather the requirements., Designing Azure pipelines to pull data from different sources like MS SQL, ORACLE & MY SQL and storing the data into ADLS segregating the sources., Developed the pyspark notebooks to transform the data as per business requirement., Creating the external tables in Dedicated SQL pool., Involved in Development of Python wheel packages to process the data from Data Lake., Folder Segregations in ADLS to distribute data according to source and Market- Market Segregation., Used Azure DevOps to deploy code into higher environments., Design and Build of Azure Synapse Pipelines, stored proc and Power BI reports. PostNord, PostNord, Azure Data Engineer, Microsoft Azure, ADF, ADB, ADLS Gen2, Azure DevOps, Pyspark, SQL, Power BI, PostNord AB is a provider of postal services operating mainly in the Nordic countries. The company was formed on 24 June 2009, under the name Posten Norden, as the holding company in a merger between the Danish and Swedish postal service providers Post Danmark A/S and Posten AB., Connect to business team and gather the requirements., Designing Azure pipelines to pull data from different sources like MS SQL, ORACLE & MY SQL and storing the data into ADLS segregating the sources., Developed the pyspark notebooks to transform the data as per business requirement., Creating the external tables in Dedicated SQL pool., Involved in Development of Python wheel packages to process the data from Data Lake., Folder Segregations in ADLS to distribute data according to source and Market- Market Segregation., Used Azure DevOps to deploy code into higher environments., Using Unity catalog in ADB. Bank of Cyprus, Cynergy Bank, Azure Data Engineer, Microsoft Azure, Azure Synapse Analytics, ADLS Gen2, Azure DevOps, PySpark, Power BI, Cynergy Bank was established following the acquisition of Bank of Cyprus UK by Cynergy Capital Limited in December 2018. Cynergy Bank Limited is authorized by the Prudential Regulation Authority and regulated by the Financial Conduct Authority and the Prudential Regulation Authority. Eligible deposits with Cynergy Bank Limited are protected by the UK Financial Services Compensation Scheme. At Cynergy Bank they understand that how they customers' life work and money often overlap. With a track record dating back to 1955 and committed to delivering a comprehensive set of services to meet the evolving needs of our customers from our offices. They are a bank focused on customers, people and relationships., Connect to business team and gather the requirements., Designing Azure pipelines to pull data from different sources like MS SQL, ORACLE & MY SQL and storing the data into ADLS segregating the sources., Developed the pyspark notebooks to transform the data as per business requirement., Creating the external tables in Dedicated SQL pool., Folder Segregations in ADLS to distribute data according to source and Market- Market Segregations., Azure Synapse is used as an orchestrator to schedule these as jobs., Used Azure DevOps to deploy code into higher environments. Axis Bank, Banking, Data Engineer, Microsoft Azure, PySpark, SQL, Power BI, Axis Bank is the third largest private sector bank in India. The Bank offers the entire spectrum of financial services to customer segments covering Large and Mid-Corporates, MSME, Agriculture and Retail Businesses. The Bank has a large footprint of 5000 domestic branches (including extension counters) with 15,751 ATMs & cash recyclers spread across the country. The Bank has 6 Axis Virtual Centres with over 1,500 Virtual Relationship Managers as on 31st March 2023. The Overseas operations of the Bank are spread over eight international offices with branches in Singapore, Dubai (at DIFC), and Gift City-IBU; representative offices in Dhaka, Dubai, Abu Dhabi, Sharjah and an overseas subsidiary in London, UK. The international offices focus on Corporate Lending, Coverage Business, Trade Finance, Syndication, Investment Banking, Liability Businesses, and Private Banking/Wealth Management offerings., Connect to business team and gather the requirements., Designing Azure pipelines to pull data from different sources like MS SQL, ORACLE & MY SQL and storing the data into ADLS segregating the sources., Developed the pyspark notebooks to transform the data as per business requirement., Creating the external tables in Dedicated SQL pool., Design and Build of Azure synapse Pipelines., Azure synapse is used as an orchestrator to schedule these as jobs., Involved in Development of Python to process the data from Data Lake., Folder Segregations in ADLS to distribute data according to source and Market- Market., Used Azure DevOps to deploy code into higher environments.