Experienced Azure Data Engineer & Software Engineer at UBS Business Solutions US LLC with proven experience in SQL, Azure Data Factory, Azure Data Bricks, PySpark, C#, WPF, React. Proven background in designing, building, and optimizing big data solutions. Skilled in analyzing complex data sets and developing creative solutions. Detail-oriented team player with strong organizational skills. Ability to handle multiple projects simultaneously with a high degree of accuracy.
• Experienced Azure Data Engineer and Software Engineer over 6 years of experience with proven skills in software development, database design, and data engineering.
• Experience on Migrating SQL database to Azure data Lake, Azure data lake Analytics, Azure SQL Database, Data Bricks and Azure SQL Data warehouse and controlling and granting database access and migrating On premise databases to Azure Data Lake store using Azure Data factory.
• Experience in Developing Spark applications using Pyspark in Databricks for data extraction, transformation, and aggregation from multiple file formats for analyzing & transforming the data to uncover insights into the customer usage patterns.
• Created Azure SQL database, performed monitoring and restoring of Azure SQL database. Performed migration of Microsoft SQL server to Azure SQL database.
• Good Understanding of Azure Big data technologies like Azure Data Lake Analytics, Azure Data Lake Store, Azure Data Factory and creating POC in moving the data from flat files and SQL Server using U-SQL jobs.
• Designed complete scalable data pipelines, data warehouse for optimized data ingestion.
• Highly proficient in developing and deploying applications and solutions on the Microsoft Azure platform.
• Analyzed data to identify glitches and cleaning it to reduce the distortions.
• Experience in working with version control systems GIT Bash, GitHub, GIT Lab.
• Collaborated with data scientists and architects on several projects to create data mart as per requirement.
• Designed and implemented data integration pipelines using Azure Logic Apps and Azure Functions, resulting in a reduction in data processing time.
• Experience in building data pipelines using Azure Data factory, Azure Databricks and loading data to Azure data Lake, Azure SQL Database, Azure SQL Data warehouse and controlling and granting database access.
• Experienced working in matrixed project teams employing software engineering principles such as design patterns, versioning software, continuous integration, automated deployments and automated test tools.
• Worked collaboratively as a developer with the User Interface team working on strategic projects, enhancing a well appreciated UI Framework in the Credit Risk IT department responsible for turning business requirements into technical designs, development of new features and supporting the platform and maintaining its high quality.
• Developed windows based applications using WPF, MVVM, Data Binding, Mocking libraries, Unit testing frameworks such as NUnit -advanced asynchronous and multi-threaded programming,SQL.
• Designed and developed user interfaces and web applications using React JS, HTML, CSS, and JavaScript
• Involved to work on issue tracking tools such as JIRA , made use of Git versioning, Github code reviews and developed software in a collaborative environment.
• Experience with front-end libraries and frameworks such as Redux and familiarity with back-end technologies such as Node JS.