My expertise includes hands-on experience with Azure Cloud Services, Azure Synapse Analytics, SQL Azure, Azure Data Factory, SQL, SAS, and data management. Experience on migrating on premise databases/files to Azure cloud environment using Azure Data factory. Experience in data bricks using python, spark and spark SQL for data extraction, transformation, and aggregation from multiple file formats for analysing & transforming the data to uncover insights into the customer usage patterns. Good understanding of Spark Architecture including Spark Context/Session, Spark SQL, Data Frames, Spark Streaming, Driver Node, Worker Node, Stages, Executors and Tasks. Orchestrated data integration pipelines in ADF using various Activities like Get Metadata, Lookup, For Each, Wait, Execute Pipeline, Set Variable, Filter, stored procedure, until etc. Experienced in implementing data validations using Pyspark. Experienced in scheduling data bricks notebooks using data bricks jobs. Experienced in implementing audit logs in every notebook. Experienced in implementing the exception handling and logging in every data brick notebook. Experienced in implementing dynamic notebooks using notebook parameters. Developed pyspark code for data cleansing like trimming of columns and duplicate checks. Knowledge on data pipelines and dependencies in Azure Data Factory for efficient data copying between Sources and destination. Strong capabilities in data manipulation, cleansing, profiling, and scrubbing, ensuring data quality and accuracy. Thorough understanding of cloud and big data technologies, including Azure Data Factory, Azure Databricks, Spark Architecture, and Structured Streaming. Experience in various phases of the Software Development Life Cycle (SDLC), including planning, requirement analysis, design, development, testing, implementation, and support. Enhanced tableau reports, showcasing adaptability in visual data representation and reporting. Conducted exploratory data analysis using SQL queries, providing valuable insights for strategic decision-making. Played a pivotal role in the migration process, contributing to mapping efforts and ensuring seamless transitions. Extensive collaboration with Business Partners, Statisticians, and key stakeholders, providing SAS programming for data analysis and reporting. Executed validation and trend checks on generated reports, ensuring data Accuracy and compliance. Reviewed metadata to enhance understanding of database tables, supporting data mapping and analysis efforts. Applied SAS and SQL to pull, filter, and validate data, supporting various ad hoc queries from cross-functional teams. Traveled onsite for report transition purposes, showcasing a commitment to project success. Enabled stakeholders with actionable insights through intuitive performance reporting, responding to business requests effectively. Demonstrated strong skills in Data Analysis, Requirement Analysis, and Data Mapping for diverse business processes. Ran SQL queries for analysis teams, providing essential data for in-depth insights and decision support. Detail-focused Data Analyst with knowledge in data warehousing, process validation and business needs analysis. Proven to understand customer requirements and translate into actionable project plans. Dedicated and hard-working with passion for Big Data.
· Excellent experience working on Health Care Systemsand applications.
· Hands on experience working on Waterfall Model as well as Agile Model, implementation of various sprint.
· Experience in Microsoft Power BI and Tableau reports, dashboards and publishing them to the end user to make decisions.
· Interacted with end-users and functional analysts to identify and develop Business Requirement Documents (BRD) and transform it into technical requirements.
· Supported team using techniques in Microsoft Excel and working knowledge of Visual Basic for Applications (VBA), Power BI, and Data Analysis Expressions (DAX)
· Expertise in tuning the performance of Mappings and sessions in Informatica and determining the Performance bottlenecks.
· Enhancements to existing dashboards to improve capabilities and expand insights as well as creation of new dashboards.
· Extracted and analyzed data using Power Query, PivotTablesand created different types of charts like pie chart, bar chart, tree map etc. in Power BI and Excel to provide data visualization.