Vivek V

• Knowledge of best practices for data integration, including data quality and data governance.
• Proficient in SQL and experience working with large datasets in a Teradata environment.
• Experience with Airflow to schedule, monitor, and manage data pipeline workflows.
• Strong understanding of data warehousing concepts and experience with ETL processes.
• Working with ideation forum in migrating the ETL processes to Azure

Training on SQL , Python, Datawarehousing ,Datastage , ADF and big data technologies.

• Worked with Azure Solutions Architects to implement an architecture/flow for both Data Warehousing and Analysis Services using different Azure resources.
• Migration of data from OnPrem storage to synapse using Azure Data Factory Pipelines. Input pipelines are designed to pick data as csv, parquet, JSON and delta formats from On-prem location to ADLS gen2 storage accounts and various levels of curation and wrangling are applied on data. Databricks notebooks are created for curation activities. Transformed files are finally written to synapse using azure Data Factory.
• Tableau and powerBI data modelling and customisation.
• Designing, developing and test data, data transformation and mappings Python, SQL queries.
• Working with dynamic groups, taking part in brainstorming to reach optimal solutions.