Mereb Ahmed

TechbrothersIT is an IT Solution provider with a primary focus on delivering technology-based solutions to meet the specific needs of businesses, organizations, and individuals by providing innovative and tailored IT solutions.They further provide support to their clients for ongoing issues. As a Data Engineer, I worked with clients from various industries, including industrial, medical, and educational, serving their needs in the field of SQL querying, Microsoft Azure PaaS, and Azure Data Factory.My primary responsibilities included going on call with clients alongside Senior Engineers, recreating test scenarios to troubleshoot clients failing pipelines or sql code, creating data solutions such new etl workloads that would utilize sql code and various etl components in order effectively extract data, transform data, and load data.

• Knowledge of creating tables, stored procedures, triggers, user-defined functions, and views in SQL Server Management Studio (SSMS) as per requirement.
• Experienced in both DDL and DML, including joins, functions, indexes, views, constraints, primary key, foreign key, etc.
• Ability to code and optimize queries in T-SQL.
• I have created an external stage of Azure Blob storage to extract data and load it into a Snowflake table using Copy Into in Snowflake.
• Applied various business logic to clean, convert, and validate the data using string functions, analytical functions, data conversion functions, mathematical functions, and user-defined functions.
• Experienced in working on Jira, managing timesheets in Jira, and responding to tasks assigned to me.
• Designed a comprehensive stored procedure leveraging advanced techniques, such as the merge statement, UNION ALL, inner join, and left join, to efficiently load new data, merge it with existing records, and eliminate duplicates.
• Optimized stored procedures and T-SQL queries to improve database performance by implementing indexes, utilizing joins instead of subqueries, and applying other performance-tuning techniques.
• Understanding how to collaborate with the reporting team and a basic understanding of MS Power BI.
• Created tables, stored procedures, triggers, user-defined functions, and views in SQL Server Management Studio (SSMS) as per requirement.
• Developed and deployed SQL Server Integration Services (SSIS) packages to automate data import/export between SQL Server, Excel, and various flat file formats (CSV, tab-delimited, pipe-delimited, fixed-width, raw files, etc.), with custom configurations and workflows.
• Designed SSIS packages to load data from sources like Excel, Access, and flat files into destinations such as OLE DB and flat file outputs.
• Experienced in implementing data modeling designs, such as Star schema and Snowflake schema, in data warehouses.
• Experience in normalization (1st, 2nd, 3rd form) and denormalization for effective and optimal performance in OLTP and OLAP environments.
• Expertise in dimensional data modeling in Slowly Changing Dimension (SCD) Type 1, Type 2, and Type 3 for required Dimension and Fact tables.
• Created different linked services for Azure SQL Database, Azure Blob Storage, Azure Data Lake Storage Gen2, etc.
• Created Azure Data Factory pipelines with activities such as Copy Data, Lookup, ForEach, Data Flow, Execute SSIS package, Execute Pipeline, Delete, etc.
• Developed and maintained Azure Data Factory pipelines for data integration and orchestration across multiple sources and destinations for example from On Prem SQL to Azure Data Lake Storage Gen2, file store to Azure Blob Storage, Excel to Azure SQL Database, etc
• Designed a comprehensive stored procedure leveraging advanced techniques, such as the merge statement, union all, inner join, left join, ROW_NUMBER() to efficiently load new data and merge it with existing records, update existing data in the destination table, delete from the destination table that which does not match the source, and remove duplicates
• Designed pipelines in ADF which utilized various types of data movement, data transformation, and control flow activities such as Copy Activity, Data Flow Activity, and ForEach Activity
• Implemented scheduled triggers on pipelines to run them on a daily, weekly, or monthly basis as per requirement, and monitored pipelines running on scheduled triggers in ADF
• Built dynamic Azure Data Factory components by using parameters and variables in pipelines and datasets
• Used Append Variable activity in Azure Data Factory to add new values to existing variables in order to update data dynamically within pipelines
• Handled error rows in Azure Data Factory using Mapping Data Flows by using conditional split transformation and redirecting faulty rows to a log file in blob storage, while writing the good rows to destination
• Set up dynamic file retrieval in Azure Data Factory by using the Get Metadata activity to list file names based on their file extension and specified prefix from the source folder and the ForEach activity to process each file name
• Automated the deletion of old files from storage in Azure Data Factory to manage storage efficiently by using Get Metadata Activity and Foreach Loop with Delete Activity
• Experience in creating linked services and datasets for pipelines to extract and load data from various systems like flat files, parquet files, JSON files, csv files, SQL Server database, Azure Blob Storage, and Azure SQL Database for full and incremental loads
• Monitored ADF pipelines set on triggers for execution status, providing failing runID to MS support, and duration
• Designed and tested ADF pipelines in an Azure DevOps working branch then created pull requests for merging changes to the master branch
• Experience in creating a new database in Azure SQL Managed Instance as per business requirement
• Exported and imported ARM Template of ADF pipeline to create/restore ADF pipeline
• Copied multiple files from source container in Azure Blob Storage to destination container and deleted in source container using ADF pipeline