Summary
Overview
Work History
Education
Skills
Certification
Accomplishments
Areas Of Interest
References
Work Availability
Quote
Timeline
Generic

Nizamuddin Khazi Syed

Boerne,USA

Summary

Dynamic and results-oriented Data engineer with a strong 16+ years of experience with a diverse skill set in architecting business centric data solutions that power strategic business decisions. Combines business acumen with technical prowess and leadership excellence to craft highly integrated, scalable, innovative data solutions. Familiar with all aspects of the development lifecycle and proficient in data modeling, Data profiling, Performance tuning, Code optimization, Python and Shell Scripting, Database technologies. Passion for Analytical Thinking, a knack for Critical problem-solving, and a willingness to take calculated risks. Strong interpersonal skills and history of mentoring team members to excel in the data engineering field.


My expertise extends across various facets:

  • ETL Data Integration
  • ELT Data Integration for Cloud Data platform using dbt (data build tool)
  • Cloud Data Platform Architecture
  • Snowflake Data Engineering
  • Building data pipelines to process semi-structured/structured data
  • Python and Shell scripting.
  • Leadership, Quality Assurance, Security and Compliance.


Overview

17
17
years of professional experience
1
1
Certification

Work History

ETL Lead

Populus Group
San Antonio, TX
05.2018 - Current
  • Lead onsite and offshore team in migrating the existing applications into snowflake cloud warehouse
  • Responsible for providing strategic solutions/mentoring team members to refactor the existing SQLs into dbt leveraging Jinja Macros
  • Collaborated with Data Analysts, data engineers and stakeholders to understand and translate requirements into data pipelines
  • Designed and developed data pipeline using dbt
  • Built data transformation logic by developing SQL scripts to transform data from Snowflake into structured data models
  • Created reusable Jinja Macros in dbt for data validation
  • Developed both Singular and Generic tests to ensure the data pipelines built are accurate and implemented best practices to ensure data quality
  • Developed documentation by creating "overview" and "docs" markdown files and by updating documentation on all the resources/models in dbt
  • Involved in setting up the dbt cloud environment, CICD pipeline to promote code across multiple regions.
  • Also created, data dictionaries, data lineage, process flow diagrams
  • Created data pipelines to automatically transfer data from flat files to snowflake database using Snowpipe/ Snowflake streams in to Data Lake in snowflake warehouse.
  • Created and scheduled snowflake tasks that identifies data from the snowflake streams and ingests data into tables in business layer.
  • Created snowpark udfs to automatically push data from data lake into Snowflake warehouse.
  • Worked closely with the Project Management team for coordinating, scheduling and implementing the project
  • As a member of data warehouse design team, assisted in creating facts and dimension tables based on requirement of the project
  • Possess good knowledge in auto insurance domain and participated in architectural design strategy meetings and proposed several ETL solutions and best practices based on the expertise gained from prior experience
  • Perform as active, leading role in shaping and enhancing overall ETL Informatica architecture
  • Assist and verify design of effort led by other team members and production of all design phase deliverables
  • Expertise in implementing complex Business rules and possesses good hands-on experience to build robust ETL designs with less to no maintenance cost and use of pushdown optimization as applicable for load balancing
  • Possess good knowledge in performance tuning of SQL overrides to Source qualifiers/lookup sql overrides
  • Extensive use of Shell scripting to speed up development process by creating several reusable Unix shell scripts
  • Responsible for facilitating load testing and benchmarking the developed product with the set performance standards
  • Created Control-M jobs with well-defined pre-requisite conditions for the current requirement. Actively participated in Walkthrough meetings with end users, senior product owners and Subject Matter experts
  • Involved in updating and maintaining metadata for the new attributes added and defined data lineage
  • Involved in Release activities, planning and implementation of ETL/Unix components
  • Prepared ETL Documentation, user manuals, wiki pages, presentations, trained users
  • Involved in warranty support
  • Ensured compliance with standard software development practices, processes and enterprise standards

Lead Developer

PROBYS Inc
Columbus, OH
11.2017 - 04.2018
  • Actively involved in gathering requirements from end users, involved in modifying various technical and functional specifications in the development
  • Built a centralized warehouse to meet all the auto policy needs for business on Amazon Redshift database.
  • Demonstrated knowledge of dimensional data models and involved in creating and modeling tables in Amazon red shift and also worked on improving the performance on the existing tables by adding distribution and sort keys
  • Possessed good knowledge on Amazon Redshift explain plan and provided performance tips which significantly dropped overall execution time
  • Possess good Insurance knowledge which helped me in tuning several long running jobs by routing the Quote data traffic to Amazon S3 bucket as well as filtering out the mid Quote version data from all the lookup cache overrides which significantly reduced lookup cache build time
  • Provided Performance Tuning methods in Informatica with large volumes of data load
  • Created persistent lookup Cache on several dimensions which reduced the overall execution time by 40%
  • Conducted unit testing of the components to identify any potential defects and fix them during unit testing and system testing
  • Responsible to facilitate load testing and benchmarking the developed product with the set performance standards
  • Prepare validation results and walkthrough with business during story Demo’s.

Senior ETL Developer

Populus group
San Antonio, TX
01.2015 - 10.2017
  • Interacted with the business people and database administrators to identify the business requirements and data realties and involved in modifying various technical and functional specifications in the development
  • Good understanding of logical and physical database model design
  • Participated in the entire Software Development Life Cycle (SDLC) phases including Data Analysis, Design, Coding, Testing and Deployment
  • Created several UNIX shell scripts utilizing NZSQL and NZLOAD utilities to recover any failed loads or for any historical fixes of data in warehouse or mart
  • Created UNIX scripts to automate to archive host files using gzip/bz2 compression algorithms
  • Responsible to lay out architecture for standardizing the data load into Hive through Automation process.
  • Worked on UNIX shell scripts for data ingestion into Hive utilizing Sqoop (Thoosa) framework
  • Demonstrated experience with ETL process exception handling, event triggering, and event notification and experience analyzing ETL performance
  • Possess good knowledge on how to fix data historically, especially in pure dimensions and facts
  • Coordinated with source team/business and facilitated in developing scenarios for unit test plans and executed the unit test plans to identify any potential defects, and fix them in flight
  • . and maintaining metadata to help data lineage for stakeholders.

Senior I.T. Engineer/Associate

Cognizant U.S technologies
Jersey City, NJ
11.2013 - 12.2014
  • Co-ordination with customers and getting the requirements
  • Responsible for building and maintaining Customer data warehouse on Teradata.
  • Demonstrated knowledge of dimensional data models
  • Running Fast load, Multiload, and TPUMP Scripts to recover failed loads and provided Performance Tuning methods in Informatica with large volumes of data load
  • Implemented Persistent cache lookup
  • Involved in Defect fixes, creating unit test plans and peer reviews, Warranty Support and code migration and release activities
  • Involved in Onsite and Offshore coordination to ensure the completeness of Deliverables

I.T Analyst

TATA Consultancy Services
San Antonio, TX
03.2011 - 10.2013
  • Migrated existing warehouse and mart from DB2 to Netezza database and strategized to migrate 1800+ jobs.
  • Developed reusable utilities that facilitates for smooth migration and easy backout procedures in case of potential failures
  • Developed a framework to validate data and data grain across warehouse tables (360 degree check) using UNIX shell scripts and through Informatica Concurrent pipeline execution.
  • Conducted trainings on Netezza and developed best practices.


Systems Engineer

TATA Consultancy Services
Chennai, INDIA
04.2007 - 02.2011
  • Requirements gathering and created A&Ds, S2Ts, HLDs and LLDs, warranty support documentation like O&M and level -3 hand-off documents.
  • Developed and tested ETL components as well as coordinated efforts with other team members with Assignments/Troubleshooting / Peer reviews/ validations /walkthroughs etc
  • Created reusable Datastage containers and Informatica mapplets, parameter sets using in built transformations and developed Type 1 & 2 SCD mappings and created SFTP scripts for file transfers
  • Code migration, Release activities and warranty support.

Education

Skills

  • Dbt cloud, Informatica PowerCenter 10x/9x/8x, DataStage 11x/9x/8x
  • Snowflake, Snowpark, Snowflake data ingestion tools(Snowpipe/Stages/Streams/tasks etc), Netezza,IBM DB2 UDB, Oracle, SQL Server, Teradata, IBM Infosight’s Hadoop, Hive, BIGSQL Amazon Redshift, AWS S3
  • Python, SQL, UNIX Shell Scripting, HTML
  • Control-M cloud/9x/8x/7x
  • Gitlab, CICD, AWS, Openshift
  • Jira, IBM Rational Team Concert (RTC), Starteam
  • Waterfall & Agile
  • ETL/DataWarehouse, BI report validation, Data Migration, System & Integration, Regression, UAT Testing, Performance Testing
  • UNIX, XP/WIN-7/10/11
  • Athena (metadata mgmt), Microsoft Analysis Services, VISIO, SAP BO, Beeline, Slack

Certification

  • Dbt certified Data Analyst Engineer.
  • IBM Certified Solution Developer - InfoSphere DataStage v8.5
  • IBM Certified Database Associate DB2 Universal Database V8.1 Family
  • Big DATA 101 and Hadoop 101 cognitive class certificate

Accomplishments

  • Certificate of Appreciation (06/21/2013): Awarded by the client IT technical manager for outstanding performance and lasting contribution for Netezza Migration project.
  • Certificate of Appreciation (12/03/2012): Awarded by the client IT technical manager for exceptional dedication and hard work.
  • Service and Commitment award (April’10; April’12): Awarded for completing 3 and 5 years of service.
  • Star of the Month award (01/13/2011): received for dedication and commitment.
  • Certificate of Appreciation (Sep’2010): Received from the project manager of a different team for providing technical support to his team members.
  • Technical Excellence Award (10/23/2009): received for achieving technical excellence in my field and for outstanding contribution to the organization.
  • Part of Blue-Chip Team: Me, being the only contractor in a team of four were awarded together as Blue-chip team, were responsible for providing technical solutions for various problems within the data space. Being part of this team, itself was an honor.

Areas Of Interest

dbt, Machine Learning.

References

Available on request

Work Availability

monday
tuesday
wednesday
thursday
friday
saturday
sunday
morning
afternoon
evening
swipe to browse

Quote

The future is made of the same stuff as the present.
Simone Weil

Timeline

ETL Lead

Populus Group
05.2018 - Current

Lead Developer

PROBYS Inc
11.2017 - 04.2018

Senior ETL Developer

Populus group
01.2015 - 10.2017

Senior I.T. Engineer/Associate

Cognizant U.S technologies
11.2013 - 12.2014

I.T Analyst

TATA Consultancy Services
03.2011 - 10.2013

Systems Engineer

TATA Consultancy Services
04.2007 - 02.2011

Similar Profiles

CREATE PROFILE
Nizamuddin Khazi Syed