MOHAMMED SHAHID
Seattle,USA
Summary
Senior Data engineer with more than a decade of experience- well versed in Cloud (AWS/Azure), ETL, Big data, Model development and training in Machine Learning, Databases, Streaming, Application Development, Product experience on Cloud and Advanced level in Kafka, Spark.
Dedicated champion of open-source initiatives, actively contributing to community-driven projects and fostering collaboration to advance technology and innovation. Seeking data science/engineering related work in exciting product-based big-data/AI companies.
Overview
11
11
years of professional experience
1
1
Certification
Work History
Sr. Cloud Data Platform Engineer
Snowflake Inc.
10.2022 - Current
- I designed and built efficient data pipeline and workflows for customer, focusing on scalable ETL processes and ensuring data integrity
- Reproduce and test complex use-cases of customers- sometimes diving down deep into the product, OS level to find the root cause
- Creating knowledge articles, training materials based on my thorough testing of product, conducting brown-bad sessions, and brainstorming within my core team.
- Played a pivotal role in developing scalable machine learning models for production using EMRs, Python, and PySpark. Enhanced model accessibility for business analysts through parameter customization, resulting in a 23% increase in analytical efficiency.
- Utilized SQL queries and internal tools to enhance the storage and retrieval of terabytes of data in Snowflake and OneLake databases, resulting in savings of over $2800 per month.
- Worked closely with data scientists, support engineers, and project managers to integrate new features and enhance workflows.
Customer Operations Engineer
Confluent Inc
09.2021 - 10.2022
- Designing and Setting up real-time data streaming solutions with Apache Kafka and Spark Streaming
- Troubleshooting and investigation complex cases, and Kafka cloud outage.
- Drafting up KB articles, conduction training, mentoring junior engineers.
- Designed and developed Enterprise-wide standardized Jenkins pipelines that streamlines the deployment process, provisions infrastructure in AWS, and accommodates automated testing and quality scans.
- Managed AWS infrastructure for non-serverless applications, achieving 99.95% uptime and reducing latency by 40%.
- Developed auto-scaling solutions that boosted performance by 50% during peak traffic periods.
- Provided extensive support to over 200 developers, assisting with onboarding onto specific pipelines and ensuring smooth operations.
Customer Operations Engineer
Cloudera Inc.
07.2019 - 09.2021
- Specialties: Handling Priority 1 cases for mainly Kafka, Spark and Nifi
- Responsible for driving cases on Product related issues from customer engineering teams
- Providing best practices and configs to customers to tune the cluster for optimal performance
- Troubleshoot technical issues- Software/hardware/network/security
- Handling highly critical and complex cases for customers and providing guidance on maintaining high availability in Clusters
- Mentoring new hires in frontline team across the globe to upskill their kafka/nifi/yarn knowledge and handle cases efficiently.
Senior Staff Java Software Engineer
Cazablaze Info Solutions
03.2013 - 05.2018
- Writing and maintaining program code to automate repeated tasks to reduce manual hours and mistakes
- Effectively involved in query designing, database related operations and enhancing the performance of existing database by adopting performance tuning measures
- Organized formal workshops for clients to provide better understanding of added functionality after each release, in three months
- Executing complete lifecycle software development (being a developer for Transight (an IEEA award winning application)- a novel fleet management solution with satellite tracking system, GPS Transmitter and highly interactive users interface in both online and offline mode.
- Write well-structured programs in Java and C++,
- Performing code reviews, UT/IT reviews
- Executing technical tasks that include requirements, design, code and unit test activities
- Integrating software components into a fully functional software system
- Developing software verification plans and quality assurance procedures
- Documenting and maintaining software functionality
Education
Bachelor of Technology in Computer Science and Engineering -
MAHATMA GANDHI UNIVERSITY
01.2012
Skills
- Python
- Machine Learning Concepts
- Kafka SME
- Software Development, Data Structures and Algorithms
- Cloud Infrastructure Management, Cloud Storage and Services
- Metadata Management, API Design and Development, Distributed Systems, Monitoring and Alerting, and Application Debugging
- Spark (SparkSQL, Streaming, PySpark)
- Snowflake
- Strong security skills- TLS/SSL, MIT Kerberos, RBAC, Network protocols
- OS- Linux (RHEL, CentOS, Ubuntu)
- Strong n/w troubleshooting skills
- DATABASE: Snowflake, MySQL
- Good theoretical and hands-on Docker and Kubernetes experience managing K8 clusters
- CORE PROGRAMMING: Python, Java, C and C (Object oriented)
- VERSION CONTROL, Incident Management tool and SDLC: Git, JIRA, Agile (Scrum)
- CI/CD Pipelines: Ansible
- CORE PROGRAMMING: Python, Java, C, C
- VERSION CONTROL, Incident Management tool and SDLC: Git, JIRA, Agile
Certification
- Confluent Certified Developer for Apache Kafka
- Confluent Certified Administrator for Apache Kafka
Timeline
Sr. Cloud Data Platform Engineer
Snowflake Inc.
10.2022 - Current
Customer Operations Engineer
Confluent Inc
09.2021 - 10.2022
Customer Operations Engineer
Cloudera Inc.
07.2019 - 09.2021
Senior Staff Java Software Engineer
Cazablaze Info Solutions
03.2013 - 05.2018
Bachelor of Technology in Computer Science and Engineering -
MAHATMA GANDHI UNIVERSITY
Similar Profiles
Derrick BohnDerrick Bohn
Enterprise Account Executive at Snowflake Inc.Enterprise Account Executive at Snowflake Inc.
Harsha JasminHarsha Jasmin
Internal Audit Senior Analyst - Business at Snowflake Inc.Internal Audit Senior Analyst - Business at Snowflake Inc.
Alice IrvinAlice Irvin
Senior Technical Evangelist at SnowflakeSenior Technical Evangelist at Snowflake
Romeo KaizerRomeo Kaizer
Internship Year at Judetean County Hospital & Affiliated ClinicsInternship Year at Judetean County Hospital & Affiliated Clinics
Racheal MorganRacheal Morgan
Material Handler/ Ramp Agent at Federal ExpressMaterial Handler/ Ramp Agent at Federal Express