Hi, I’m
SHERA SINGH PATEL
SRE / Sr. Big Data Lead
Charlotte,NC
Summary
Highly motivated and results-oriented IT professional with over 10 years of experience in designing, developing, and implementing robust data solutions across diverse cloud environments (AWS, Azure). Proven expertise in all phases of the data lifecycle, from data ingestion and transformation to advanced analytics and reporting. Deep knowledge of Big Data technologies, data warehousing methodologies, and cloud migration strategies. Skilled in leveraging Tableau for data visualization and BI solutions, including dashboard development and server administration. Demonstrated ability to effectively collaborate with cross-functional teams, communicate complex technical concepts to both technical and non-technical audiences, and drive projects to successful completion. Possesses strong analytical and problem-solving skills with a continuous drive for learning and professional growth.
Overview
10
years of professional experience
Work History
Visa Inc.
Staff Site Reliability Engineer / Sr.Big Data Lead
06.2023 - Current
Job overview
- Responsible to Perform Big Data Administration and Engineering activities on multiple opensource Hadoop, Kafka, HBase and Spark clusters
- Strong Troubleshooting and debugging skills
- Cross-team teamwork, build and maintain relationships with the customer teams, the user community, architects, and engineering teams, jointly work on key deliverables ensuring production scalability and stability
- Effective Root cause analysis of major production incidents and developing learning documentation
- Identify and implement HA solution for services with SPOF
- Plan and perform capacity expansion and upgrades in timely manner avoiding any scaling issues and bugs
- Automation of repetitive tasks to reduce manual effort and avoid Human errors
- Tune alerting and setup observability to proactively identify the issues and performance problems
- Work closely with L-3 teams in reviewing new use cases, cluster hardening techniques for building a robust and reliable platform
- Leverage Dev-OPS tools, disciplines (Incident, problem and change management) and standards in day to operations
- Ensure the Hadoop platform can effectively meet performance and SLA requirements
- Perform security remediation, automation and selfheal as per the requirement
Cloudera, Inc.Charlotte, North Carolina
Sr. Hadoop Admin / Solutions Architect
01.2022 - 06.2023
Job overview
- Working on various projects which includes CDH to CDP migration, Security Setup, Planning and Optimizing their existing infrastructure
- Responsible for the implementation and support of the Enterprise Hadoop environment
- Independently engaged with business leaders to understand market specific levers and constraints
- Setting up Hadoop Backup, whitelist, and blacklist data nodes in a Cluster
- Experience of Service Monitoring, Service and Log Management, Auditing and Alerts, Hadoop Platform Security, and Configuring Kerberos
- Identify key business problems and proactively identify opportunities for cost and utilization improvements
- Involved in designing, capacity arrangement, cluster setup, performance fine-tuning, monitoring, structure planning, scaling, and administration
- Installed and configured production and development clusters on Azure Cloud with latest Cloudera Version CM/CDH 7.1.7
- Worked with the application teams to overcome the challenges faced post upgrade
- Deployed the Hadoop cluster in a cloud environment with scalable nodes as per the business requirements
- Automated the day-to-day activity using Ansible and Shell scripts
- Configured and deployed all the security updates in the platform including user authentication and authorization for all the CDH, CDP and CM Services
EquitableCharlotte, North Carolina
Sr. Hadoop Admin / Architect
08.2018 - 01.2022
Job overview
- Responsible for maintaining the application availability, monitoring, backup and recovery setup
- Architected application servers to communicate with different networking tiers for inbound and outbound calls
- Provided solutions related to Cloud System Enterprise, Cloud System Automation, Cloud System, and hybrid solutions of UNIX, Linux VMware/Microsoft, Networking etc
- Extensively used angular.js user interface software to display bitcoin and other cryptocurrencies in multiple web browsers
- Created wrapper scripts in python and java to execute different application models
- Designed business claim forums for customers on application portal to improve customer feedback
- Setup real time streaming of data for various source systems and prepare business transaction report
- Created new Linux servers and apply OS, Java and Security related patches on quarterly basis
- Interacting with Client and Business team to understand the requirements and act as an Onshore Coordinator for Offshore team
- Working with Django framework and create web APIs in the JSON format using REST Architecture
- Worked with release management teams for the production deployments and adhere to the organization security compliances
- Experience working on security tools like LDAP, Sentry, ACL, Kerberos, Active Directory for user Authentication and Authorization
- Resolving tickets submitted by users related to any technical issues, platform issues, incidents, deployments
- Provide design guidance across a range of system and application technologies, ensuring solutions are aligned with the enterprise architecture vision and meet with technical standards
- Working with data governance team and governance tools to generate lineage between multiple source systems
Pro-Tek ConsultingFremont, CA
Sr. Hadoop Admin / Engineer
11.2014 - 08.2018
Job overview
- Installed and managed Hadoop production cluster with 50+ nodes with storage capacity of 10PB with Cloudera Manager and CDH services version 5.13.0
- Worked on setting up Data Lake for Mobile Data all the way from Data Ingestion, Landing Zone, Staging Zone, ETL Frameworks and Analytics
- Worked on architecture design, data modeling, and implementation of Big Data platform and analytic applications for various products
- Managed all the user tickets related to cluster issues and handled them with perfection within SLA
- Working with data delivery teams to setup new Hadoop users
- This job includes setting up Linux users, setting up Kerberos principals, ACL Implementation, Service Accounts etc
- Expertise in Installing, Configuration and Managing RedHat Linux 4, 5, 6 & Centos Linux 6.5
- Developed Shell and Python scripts to automate the jobs, metadata backups, log purge etc
- Enabled HA for Name Node, Resource Manager, Yarn Configuration and Hive Meta store Server
- Worked on Flume Kafka and Kafka Spark integration to store live events and logs in HDFS
- Worked on setting automated processes to analyze the System and Hadoop log files for predefined errors and send alerts to appropriate groups
- Worked on configuring Zookeeper to provide high availability and Cluster services coordination
- Setting up quotas and replication factor for user/group directories to keep the disk usage and cluster resource consumption under control using HDFS quotas and Dynamic Resource Pool
Education
Northwestern Polytechnic UniversityFremont, CA
MS
12.2015
Jaipur National UniversityJaipur, India
B.Tech.
05.2014
Skills
- Docker
- Kubernetes
- Continuous Integration
- Cloud-Watch
- AWS Cloud Formation
- Blockchain
- EC2
- Dynamo DB
- Ripple
- Microsoft Azure
- Redshift
- R-Studio
- Jupyter Hub
- Hadoop
- CDH 4x/5x/6x
- CDP 7X
- Cloudera Manager
- Cloudera Search
- MapReduce 10/20
- Pig
- Hive
- Phoenix
- Oozie
- Zookeeper
- Sqoop
- Avro
- Kafka
- Spark
- Flume
- Storm
- Impala
- Scala
- Mahout
- Hue
- Kerberos
- Sentry
- Yarn
- Mongo DB
- RHEL 5x
- 6x
- 7x
- 8x
- CentOS
- Linux
- Rocky Linux
- UNIX
- MacOS
- Windows
Timeline
Staff Site Reliability Engineer / Sr.Big Data Lead
Visa Inc.
06.2023 - Current
Sr. Hadoop Admin / Solutions Architect
Cloudera, Inc.
01.2022 - 06.2023
Sr. Hadoop Admin / Architect
Equitable
08.2018 - 01.2022
Sr. Hadoop Admin / Engineer
Pro-Tek Consulting
11.2014 - 08.2018
Northwestern Polytechnic University
MS
Jaipur National University
B.Tech.
Similar Profiles
Srujan KSrujan K
Staff Software Test Engineer (QA Lead) at Visa Inc.Staff Software Test Engineer (QA Lead) at Visa Inc.
Arun Kumar GuptaArun Kumar Gupta
Director (Global Product, Business Strategy & Operations, GTMS Services) at VISA Inc.Director (Global Product, Business Strategy & Operations, GTMS Services) at VISA Inc.
Brian McGroryBrian McGrory
Vice President – Merchant Sales and Acquiring – Australia, NZ and South Pacific (AuNZSP) at Visa Inc.Vice President – Merchant Sales and Acquiring – Australia, NZ and South Pacific (AuNZSP) at Visa Inc.
Vineela JagarlamudiVineela Jagarlamudi
Sr. Software Test Engineer at Visa Inc.Sr. Software Test Engineer at Visa Inc.
Samantha CottonSamantha Cotton
Manager at Mellow MushroomManager at Mellow Mushroom