Experienced Lead Big Data Administrator with over 9 years of hands-on expertise in leading & managing large-scale Hadoop ecosystems (HDP/CDH) in production environments. Skilled in cluster setup, performance tuning, and implementing enterprise-grade security using Kerberos, Ranger, and LDAP. Proven ability to automate administration tasks using Shell and Ansible, while ensuring high availability, compliance, and data integrity across multi-tenant environments and a Certified AWS Solutions Architect. Experienced in Microsoft Azure and Familiarity with GCP.
Overview
9
9
years of professional experience
1
1
Certification
Work History
Application Architect(Computer Systems Analyst)
Artech LLC
Chicago, IL
01.2026 - Current
Designed and implemented scalable application architectures to enhance system performance in Big Data ecosystems.
Managed platform operations across all environments, including upgrades, bug fixes, deployments, metrics and monitoring for resolution and forecasting, disaster recovery, and incident, problem, and capacity management
Served as a liaison between client partners and vendors, in coordination with project managers, to deliver technical solutions that address user needs.
Work with technologies including Hadoop, Kafka, Spark, Impala, Hive, HBase, and related components.
Integrate solutions with other applications and platforms outside the core framework.
Collaborated with cross-functional teams to define technical requirements and project scope.
Led architectural reviews to ensure alignment with industry standards and best practices.
Applied automation and DevOps tools including Ansible, Jenkins, Bitbucket, Github etc
Managed Hadoop ecosystem services such as Hive, HBase, Pig, Sqoop, and Oozie.
Scheduled and monitored Hadoop jobs using Oozie and controlled job priorities in YARN.
Integrated Kerberos authentication for securing the Hadoop cluster.
Integrated Spark applications with Hive Metastore and HDFS, ensuring schema consistency and metadata management.
Lead Hadoop/Cloud Administrator
Baigan Solutions
Toronto, Ontario, Canada
03.2020 - 11.2025
Managed, Installed, configured, and maintained Hadoop clusters including HDFS, YARN, and MapReduce.
Performed regular cluster health checks and monitored node status using various monitoring tools.
Enforced encryption at rest using HDFS Transparent Data Encryption (TDE) and in-transit using TLS/SSL, enhancing protection of sensitive data across ingestion and processing layers.
Performed data backup and recovery using DistCp, rSync and Snapshots.
Collaborated with security and compliance teams during internal and external audits.
Provided expert-level application and system support for data and analytics tools (e.g., Tableau etc), including troubleshooting, patching, and vendor coordination to resolve complex issues.
Participated in capacity planning and hardware expansion by analyzing usage trends.
Diagnosed and resolved issues related to DataNode failures, HDFS corruption, and YARN job crashes.
Managed Azure resources including virtual machines, storage accounts, and virtual networks.
Monitored resources using Azure Monitor, Log Analytics, and custom alerts to ensure availability and performance.
Configured and secured Azure Storage (Blob, File, and Table) for application and analytics needs.
Hadoop Administrator
Elan Technologies
Austin, TX
04.2019 - 01.2020
Install, Configure and maintain Multi-node Hadoop clusters.
Involved in installation, configuration, supporting and managing Hadoop Clusters using Cloudera Distributions Hadoop (CDH) and Hortonworks Distribution (HDP).
Responsible for all configuration changes and applying patches on the cluster.
Configured Apache Ranger policies for HDFS, Hive, and Yarn, enabling fine-grained, role-based access control aligned with data governance and compliance requirements.
Responsible for all customer issues linked with Big Data Hadoop cluster during onshore hours and providing support through service now ticketing tool for various severity tickets.
Hands on experience on Cluster monitoring tools like Cloudera Manager and Ambari.
Configuring SQOOP to import data from external database - MYSQL.
Worked with both Shell and Bash Scripting languages to automate day to day activities.
User management on Hadoop for HDFS and Map Reduce.
Supported technical team members for automation, installation and configuration tasks.
Work with user to resolve issues related to access and jobs running on cluster.
Imported/exported data from RDBMS to HDFS using Data Ingestion tools like Sqoop.
Commissioning and Decommissioning nodes to Hadoop cluster.
Linux/Hadoop Administrator
NPV Staffing/Emergsoft LLC
Bellevue, WA
01.2017 - 04.2019
Monitored system performance and resource utilization using tools like top, vmstat, and iostat to identify and troubleshoot bottlenecks.
Assisted with user and group account management, including permissions, quotas, and SSH key configurations.
Performed routine log reviews in /var/log and applied basic troubleshooting to resolve common errors and service issues.
Supported patching and package management on RHEL/CentOS and Ubuntu systems using yum, dnf, and apt.
Collaborated with senior administrators to implement and maintain scheduled backups, cron jobs, and disk usage monitoring.
Assisted in configuring and maintaining network services such as DNS, DHCP, and NTP under supervision.
Participated in server provisioning and initial configuration, including hostname setup, network interfaces, and firewall rules (iptables/firewalld).
Provided Tier-1/Tier-2 support by investigating and resolving Linux system incidents escalated from the help desk.
Documented standard operating procedures (SOPs) for common administrative tasks to improve knowledge sharing within the team.
Supported monitoring and alerting tools (e.g., Nagios, Zabbix, or systemd journal alerts) to proactively address service disruptions.
Education
Master of Science - Computer Science
Governors State University
University Park, IL
12-2016
Bachelor of Science - Electrical & Electronics Engineering
JNTU
Hyderabad, India
04-2013
Skills
HDFS (Hadoop Distributed File System)
MapReduce
Pig
Sqoop
Kafka
Flume
Zookeeper
Apache Ranger / Sentry
HDFS Encryption & KMS
Grafana
GCP
DistCp / rsync for Data Transfers
Azure Data Lake / AWS S3 Integration with Hadoop
Autosys
ServiceNow
Jira
Data Ingestion & Export Automation with Sqoop / Flume
Zabbix
NewRelic
Terraform
Apache Nifi
AWS
YARN (Yet Another Resource Negotiator)
Hive
HBase
Linux
Tableau
Nifi
Oozie
Kerberos Authentication
LDAP / Active Directory Integration
Cloudera Manager / Ambari
Shell Scripting (Bash)
Crontab / Scheduled Jobs Management
PySpark
CI/CD with Jenkins
Git / GitHub / GitLab
Ansible
Docker
Jira/Confluence
Python
Kubernetes
DevOps
Microsoft Azure
Apache Spark
Certification
AWS Solutions Architect - Associate
Timeline
Application Architect(Computer Systems Analyst)
Artech LLC
01.2026 - Current
Lead Hadoop/Cloud Administrator
Baigan Solutions
03.2020 - 11.2025
Hadoop Administrator
Elan Technologies
04.2019 - 01.2020
Linux/Hadoop Administrator
NPV Staffing/Emergsoft LLC
01.2017 - 04.2019
Master of Science - Computer Science
Governors State University
Bachelor of Science - Electrical & Electronics Engineering