Lakshmisri Selvaraj
Franklin,TN
Summary
7+ years of experience in Information Technology with a strong background in application development. 4.5+ years of experience in BIG DATA Hadoop Administration and Development. Experience in Performance tuning and benchmarking of Hadoop Cluster. Experience in Monitoring, maintenance and troubleshooting of Hadoop cluster. Experience in Security integration of Hadoop Cluster. Good knowledge on Kerberos Security. Experienced in configuring, installing, upgrading and managing MAPR, Apache & Hortonworks Hadoop Distributions. Hands on experience in analyzing log files for Hadoop and eco-system services and finding root cause. Hands on experience in Installing, Configuring and managing the Hands on experience in analyzing log files for Hadoop and eco-system services and finding root cause. Experience with DATA migration from oracle to HDFS, Sqoop and HBase. Experience on Commissioning, Decommissioning, Balancing, and Managing Nodes and tuning server for optimal performance of the cluster. Experience in understanding the security requirements for Hadoop and integrating with Kerberos authentication infrastructure- KDC server setup, creating realm /domain, managing. Understanding in SSSD(System Secutiry Services Daemon) and have troubleshoot some major bugs on the environment.
Overview
7
7
years of professional experience
1
1
Certification
Work History
Cloudera/EMR Administrator
Tech Mahindra Americas, USA
05.2023 - Current
- Responsible for Administer On-Prem Cloudera Data Platform and Cloudera Data Science workbench
- Working on AWS Elastic MapReduce migration
- Raised AWS support cases for any EMR issues
- Recreated instances and performed validation
- Ensured Tableau Desktop connectivity to EMR Hive services
- Explored Ranger setup in EMR
- Configured Solr services in EMR environment
- Utilized Snowball and Datasync services for on-premises data transfer to S3 buckets
- Used IAM services for role-based and group-based access control
- Stored table data and code using S3 services
- Maintained a Bitbucket repository for storing all tenant code and bootstrap scripts.
- Frequently inspected production area to verify proper equipment operation.
- Developed effective improvement plans in alignment with goals and specifications.
- Optimized customer experience by delivering superior services and effectively troubleshooting issues.
Big Data Developer
Tech Mahindra Americas, USA
12.2021 - 05.2023
- EQUIP is Analytics project which will provide single solution to replace many existing systems and tools in TCS/FQI group and are used to make essential decisions and perform day to day operations and increase user efficiency through performance improvements and it will eliminate existing ALERT and GEARS products and replace them with a single, non-proprietary platform that utilizes Hadoop, Tableau, Data Integration Hub, Oracle, Java, and other supported EA technologies and it will eliminate many Access and Excel based Shadow IS solutions (Such as Task Force) that use ALERT and GEARS as sources, replacing them with maintainable, IS-supported solutions
- Performing data cleansing on daily feed-level data received as files in landing location
- Ingesting cleansed data into Hive using Spark for data manipulation and reporting purposes
- Importing RDBMS data into Hive database using Sqoop
- Performing data analysis and providing query fixes whenever there are issues reported by business
- Debugging files whenever failure occurs to understand root cause of issues and fix them
- Loading data from Hive to Solr collection for Edart application, which utilizes Solr services
- Compiled, cleaned and manipulated data for proper handling.
- Implemented robust monitoring and alerting mechanisms to proactively identify system issues and minimize downtime in production environments.
- Achieved significant cost savings through resource optimization strategies including proper partitioning, indexing, caching, and compression techniques within the big data environment.
- Mentored junior developers on best practices for big data development, resulting in higher code quality and overall team productivity improvements.
- Enhanced data processing efficiency by designing and implementing big data solutions using Hadoop ecosystem tools.
Cloudera Administrator
Tech Mahindra
09.2019 - 12.2021
- NISSAN/Infiniti maintains all data related to Manufacturing, sales and service
- Apart from that are collecting sensor data (TELEMATICS) for data analytics on parts of vehicle
- All data will is collected will be stored using using Hadoop environment by using Hortonworks.This connects which various sources like Informatics, Tableau to get data maintained in Hadoop Cluster
- This uses Hortonworks Hadoop Cluster
- System should support various activities to be performed by Super Admin (Super User) which managed by us
- Upgraded Hortonworks Hadoop cluster from HDP 2.6.5 to CDP (Cloudera Data platform)7.1.4 for development, pre-prod and prod with most of available services in Hadoop Installed System Security Services Daemon on all environments to sync Active Directory directly to cluster and remove local users
- Administered cluster maintenance, commissioning and decommissioning of Data nodes, cluster monitoring, and troubleshooting
- Performed addition/removal of new nodes to existing Hadoop cluster
- Defined cron jobs to automate tasks at desired intervals
- Created policies in Ranger to ensure cluster robustness
- Made cluster available for various data sources for easy data access and ensured all connections were reachable
- Scheduled batch process jobs in cluster and distributed workload evenly
- Set up alerts on Cloudera Manager based on criticality
- Established coding standards for developers, reviewed code, and deployed it across different environments
- Raised support cases to improve cluster stability
- Provided HDFS support and maintenance
- On boarded new Hadoop users/service accounts
- Scheduled, monitored, and optimized performance for application teams to load data in Hive/HBase
- Handled day-to-day support and maintenance activities
- Implemented multiple major enhancements to customize applications according to user needs and delivered them defect-free
- Prepared and recommended technical alternatives involving technology, methodology, tools, processes, and solution components
- Reviewed and promoted code between environments
- Documented standard policies and procedures in BDE admin Confluence space
- Assisted tenants/users in smoothly running scheduled jobs in the environment.
Windows Server Administrator
Tata Consultancy services
02.2017 - 09.2019
- Directory configuration and installation, adding OU and users in server
- Creating Policy for users in GPO and creating script and pushing software through GPO
- DNS Configuration and adding records in DNS
- Configuring DHCP and assigning Reserve IP via DHCP Coordinating with vendors for Hardware / Software issues
- WDS and WSUS server configuration for pushing OS and patch though LAN network
- Managing and monitoring with Symantec Endpoint point security control panel LAN Network Troubleshooting and giving file sharing access for 500 Employees
- Ticket logging and coordinating with user , vendors to resolve issues Updating patches, troubleshooting and helpdesk activities for day-to-day operation
- Configuring, managing & securing resources (Users, Printers and Folders) Maintaining and troubleshooting 10 servers and 250 desktops and 100 Workstations using applications.
- Conducted training sessions for junior administrators on Windows Server management techniques, fostering professional growth within team.
- Developed comprehensive documentation on server administration procedures, contributing to efficient knowledge transfer within IT team.
- Delivered outstanding end-user support by quickly resolving escalated Windows Server-related issues.
- Performed software installations and upgrades to UNIX or Windows operating systems.
- Performed network security design and integration duties.
- Devised scripts and automation tools to improve system efficiency.
- Identified and resolved network congestion issues and bottlenecks.
- Analyzed complex project server issues and worked on large enterprise and business-critical applications.
- Analyzed network traffic and performance metrics to optimize system performance.
- Implemented, developed and tested installation and update of file servers, print servers and application servers.
- Maintained flexible schedule and responded to after-hours and weekend emergencies.
- Planned and implemented upgrades to system hardware and software.
Education
Master of Computer Application -
Sri Sai Ram Engineering College, Anna University
Chennai,India06.2016
Bachelor of Computer Application -
Women’s Christian College, University Of Madras, Chennai
India04.2014
Hsc Commerce,Accountancy,Maths&Computer Science -
Fatima Matriculation Higher Secondary School, Chennai
India03.2011
SSLC -
Ebenezer Matriculation Higher Secondary School,
Chennai,India03.2009
Skills
- Apache Spark
- Python Programming
- Shell scripting
- Big Data Architecture Hadoop,Yarn,Hive,Sqoop,Apache oozie,HBase )
- Data Migration ( AWS Snowball and Datasync services)
- Data repositories(Bitbucket and Tortoise SVN)
- Apache Solr
- AWS Services ( EMR, Trino, Steps Function,IAM,S3)
- SQL Databases
Certification
- Microsoft Certified System Administrator (MCSA certification)
- Microsoft Certified Professional (MCP certification)
- AWS solution Architect Associate
Timeline
Cloudera/EMR Administrator
Tech Mahindra Americas, USA
05.2023 - Current
Big Data Developer
Tech Mahindra Americas, USA
12.2021 - 05.2023
Cloudera Administrator
Tech Mahindra
09.2019 - 12.2021
Windows Server Administrator
Tata Consultancy services
02.2017 - 09.2019
Master of Computer Application -
Sri Sai Ram Engineering College, Anna University
Bachelor of Computer Application -
Women’s Christian College, University Of Madras, Chennai
Hsc Commerce,Accountancy,Maths&Computer Science -
Fatima Matriculation Higher Secondary School, Chennai
SSLC -
Ebenezer Matriculation Higher Secondary School,
Similar Profiles
RAVI KUMAR RAVIRAVI KUMAR RAVI
Director of Service Delivery at Tech Mahindra (Americas) IncDirector of Service Delivery at Tech Mahindra (Americas) Inc
Lokesh C DineshLokesh C Dinesh
Lead Quality Assurance Analyst at Tech Mahindra Americas Inc.Lead Quality Assurance Analyst at Tech Mahindra Americas Inc.
Esha ParadkarEsha Paradkar
DevOps Engineer at Tech Mahindra Americas Inc. (Client - AT&T)DevOps Engineer at Tech Mahindra Americas Inc. (Client - AT&T)