Accomplished Senior Data Engineer with 12+ years of experience leading projects by acting as architect, developer and programmer analyst. Proficient in supporting project deliverables and maintaining releases. Strong leader in guiding support teams and solving complex issues. Steadfast in planning and
implementing effective development strategies based on industry best practices.
Overview
16
16
years of professional experience
1
1
Certification
Work History
Senior Data Engineer
THE NIELSEN COMPANY
05.2018 - Current
Contributed to the architecture design of complex software systems, ensuring scalability and maintainability.
Reengineered existing ETL workflows to improve performance by identifying bottlenecks and optimizing code accordingly.
Developed a robust PySpark framework deployed on
AWS and optimized costs by leveraging cloud-based resources effectively, resulting in a significant
performance boost.
Implementing Serverless Event-Driven Architecture using Lambda.
Designed Apache Airflow DAGs for workflow management to schedule and execute end-to-end data pipelines efficiently.
Lead and completed the migration of multiple Hadoop projects to AWS by leveraging the power of PySpark for greater agility and cost efficiency.
Implemented a suite of highly effective Spark performance tuning techniques.
Utilize CI/CD tools and Git for automating the build process,
enhancing efficiency and consistency in development workflows.
Maintain version control to track changes and ensure seamless collaboration within the development team.
Streamlined development processes by incorporating agile methodologies and continuous integration practices.
Reduced system downtime by conducting rigorous testing and addressing critical bugs promptly.
Mentored junior developers, providing guidance on best practices and coding techniques for improved productivity.
Delivered high-quality code on time by effectively managing project timelines and prioritizing tasks accordingly.
Documented code thoroughly, facilitating ease of understanding for other team members during maintenance cycles or future updates.
Conducted comprehensive code reviews, ensuring adherence to established coding standards and improving overall code quality.
Spearheaded the successful migration of legacy systems to modern platforms without compromising functionality or data integrity.
Participated in troubleshooting efforts, efficiently isolating root causes of issues and implementing effective solutions quickly.
Established clear communication channels between developers, QA testers, and stakeholders resulting in better collaboration leading to faster delivery of key features.
Senior Software Developer
University Of California Office Of The President
11.2017 - 04.2018
Created web-based applications for departments section.
Design and implement database-driven web sites.
Developed dynamic web sites by building MySQL databases, writing code (in PHP, Smarty, HTML, CSS and JQuery), performing testing, and writing system documentation.
Provides technical support for ancillary web-related applications provided by IT.
Worked on migrating old web applications into PHP 5.6.
Coordinated technical architecture with Data Center personnel on changes to web servers and web-site related technical matters such as software and hardware upgrades, architectural changes and connectivity issues.
Involved in testing upgrades to ensure that production services remain available after technical changes to hardware and software.
Managed Git repository, code merging, and production deployments.
Used JIRA/Agile board to track development, migration and testing issues.
Collaborated with cross-functional teams to integrate software components seamlessly into existing systems.
Senior Software Developer
EBay Inc
01.2017 - 10.2017
Developed back end components for web applications and WordPress CMS based websites.
Experience in build and maintain custom VPC instance
Optimized application for maximum speed and scalability.
Used JavaScript to display RESTful data.
Responsible for Stability and Security of WordPress applications.
Developed a backup and recovery strategy for MySQL & Oracle databases, configured and created scripts to backup database to C3 cloud environment.
Backup automation using Shell Script and cron tab.
Fixed Bugs with the help of Jira (Bug Tracking System).
Used all aspects of PHP Programming and MySQL.
Clear understanding of the entire project life cycle including Analysis, Design, and Development.
Worked on PHP 5.6, MySQL, HTML5, CSS3, Ajax, JavaScript, jQuery, and WordPress on Windows and Linux operating systems.
Responsible for creating the navigation menu and sub menu in the site using CSS, HTML and jQuery.
Designing in HTML5, DHTML, CSS3, JavaScript and jQuery for making website more attractive.
Managed Git repository, code merging, and production deployments.
Used JIRA/Agile board to track development, migration and testing issues.
Created C3 VPC instances, install LAMP stacks, deploying and maintaining C3 VPC instances.