PALLAVI BHARDWAJ
Data Engineer
Stamford,Connecticut
Summary
Results-driven Data Engineer with over 7 years of experience in designing and optimizing data pipelines and architectures. Expertise in GCP migration projects utilizing BigQuery, SQL, and Python to significantly enhance data processing efficiency. Proven ability to lead seamless data migrations and conduct comprehensive Proof of Concepts (POCs) across diverse technologies. Strong collaboration skills foster effective communication across teams, ensuring alignment on project objectives and successful outcomes.
Overview
12
12
years of professional experience
Work History
Data Engineer
Ascendion
USA
08.2022 - Current
- Company Overview: Client - Aetna
- Spearheaded a large-scale GCP migration project, successfully transitioning the company's data infrastructure to the cloud
- Worked on migrating GCP tenants from shared to their own compute projects in order to monitor expenses and utilization and improve the estimation of their business budget
- Refactored existing on-premises code to Airflow DAGs, leveraging BigQuery and Python for efficient data processing
- Developed and optimized SQL queries to extract, transform, and load data from various sources
- Conducted numerous POCs involving FTP, Dataproc, and other technologies to evaluate their suitability for specific use cases
- Led the data migration effort, ensuring data integrity, security, and compliance throughout the process
- Collaborated with cross-functional teams to ensure accurate data migration and to resolve other dependencies for smooth migration process
- Automated the process to validate and compare tables migrated by two different tools for data migration team
- Automated the data ingestion process using Dataproc, ingesting data from BigQuery to various databases.
- Provided training and mentorship to team members, fostering knowledge sharing and professional growth
- Participated in agile development processes, contributing to sprint planning, stand-ups, and reviews to ensure timely delivery of data projects.
- Optimized SQL queries and database schemas for performance improvements in data retrieval operations.
- Designed, constructed, and maintained scalable data pipelines for data ingestion, cleaning, and processing using Python and SQL.
- Implemented data visualization tools like Tableau and Power BI to create dashboards and reports for business stakeholders.
- Developed Python scripts for extracting data from web services API's and loading into databases.
Sr. Data Analyst - Datacenter Services
NIIT Technologies Pvt. Ltd (COFORGE)
Noida, India
01.2018 - 01.2019
- Company Overview: Client - British Airways
- Monitored brand mentions and reviews across various platforms, performing sentiment analysis using Python libraries (Beautiful Soup, TextBlob) for brand monitoring and reputation management
- Created interactive Tableau dashboards to showcase sentiment analysis, identifying friction points and improving customer perception, resulting in a ~10% increase in conversion rate
- Analyzed 3 million records of airline data using SQL to create reporting dashboards in Power BI, highlighting KPIs from various operational aspects for stakeholders
- Worked on a pilot project to develop fraud triggers using historical data to flag high-risk transactions and identify drivers of fraud bookings
- Led a team of 5 data analysts, compiling daily, weekly, monthly, and annual reports, and conducting ad hoc data mining for executive leadership
- Analyzed complex datasets to identify trends and patterns.
Data Analyst | Software Developer
Premier Logic (Acquired by Alten Cal Soft labs)
Noida, India
01.2014 - 01.2018
- Company Overview: Client - Imarticus Learning, Jubi, DGC
- Developed and implemented comprehensive solutions for multiple Customer Relationship Management (CRM) campaigns, facilitating seamless outreach to customers across various channels, including email, web, and mobile, tailored to meet client-specific requirements
- Presented findings and insights through visualizations and written reports to stakeholders
- Developed a full-stack online learning platform using PHP, MySQL, and Angular, featuring secure user authentication, course management, interactive learning modules, and gamification elements
- Created an interactive data visualization dashboard using Tableau and Python to analyze student performance data, identify learning gaps, and provide actionable insights to educators and administrators
- Designed and developed a learning platform with two distinct dashboards: one for instructor and another for students, featuring real-time data updates and interactive visualizations
- Automated the process of fetching student results every 30 minutes and updating the database and instructor's dashboard, ensuring timely access to up-to-date information
- Client - Imarticus Learning, Jubi, DGC
Research and Development Engineer
MRM Procom
Faridabad, India
01.2013 - 01.2014
- Embedded System Design Based Projects and Electronics Hardware Based Projects: Hardware & Firmware Designing, Project Monitoring & Testing
- Developed protocols like CAN, Modbus, and USB for microcontrollers used for communication
Education
Big Data Analytics Ontario College Graduate Certificate -
Georgian College
Barrie, Canada01-2022
PG Diploma - Embedded Systems and Design
Centre For Development of Advanced Computing
Hyderabad, India01.2013
Bachelor of Technology - Electrical and Electronics
Maharshi Dayanand University
Rohtak, India08-2012
Skills
- Python
- SQL expertise
- Spark framework
- Big data processing
- BigQuery
- Airflow
- Dataproc
- Cloud Storage
- ETL development
- Power BI
- Tableau
- PowerPoint
- Git
- Data migration
- Scripting languages
Accomplishments
Client Whisperer Award
- 2024 | Awarded by Aetna
- Recognized for exceptional client relationship management and high satisfaction rating among over 200 nominees.
Timeline
Data Engineer
Ascendion
08.2022 - Current
Sr. Data Analyst - Datacenter Services
NIIT Technologies Pvt. Ltd (COFORGE)
01.2018 - 01.2019
Data Analyst | Software Developer
Premier Logic (Acquired by Alten Cal Soft labs)
01.2014 - 01.2018
Research and Development Engineer
MRM Procom
01.2013 - 01.2014
Big Data Analytics Ontario College Graduate Certificate -
Georgian College
PG Diploma - Embedded Systems and Design
Centre For Development of Advanced Computing
Bachelor of Technology - Electrical and Electronics
Maharshi Dayanand University
Similar Profiles
Ardhendu TripathyArdhendu Tripathy
Manager - Engineering (Business Analyst) at ASCENDIONManager - Engineering (Business Analyst) at ASCENDION
Elija Rajesh MavuriElija Rajesh Mavuri
Associate Director at AscendionAssociate Director at Ascendion
STEPHEN DORAIRAJSTEPHEN DORAIRAJ
Senior Data Steward – MDM & Governance at AscendionSenior Data Steward – MDM & Governance at Ascendion
Lipsa MuniLipsa Muni
Senior Talent Acquisition Specialist at AscendionSenior Talent Acquisition Specialist at Ascendion
Kathleen PisciottaKathleen Pisciotta
First and Second Grade Teacher at North Stratfield Elementary SchoolFirst and Second Grade Teacher at North Stratfield Elementary School