Janane Venugopal
Frisco,TX
Summary
IT professional with over 10 years of experience at Cognizant Technology Solutions, specializing in AWS and GCP cloud services. Certified Databricks Spark Developer with extensive hands-on experience in building data pipelines and managing Big Data ecosystems. Proficient in Python, PySpark, and SQL for processing large datasets, with a strong background in Agile methodologies and CI/CD practices. Collaborated with cross-functional teams to integrate various data sources while maintaining high-quality standards. Strong analytical skills contribute to delivering impactful data-driven solutions.
Overview
18
18
years of professional experience
1
1
Certification
Work History
Data Engineer
CVS Health
TX
05.2020 - Current
- Acquired a comprehensive understanding of the 340B claims business process.
- Collaborated with data scientists and analysts to understand data requirements, define data models, and deliver processed data for analytical and reporting purposes.
- Designed, developed, and maintained robust and scalable ETL pipelines using PySpark on Google Cloud Platform (GCP), specifically leveraging Dataproc for distributed processing of large datasets.
- Reviewed code for compliance with standards, and implemented necessary changes.
- Migrated historical data from on-premises systems to GCP BigQuery using the internal EDM tool.
- Develop and maintain robust data pipelines to extract data from Snowflake and load it into various GCP services, primarily Google Cloud Storage (GCS), and potentially BigQuery.
- Implemented access controls and role-based permission to restrict unauthorised access to sensitive data.
- Implemented Slowly Changing Dimension (SCD) Type 2 to keep track of historical data.
- Configured Secret Manager to pass secrets securely to batch jobs, protecting sensitive configuration data during deployment and execution.
- Executed business transformations using PySpark data frames and Spark SQL.
- Scheduled and monitored jobs while configuring DAGs in Cloud Composer.
- Verified code changes to ensure seamless continuity of business processes.
- Automated system maintenance tasks using scripting languages like Python reduce manual effort.
Big Data Developer
Toyota (TMNA)
TX
07.2019 - 05.2020
- Designed and developed components for data transformation framework supporting ETL processes.
- Migrated structured and semi-structured data to Hadoop using TBDP framework for ETL operations.
- Executed Sqoop imports from Oracle to update Hive Data Warehouse with full and incremental data.
- Implemented transformation logic for Supplier module utilizing PySpark for enhanced processing.
- Created Bitbucket repository for code management, facilitating migration across Dev, QA, and Prod environments.
- Redesigned Data Quality framework, transitioning from IDQ to Spark jobs for improved performance.
- Developed and automated ETL workflows with Oozie Coordinator to enhance operational efficiency.
- Monitored job performance within AMS team, addressing failures to maintain system reliability.
Associate Projects
PayPal
Chennai, India
04.2011 - 05.2012
- Collaborated with client and project manager to understand KB product requirements (risk recoveries module) and collaborated with team members to design and execute test scenarios and test cases and attained good test coverage.
- Designed and developed automation scripts using the Selenium WebDriver and TestNG framework, converted manual test cases into automation test scripts, and developed test scripts for data-driven testing.
- Executed functional and regression tests to ensure new enhancements meet functional requirements, and documented the defects to track them to closure, which ensured the delivery of a quality product on schedule.
- Coordinating with the team members on a daily basis and updating the status to the client resulted in meeting the deliverable milestones.
Programmer Analyst
Intuit
, India
03.2010 - 04.2011
- Developed functional test scenarios and cases for CFB application module, ensuring seamless MRI integration.
- Executed functional, integration, ad-hoc, and exploratory testing to enhance overall test coverage.
Programmer
Intuit
, India
11.2007 - 03.2010
- Analyzed requirements and identified and executed the Smoke, Feature, System, Database and Regression testing test cases and successfully completed the end to end testing on time.
- Documented the test results in HP Quality Center and ensured the quality of the product.
Education
Master of Computer Application -
Anna University
Chennai, IndiaSkills
- Cloud platforms: GCP and AWS
- Data processing: BigQuery, DataProc, and Cloud Storage
- Data orchestration tools: Apache Airflow, Cloud Composer
- Scripting languages: Python and SQL
- Big data technologies: HDFS, Hive, Spark, and Kafka
- CI/CD tools: Jenkins
- Project management: JIRA and Rally
- Version control: Git and Perforce
- Databases: Teradata and SQL Server
Certification
- AWS Certified Cloud Practitioner
- AWS Certified Solution Architect
- Databricks Certified PySpark Developer
Timeline
Data Engineer
CVS Health
05.2020 - Current
Big Data Developer
Toyota (TMNA)
07.2019 - 05.2020
Associate Projects
PayPal
04.2011 - 05.2012
Programmer Analyst
Intuit
03.2010 - 04.2011
Programmer
Intuit
11.2007 - 03.2010
Master of Computer Application -
Anna University