Proficient Data Engineer with 5+ years of experience in developing and optimizing ETL pipelines, data integration, and automation using IBM DataStage, Python, and Teradata. Expertise in managing large datasets, creating visual insights with Tableau, and automating workflows with Shell Scripting. Proven track record of delivering efficient, scalable data solutions across healthcare and telecom industries.
Overview
1
1
year of professional experience
Work History
Associate-Projects
Cognizant Technology Solutions, CTS
Hyderabad, Telengana
07.2022 - 12.2023
In my role as a Senior DataStage Developer, I was responsible for the design, development, and optimization of ETL jobs, ensuring seamless data integration for Health Care Service Corporation (HCSC). My work focused on creating high-performance data solutions, collaborating with cross-functional teams to deliver business-critical results in a fast-paced environment.
Key Responsibilities:
Designed, developed, and optimized ETL jobs using IBM DataStage, including advanced stages such as Sequential Files, Dataset, Copy, Funnel, Pivot, Join, Lookup, and Transformer. Implemented efficient data pipelines that ensure data integrity and high availability.
Utilized Tableau to create dynamic dashboards and data visualizations, delivering actionable insights to key business stakeholders.
Automated repetitive tasks using Python and Shell Scripting, improving operational efficiency and reducing manual intervention.
Managed complex queries in Teradata for large-scale data extraction, transformation, and loading, optimizing database performance and ensuring the stability of ETL workflows.
Conducted Unit Testing and Integration Testing, and monitored job performance using Control-M and Zena Workstation for smooth operations.
Developed web services for real-time job integration using Information Server Console, enhancing the scalability and performance of data workflows.
Led code reviews and maintained comprehensive technical documentation to ensure best practices and continuous process improvements.