Ishan Bagchi
Binghamton
Summary
Azure Data Engineer with hands-on experience designing and building cloud-native data platforms using Azure Synapse, Databricks, Data Factory, and ADLS. Skilled at developing scalable, metadata-driven pipelines that support complex ingestion, transformation, and analytics workloads across healthcare environments. Strong track record in structuring data lakes, implementing ELT/ETL frameworks, and optimizing performance for large-volume datasets. Adept at diagnosing data quality issues, validating complex business rules, and partnering with architects and SMEs to deliver reliable, secure, and compliant data solutions. Brings a practical, engineering-first mindset with a focus on automation, observability, and production-ready design.
Overview
7
7
years of professional experience
1
1
Certification
Work History
Software Engineer - Data Engineering
Taxlocity
01.2024 - Current
- Developed end-to-end ETL/ELT workflows using metadata-driven patterns, incorporating orchestration, error handling, logging, lineage tracking, and automated monitoring.
- Implemented curated data models and optimized storage layers in Synapse and Delta Lake, applying best practices in partitioning, indexing, and schema evolution.
- Engineered data lake structures in ADLS Gen2 across raw, staging, curated, and consumption zones, ensuring consistent pipeline flow and secure handling of PHI.
- Performed detailed data analysis across clinical, operational, and financial sources to troubleshoot quality issues, validate transformations, and support analytics and reporting needs.
- Collaborated with solution architects and SMEs to translate business rules into transformation logic and scalable ingestion frameworks.
- Tuned pipeline performance, optimized compute and storage usage, and contributed to continuous improvements in observability, including alerts, job metrics, and pipeline health dashboards.
Solution Engineer
Sensiple
01.2023 - 12.2023
- Developed and implemented technical solutions to enhance client operations.
- Collaborated with cross-functional teams to identify system requirements and optimize performance.
- Analyzed client needs to recommend software solutions aligning with business objectives.
- Conducted product demonstrations and training sessions for end-users, ensuring effective utilization.
- Contributed to the development of high-quality software products by collaborating closely with cross-functional teams.
- Provided expert guidance during the pre-sales process, helping drive sales success by demonstrating the value of proposed solutions to prospective clients.
- Developed custom solution proposals for clients by conducting in-depth needs assessments, resulting in tailored offerings that addressed unique challenges and delivered measurable results.
Systems Engineer-AWS Cloud
Tata Consultancy Services
09.2020 - 07.2022
- Migrate projects to AWS cloud using DevOps practices
- Create AWS cloud infrastructure such as EC2 Instances and ECS services using Terraform scripting language and automation tools like Jenkins and Ansible
- Handle database in Couchbase database and manage overall architecture
Application Security Engineer - Intern
Reliance Jio
12.2019 - 02.2020
- Create a test mobile application and test various penetration testing methods using Arachni testing tool
Network Engineer - Intern
Capgemini
12.2018 - 01.2019
- Worked on data centers, tools required in cloud migration and industry level networking across the globe
Education
Master of Science - Computer Science
SUNY Binghamton
Binghamton, NY12.2023
Bachelor of Technology - Electronics and Communication Engineering
SRM Institute of Science and Technology
Chennai, India06.2020
Skills
Data Engineering & Pipeline Development
ETL/ELT design, metadata-driven pipeline architecture, orchestration patterns, incremental and historical data loads, data quality validation, error handling frameworks, logging and monitoring, CI/CD for data pipelines
Programming & Frameworks
Python (PySpark, data processing libraries), SQL (T-SQL, Synapse SQL), Spark, Delta Lake, JSON/XML processing, API integrations
Data Modeling & Architecture
Dimensional modeling, unified data models, schema design, partitioning and indexing strategies, lakehouse architecture, Synapse dedicated and serverless models, healthcare data analysis fundamentals
Analytics & Governance
Data governance frameworks, lineage tracking, data classification, RBAC, PHI handling, compliance alignment, metadata management, Power BI dataset support
Tools & DevOps
Git, Azure DevOps, CI/CD pipelines, Terraform (optional for infra-as-code), monitoring dashboards, automated alerting
Soft Skills
Cross-functional collaboration, technical leadership, stakeholder communication, requirements translation, documentation, sprint-based delivery
Certification
- AWS Solution Architect Associate, AWS Business Professional and AWS Business Professional
- Hacker Rank – Core and Advance level of Java and Python
- Hands on Python and R in Data Science by A-to-Z Machine Learning, Udemy
- Complete Data Science Bootcamp by 365 Careers, Udemy
- Salesforce Developer with Ranger rank on Trailhead (64 badges, 6 Super badges with 90,000+ points)
- Robotic Operations and Applications by Prag Robotics and SRM University
Timeline
Software Engineer - Data Engineering
Taxlocity
01.2024 - Current
Solution Engineer
Sensiple
01.2023 - 12.2023
Systems Engineer-AWS Cloud
Tata Consultancy Services
09.2020 - 07.2022
Application Security Engineer - Intern
Reliance Jio
12.2019 - 02.2020
Network Engineer - Intern
Capgemini
12.2018 - 01.2019
Bachelor of Technology - Electronics and Communication Engineering
SRM Institute of Science and Technology
Master of Science - Computer Science
SUNY Binghamton