ALBIN JOSE
Sugar Land
Summary
Data engineer with 5+ years specializing in scalable data pipelines and lakehouse architectures. Delivered a 35% decrease in processing times by optimizing ETL workflows and implemented medallion architecture, enhancing data accessibility for analytics and business intelligence projects.
Overview
7
7
years of professional experience
Work History
Data Engineer
Exelon
Philadelphia
01.2025 - 04.2026
- Designed, developed, and maintained scalable batch ETL/ELT data pipelines using Azure Databricks and Apache Spark.
- Optimized lakehouse architectures with ADLS Gen2 and medallion architecture to enhance data accessibility.
- Developed scalable PySpark applications for ingesting, transforming, and processing data from various enterprise sources.
- Implemented Delta Lake features to enforce schema, evolve structures, and support incremental data processing.
- Reduced pipeline execution time by 35% through optimization of Apache Spark workloads via partitioning and caching.
- Created analytics-ready datasets and reusable data models for enterprise reporting and machine learning initiatives.
- Applied data governance practices with Unity Catalog, ensuring secure access control and metadata management.
- Collaborated with analysts and stakeholders to translate business needs into efficient production data solutions.
Data Engineer
Veranova
West Deptford
04.2022 - 09.2024
- Developed and optimized large-scale data pipelines using Python, SQL, PySpark, and Apache Spark.
- Designed and implemented modern data lake and Lakehouse architectures supporting enterprise analytics and business intelligence.
- Built automated ETL/ELT frameworks for ingesting and transforming data from APIs, databases, and cloud applications.
- Developed reusable data models and curated datasets for reporting, analytics, and downstream applications.
- Implemented data quality frameworks, validation rules, and anomaly detection processes to improve data accuracy.
- Optimized SQL queries, database performance, and distributed processing workloads.
- Supported CI/CD pipelines, Git repositories, code reviews, and deployment processes.
IT Analyst
Peldano
India
02.2019 - 11.2021
- Developed SQL queries to automate reports and structure datasets for operational analytics.
- Engaged stakeholders to define reporting requirements, enhancing data accessibility and usability.
- Facilitated enterprise data integration, cleansing, and transformation for consistency across systems.
- Designed scalable cloud-based data pipelines using Azure Databricks, PySpark, SQL, and Azure Data Factory.
- Built lakehouse solutions leveraging Azure Data Lake Storage Gen2 and medallion architecture for reliable data management.
- Created reusable ETL/ELT frameworks to ingest data from various sources including APIs and databases.
- Established curated silver and gold datasets through effective transformation techniques for self-service reporting.
- Optimized distributed Spark processing by improving partition strategies and tuning SQL queries for performance.
Education
MS - Data Science
Eastern University
Philadelphia11-2024
Bachelor’s - Data Analytics
Amity University
Noida, India10-2020
Skills
- Python and SQL
- Apache Spark and PySpark
- ETL processes
- Data pipeline design
- Data pipeline orchestration
- Delta Lake architecture
- Lakehouse architecture
- Azure Data Factory
- Azure Databricks
- Synapse Analytics
- AWS and GCP cloud services
- Pandas and NumPy libraries
- Scikit-learn and TensorFlow
- Data quality management
- Exploratory data analysis
- Machine learning
- Big data technologies
- MySQL database management
- Excel data analysis
- Data visualization tools
- Git version control
- Data analysis environments
- Problem-solving skills
- Data modeling
- ETL development
- Snowflake
- Delta Live Tables
- Kafka
- Event Hubs
- Structured Streaming
- Docker
- Terraform
- dbt
- Spotfire
- Industrial IoT
- SCADA
- Historian data
Green Card Holder
True
Skills Summary
.Python, SQL, PySpark, Spark, R, Git, Azure Data Factory, Azure Data Lake Gen2, Azure Databricks, Apache Spark, Delta Lake, Synapse Analytics, familiarity with AWS (Redshift, Glue), GCP (Big Query), Pandas, NumPy, Scikit-learn, TensorFlow, Keras, Power BI, Tableau, MySQL, Excel, Jupyter Notebook, RStudio, Data Pipeline Design, Lakehouse Architecture, Data Governance, Exploratory Data Analysis, Machine Learning, AI Integration, Problem-Solving, Data ModellingSnowflake
- Delta Live Tables
- Kafka
- Event Hubs
- Structured Streaming
- Docker
- Terraform
- dbt
- Spotfire
- Industrial IoT
- SCADA
- Historian data
Timeline
Data Engineer
Exelon
01.2025 - 04.2026
Data Engineer
Veranova
04.2022 - 09.2024
IT Analyst
Peldano
02.2019 - 11.2021
MS - Data Science
Eastern University
Bachelor’s - Data Analytics
Amity University