Highly competent Data Engineer with background in designing, testing, and maintaining data management systems. Possess strong skills in database design and data mining, coupled with adeptness at using machine learning to improve business decision making. Previous work resulted in optimizing data retrieval processes and improving system efficiency. Results-driven Data Engineer known for high productivity and efficient task completion. Skilled in big data processing frameworks like Hadoop and Apache Spark, database management using SQL, and data visualization with tools such as Tableau. Excel in problem-solving, collaboration, and adaptability to leverage technical skills in developing innovative data solutions across diverse environments.
Overview
6
6
years of professional experience
Work History
Data Engineer
Tata Consulting Service(TCS)
Jersey City, New Jersey
11.2023 - Current
Optimized existing queries to improve query performance by creating indexes on tables.
Built various dashboards with interactive visualizations using D3.js library.
Developed and implemented data models, database designs, data access and table maintenance codes.
Analyzed user requirements, designed and developed ETL processes to load enterprise data into the Data Warehouse.
Created stored procedures for automating periodic tasks in SQL Server.
Performed full life cycle development of software applications using Java and J2EE technologies.
Designed and developed reports using Business Objects, Tableau, Qlikview.
Configured SSIS packages for scheduled data loads from source systems to target tables.
Developed Python scripts for extracting data from web services API's and loading into databases.
Integrated multiple sources of structured and unstructured datasets into a single platform.
Implemented data visualization tools like Tableau and Power BI to create dashboards and reports for business stakeholders.
Configured and maintained cloud-based data infrastructure on platforms like AWS, Azure, and Google Cloud to enhance data storage and computation capabilities.
Collaborated with cross-functional teams to gather requirements and translate business needs into technical specifications for data solutions.
Designed data warehousing solutions, applying dimensional modeling techniques for optimized data retrieval.
Conducted data analysis using SQL and Python to derive insights and support decision-making processes.
Researched and integrated new data technologies and tools to keep the data architecture modern and efficient.
Designed, constructed, and maintained scalable data pipelines for data ingestion, cleaning, and processing using Python and SQL.
Implemented and optimized big data storage solutions, including Hadoop and NoSQL databases, to improve data accessibility and efficiency.
Provided technical mentorship to junior data engineers, guiding them on best practices and project execution.
Data Engineer
Tech Mahendra
Bangalore, Karnataka
08.2018 - 01.2022
Optimized existing queries to improve query performance by creating indexes on tables.
Built various dashboards with interactive visualizations using D3.js library.
Developed and implemented data models, database designs, data access and table maintenance codes.
Analyzed user requirements, designed and developed ETL processes to load enterprise data into the Data Warehouse.
Created stored procedures for automating periodic tasks in SQL Server.
Performed full life cycle development of software applications using Java and J2EE technologies.
Designed and developed reports using Business Objects, Tableau, Qlikview.
Configured SSIS packages for scheduled data loads from source systems to target tables.
Developed Python scripts for extracting data from web services API's and loading into databases.
Integrated multiple sources of structured and unstructured datasets into a single platform.
Implemented data visualization tools like Tableau and Power BI to create dashboards and reports for business stakeholders.
Configured and maintained cloud-based data infrastructure on platforms like AWS, Azure, and Google Cloud to enhance data storage and computation capabilities.
Collaborated with cross-functional teams to gather requirements and translate business needs into technical specifications for data solutions.
Designed data warehousing solutions, applying dimensional modeling techniques for optimized data retrieval.
Conducted data analysis using SQL and Python to derive insights and support decision-making processes.
Researched and integrated new data technologies and tools to keep the data architecture modern and efficient.
Designed, constructed, and maintained scalable data pipelines for data ingestion, cleaning, and processing using Python and SQL.
Implemented and optimized big data storage solutions, including Hadoop and NoSQL databases, to improve data accessibility and efficiency.
Established and enforced data governance policies and procedures to comply with regulatory requirements and ensure data privacy.
Provided technical mentorship to junior data engineers, guiding them on best practices and project execution.
Streamlined data flow from diverse sources using ETL tools such as Talend, Informatica, and Airflow.
Conducted rigorous testing and validation of data pipelines to ensure accuracy and completeness of data.
Documented data architecture designs and changes, ensuring knowledge transfer and system maintainability.
Automated data quality checks and error handling processes to ensure the integrity and reliability of datasets.
Monitored data systems performance, identifying bottlenecks and implementing solutions to maintain system efficiency.
Collaborated with data scientists and analysts to understand data needs and implement appropriate data models and structures.
Optimized SQL queries and database schemas for performance improvements in data retrieval operations.
Managed version control and deployment of data applications using Git, Docker, and Jenkins.