Dibakara Nayak
Cupertino,CA
Summary
Dynamic Data Engineer with extensive experience at Apple Inc., specializing in data pipeline design and SQL optimization. Proven track record in building high-performance analytics solutions using Snowflake and Python. Adept at collaborating with stakeholders to drive project success and enhance data quality, ensuring efficient and reliable data management.
Overview
17
17
years of professional experience
1
1
Certification
Work History
Data Engineer
Apple Inc
01.2025 - Current
- Data Tagging project focuses on the systematic tagging and annotation of raw data to create high quality labeled datasets that enable a chatbot to respond to user queries in an automated and efficient manner.
- Prepared and maintained Business Requirements Documents (BRDs) to clearly define project scope and business objectives. Collaborated with stakeholders to gather, analyze, and document business requirements.
- Built interactive front-end applications with Python and Streamlit to support real-time analytics, and designed data ingestion pipelines to load data from different systems into Snowflake, where records were tagged and categorized based on business usage and analytical requirements.
- Design and implement backend systems using vector databases and large language models (LLMs) for efficient semantic search and context-aware insights.
Automation Engineer (Batch & Scheduling)
Apple Inc
01.2024 - 12.2024
- Led the end-to-end migration of enterprise job scheduling workloads from Autosys to JS7 JobScheduler, handling job and workflow conversion, dependency mapping, testing, and production cutover to enhance scalability, flexibility, and automation.
- Set up and managed JS7 production environments, including controllers, agents, security, high availability, monitoring, documentation, and knowledge transfer, to ensure stable operations and minimal business disruption.
Data Analytics
Apple Inc
07.2013 - 12.2023
- Artificial Intelligence and Data Platform Engineering is one of the key projects within Global Business Intelligence (GBI) group at Apple in iTunes portfolio. The primary objective is to store the iTunes data, bringing the same into an Enterprise Data Warehouse and building complex reporting around the same for Apple business teams and for external vendors.
- Worked in real time streaming data to ingest into Snowflake, Data Lake, Hadoop, Teradata and Oracle through Kafka agent, Spark streaming, Splunk and Airflow.
- Worked with development, application and other data architects to discuss overall solution approach for the enhancement of existing products.
- I used Snowflake as both a developer and admin to design data pipelines, optimize complex SQL transformations, and deliver high-performance analytics using secure, well-modeled data.
- As an administrator, I managed user access, roles, warehouses, cost optimization, and performance tuning to ensure reliability, security, and efficient resource usage.
- Identify and recommend process improvements that significantly reduce workloads or improve quality for assigned areas of responsibility.
- Experienced in Spark performance by tuning configuration parameters in production environment.
- Develop ETL pipeline involves designing, implementing, and optimizing data workflows to move and transform data from source systems to a destination.
- Independently conducted root cause analysis for critical issues, identified trends, documented and implemented preventative measures to mitigate future occurrences and streamline processes.
- Conducted Risk, Business Impact and Gap Analysis and optimization efforts to enhance system efficiency and throughput for new applications and activities.
- Worked closely with internal and external Business user's requirements and concerns to fix issues.
Senior System Engineer
Loyalty One
09.2010 - 03.2013
- Contributed to the development of a retail loyalty program product that rewards customers based on behavior across multiple store chains, aiming to improve customer retention and acquisition; actively participated in functional discussions, feasibility analysis, estimation, and requirement analysis.
- Handled LLD design, coding, unit test case design, and development of secure web services, along with troubleshooting and resolving development and deployment issues across modules.
System Engineer
Microsoft
10.2008 - 08.2010
- Engaged in the MS Program to analyze issues, design solutions, prepare and test patches, and deploy them into the DEV environment, including effort estimation to address identified gaps.
- Participated in team discussions, code reviews, gap assessments, and risk analysis, with hands-on work in analyzing and patching existing stored procedures and assessing risks of consuming external services.
Education
Bachelor of Engineering - Computer Science
Post Graduate program - AI&ML
Skills
Expert - Python, SnowFlake,Vector Database,Kafka, Hadoop, HDFS, ETL,ELT, DataLake, Hive , BIg Data Tools
Familiar - Java, Oracle, Cassandra , Shell Script, Panda, NumPy, Docker, AWS, REST API, PL/SQL
Certification
- Sun Certified Java Programmer
- IBM Hadoop Fundamental Certification
- Red Hat User Administration certification
- Snow Flake
Timeline
Data Engineer
Apple Inc
01.2025 - Current
Automation Engineer (Batch & Scheduling)
Apple Inc
01.2024 - 12.2024
Data Analytics
Apple Inc
07.2013 - 12.2023
Senior System Engineer
Loyalty One
09.2010 - 03.2013
System Engineer
Microsoft
10.2008 - 08.2010