ASHOK KUNKALA
Centerton,AR
Summary
Senior Manager and Staff Data Engineer with 15 years of IT experience, including 9 years in leading complex data engineering projects. Expertise in architecting scalable data solutions across multi-cloud environments (GCP, AWS) and on-premises infrastructure, effectively processing large data volumes. Proven track record in enhancing operational efficiency and team performance through strategic leadership and mentorship. Skilled in utilizing ETL and reporting tools to drive impactful organizational changes.
Overview
1
1
Certification
16
16
years of professional experience
Work History
Staff Data Engineer
Walmart
Dallas, USA
10.2023 - Current
- Designed and implemented the solution for Walmart Scintilla Health, enabling a new revenue stream for the Walmart DaaS platform, which is projected to be around $ 300 million per year as an MVP.
- Designed an effective solution to protect HIPAA data and implement privacy solutions to protect customer PII details.
- Designed and led the team to build the Omnichannel data at Visit and Item grain.
- Worked with suppliers to understand their architecture and support an optimal way.
- Designed the solution to tag customer interaction data and transaction data to support customer behavior applications.
- Designed and developed a solution to the Data Clean Room(DCR) to allow suppliers to directly join their data with Walmart Transaction data at the customer level.
- Led cross-functional teams to achieve strategic objectives and enhance operational efficiency.
- Oversaw budgeting processes, ensuring alignment with organizational financial objectives.
- Managed project timelines and deliverables, ensuring the successful execution of key initiatives.
- Established strong relationships with clients and stakeholders, ensuring long-term partnerships and repeat business.
- Managed budgets effectively, achieving financial objectives while maintaining strict control over expenditures.
- Led a team of five data engineers to design and implement a data lake on GCP, achieving a 30% reduction in processing time.
- Collaborated with data scientists and analysts to understand data needs and implement appropriate data models and structures.
- Optimized cloud resources, resulting in 35% cost savings in storage and processing.
- Collaborated with cross-functional teams to translate business requirements into actionable data strategies.
- Implemented processes ensuring data accuracy, consistency, and compliance with security regulations.
- Reviewed engineering designs for accuracy before implementation, enhancing project quality.
- Provided technical guidance and mentorship to junior engineers to develop skills.
- Conducted research on emerging big data technologies for potential application in projects.
- Monitored performance metrics to evaluate the effectiveness of system modifications.
Senior Data Engineer
Walmart
Dallas, USA
10.2021 - 09.2022
- Collaborated with data stewards, analysts, and modelers to implement solutions for data feeds and construct data lake.
- Designed data pipelines to support large-scale data processing and analytics.
- Collaborated with cross-functional teams to define data requirements and specifications.
- Defined database and analytics engagement strategies with solution architects for operational territories and key accounts.
- Designed, implemented, tested, and refined a scalable framework for building data pipelines alongside product managers and engineers.
- Led development and support of data pipelines to establish reporting layers for top suppliers.
- Managed daily data feed deliveries to suppliers, ensuring compliance with tight SLAs.
- Conducted proof of concept (POC) evaluations to select appropriate tools for applications.
- Engineered processes for pipeline development, validation, and deployment.
- Trained L2 and L3 teams to effectively support daily operations and client requests.
Big Data Tech Lead
Verizon Communications
Irving, USA
08.2019 - 09.2021
- Work across multiple cross-functional teams in high visibility roles and own the data solution end-to-end.
- Data Storage and Computation Frameworks, Performance Optimizations in Big Data environment.
- Worked on Data ingestion using Sqoop and Spark into the Hadoop platform, Created Hive External tables on top HDFS location.
- Created Datasets using HQL, SparkSQL, and PySpark on Hortonworks Cluster.
- Design and created analytics platform using Google cloud storage and Google BigQuery.
- Design and created R & D Data lake on AWS EC2 instance with HDP platform.
- Designed and Implemented 10 PB of data migration between Hadoop clusters.
- Support and maintain near real-time Hadoop Data lake for supply chain management and finance data from multiple ERP systems.
- Created reports and visualizations in Qlik by sourcing data from Hadoop.
- Work with business and technology partners to provide reporting capabilities for all our internal customers.
- Work on quantitative business analysis, data mining, and the presentation of data to see beyond the numbers and drive enterprise level outcomes.
- Provide subject matter expertise in the analysis, preparation of specifications and plans for the development of data processes.
- Working with version control systems like Git, Stash, Bitbucket, Jira, and Confluence.
Big Data Tech Lead
Walmart Stores Inc
Bentonville, USA
07.2018 - 07.2019
- Provide technical direction in a team that designs and develops
- Load and processing a large volume of data (10 PB).
- Interact with domain experts, data architects, solutions architects,and analytics developers to define data models for streaming input and delivering analytics output.
- Design strategies and detailed approaches to integrate Hadoop with existing applications, including but not limited to Oracle, DB2 and Enterprise Data Warehouse and Data Mart applications.
- Adopt a fastworks mindset to support Business data and analytics projects.
- Designed and implemented a cost-effective solution for data migration from on-premises to Google Cloud Platform using Hadoop and Spark.
- Designed the solution for data transition to the third-party company using Google Cloud platform.
- Migration of 100+ TBs of data from different databases (i.e. Teradata, DB2 and Informix) to Hadoop. Writing code in different applications of Hadoop Ecosystem to achieve the required output in a sprint time period.
- Implemented solution with Google BigQuery and other Google cloud components.
Senior Big Data Engineer
Verizon Data Services
Hyderabad, India
07.2015 - 05.2018
- Involved in requirement gathering phase of the SDLC and helped the team by breaking up the complete project into modules begin as a team leader.
- Implement agile management ideas by facilitating exercises such as 3 Weeks sprint planning and team-leading standups.
- Imported data from various relational data stores to HDFS using Sqoop and Attunity to build Hadoop data lake.
- Written Hive jobs to parse the logs and structure them in tabular format to facilitate effective querying on the log data.
- Created Tableau Dashboards to monitor Data lake health with respective KIPs.
- Migrated TB's of data from SAP HANA/ SAP BI (Oracle) to Hadoop.
- Done POC on NoSQL DB's , AWS Dynamodb and Mongodb.
- Set up 12 node cluster for POCs on Amazon Web Services using EC2 and EBS.
- Worked with version control systems like Git, Stash, Bitbucket, Jira, and Confluence.
Big Data Engineer
Tata Consultancy Services
Bangalore, India
12.2014 - 06.2015
- Used Sqoop to load data from the relational database into HDFS for processing and exporting data to RDMS Writing and reviewing technical design documents.
- Loaded and transformed large sets of structured and semi-structured.
- Created Hive tables as per requirement as internal or external tables, intended for efficiency.
- Build/Tune/Maintain Hive QL and Pig Scripts for reporting purpose.
- Worked on hive performance techniques like partition, bucketing, vectorization, cost-based query optimization.
- Worked on different file formats and different Compression Codes.
- Worked on scheduling workflow's in Oozie to automate and parallelize Hive jobs.
SAP BI BW Consultant
Aricent Group
Bangalore, India
10.2010 - 12.2014
- Extracted data from different data source cost center wise.
- Modeling: creating Real time infocube, multi provider, transformations, DTPs (for DSO).
- Wrote Start routine, End routine and Field routine in SAP ABAP and worked on various objects like RKF and CKF as per the client requirement.
- Developed various Aggregation Levels on top of Real time Info providers. Created various Filters for restricting the data at the planning modeler side.
- Developed Bex query in change mode by building them on Aggregation levels.
- Developed Gross Margin & Direct Margin Webi reports at AVGG & BUD exchange rates.
- Extended all standard BO audit reports to Aricent landscape & developed custom reports.
Education
Bachelor of Science - Information Technology
JNTU
Anantapur, India01.2009
Skills
Technical Skill
- HDFS, Map Reduce, Pyspark, Hive, Pig, Oozie, Sqoop, Kafka, Ambari, Ranger, Automc, Airflow
- Google Cloud Platform (GCS, BigQuery, DataProc, Cloud Data Transfer, BigTables, Cloud DataStudio), and Amazon AWS (EC2, EBS, S3, Dynamo DB, and AWS EMR), Machine Learning
- C, UNIX shell scripts, Python, Core Java, PL/SQL, Scala, Java script, and SAP ABAP
- SAP BI/BW, SAP HANA, Google BigQuery, Oracle 9i, 10g, 11g, IBM Informix, Teradata, DB2, Dynamo DB, HBase and Google BigTable
- Goal Setting, Team building, Time management abilities
Managerial Skill
- Budget management
- Cross-functional collaboration
- Effective communication
- Team leadership
- Organizational improvement
- Human resources management
- Cross-functional team leadership
- Talent development
Certification
- Google Cloud Certified Professional Data Engineer
- Google Cloud - Introduction to Generative AI
Timeline
Staff Data Engineer
Walmart
10.2023 - Current
Senior Data Engineer
Walmart
10.2021 - 09.2022
Big Data Tech Lead
Verizon Communications
08.2019 - 09.2021
Big Data Tech Lead
Walmart Stores Inc
07.2018 - 07.2019
Senior Big Data Engineer
Verizon Data Services
07.2015 - 05.2018
Big Data Engineer
Tata Consultancy Services
12.2014 - 06.2015
SAP BI BW Consultant
Aricent Group
10.2010 - 12.2014
Bachelor of Science - Information Technology
JNTU