Shiva Myakala

• Data engineer with over 4 years of experience, proficient in managing large-scale data infrastructure, designing robust pipelines, and implementing ETL processes. Skilled in various programming languages, database technologies, and cloud platforms, with a strong collaboration background, delivering innovative solutions and optimizing data processes for organizational growth.
• Strong Experience in working with Databases like Teradata and proficiency in writing complex SQL, PL/SQL for creating tables, views, indexes, stored procedures, and functions.
• Designing and Developed Oracle PL/SQL and Shell Scripts performed Data Import/Export, Data Conversions, and Data Cleansing.
• Ability to write the Business Requirements Document (BRD), gather and develop UAT Test Plans, administer the Traceability Matrix, and assist with post-implementation tasks.
• Experience with Microsoft Azure services, such as Azure Data Factory (ADF), Azure Synapse Analytics, Databricks, Cognitive Search, Power platform, and Blob storage.
• Used Azure Data Factory extensively for ingesting data from disparate source systems.
• Develop intuitive visualizations and interactive dashboards both in the Power BI and Tableau environments.
• Worked on Docker based containers for using Airflow.
• Adequate knowledge and working experience in Agile and Waterfall Methodologies. Defining user stories and driving the agile board in JIRA during project execution, participate in sprint demo and retrospective.
• Developed spark applications for performing large scale transformations and denormalization of relational datasets.
• Built data pipelines, data architectures, and data sets. Integrated large, disconnected datasets using ETL / ELT Tools in on-premises as well as cloud environments.
• Written python code for gathering the data from AWS snowflake, data preprocessing, feature extraction, feature engineering, modeling, evaluating the model, deployment.
• Extensively worked on Spark using Scala, PySpark on the cluster for computational analytics, installed it on top of Hadoop, and performed advanced analytical applications by using Spark.
• Expertise in AWS Resources like EC2, S3, EBS, VPC, ELB, SNS, RDS, IAM, Route 53, Auto scaling, Cloud Formation, Cloud Watch, Athena, and Security Groups.
• Using dynamic SQL to extract information from unstructured JSON data and store it in relational data tables for analysis.
• Developed database models, views, and APIs using Python for interactive web-based solutions.

ETL/ Data Warehouse Tools: Informatica Power Centre, Talend, Pentaho, SSIS, DataStage
Querying Languages: SQL, NoSQL, PostgreSQL, MySQL, Spark-SQL, Sqoop 1.4.4
Programming Languages: PYTHON, Scala, Hibernate, JDBC, JSON, HTML, CSS, SQL, R, Shell Scripting
Databases: Oracle, SQL Server, MySQL, Cassandra, Teradata, PostgreSQL, MS Access, Snowflake, NoSQL, Database (HBase, MongoDB).
Visualization: Tableau, Power BI
OLAP/Reporting: SQL Server Analysis Services and Reporting Services.
Integration Tools: Git, Gerrit, Jenkins, Maven
Methodologies: Agile, Scrum, Waterfall UML