Neeraj Reddy

To work in a demanding workplace by showcasing my efficiency, displaying my intellect, and utilizing my software professional talents and adept IT professional with 7+ years of professional IT experience with Data Warehousing/Big Data which includes experience in Big Data ecosystem related technologies like Hadoop, Map Reduce Pig, Hive and Spark, Data Visualization, Reporting, and data quality solutions

• Experience in Big Data analytics, Data manipulation, using Hadoop Ecosystem tools Map - Reduce, Yarn/MRv2, Pig, Hive, HDFS, HBase, Spark, Kafka, Flume, Sqoop, Flume, Oozie, Avro, Sqoop, AWS, Spark integration with Cassandra, Avro, and Zookeeper.
• Experience in installation, configuration, supporting, and managing - Cloudera’s Hadoop platform along with CDH3&4 clusters.
• Experience on Migrating SQL database to Azure data Lake, Azure data lake Analytics, Azure SQL Database, Data Bricks and Azure SQL Data warehouse and controlling and granting database access and Migrating On premise databases to Azure Data Lake store using Azure Data factory.
• Experience in implementing Azure data solutions, provisioning storage account, Azure Data Factory, SQL server, SQL Databases, SQL Data warehouse, Azure Data Bricks and Azure Cosmos DB.
• Good understanding of Spark Architecture with Databricks, Structured Streaming. Setting Up AWS and Microsoft Azure with Databricks, Databricks Workspace for Business Analytics, Managing Clusters in Databricks, Managing the Machine Learning Lifecycle.
• Experience in Data extraction (extract, Schemas, corrupt record handling and parallelized code), transformations and loads (user - defined functions, join optimizations) and Production (optimize and automate Extract, Transform and Load).
• Have good experience in designing cloud-based solutions in Azure by creating Azure SQL database, setting up Elastic pool jobs and design tabular models in Azure analysis services.
• Experience with Snowflake cloud data warehouse and AWS S3 bucket for integrating data from multiple source system which include loading nested JSON formatted data into snowflake table.
• Experience in using Snowflake Clone, Time Travel and building snow pipe.
• Worked with Matillion which Leverage Snowflake’s separate compute and storage resources for rapid transformation and get the Get the most from Snowflake-specific features, such as Alter Warehouse and Flatten Variant, Object, and Array.
• Experience in working with RIVERY ELT platform which performs data integration, data orchestration, data cleansing, and other vital data functionalities
• Have Extensive Experience in IT data analytics projects, Hands on experience in migrating on premise ETs to Google Cloud Platform (GCP) using cloud native tools such as BIG query, Cloud Data Proc, Google Cloud Storage, Composer.
• Experienced with Dimensional modelling, Data migration, Data cleansing, Data profiling, and ETL Processes features for data warehouses.
• Expertise in building CI/CD on AWS environment using AWS Code Commit, Code Build, Code Deploy and Code Pipeline and experience in using AWS CloudFormation, API Gateway, and AWS Lambda in automation and securing the infrastructure on AWS.
• Excellent knowledge on Hadoop Architecture and ecosystems such as HDFS, Hive, Pig, Sqoop, Job Tracker, Task Tracker, Name Node, Data.
• Expert in designing Parallel jobs using various stages like Join, Merge, Lookup, remove duplicates, Filter, Dataset, Lookup file set, Complex flat file, Modify, Aggregator, XML.
• Good knowledge in Database Creation and maintenance of physical data models with Oracle, Teradata, Netezza, DB2, MongoDB, HBase, and SQL Server databases.
• Have experience in installing, configuring, and administrating Hadoop clusters for major Hadoop distributions like CDH4, and CDH5.
• Involved with the Design and Development of ETL process related to benefits and offers data into the data warehouse from different sources.
• Possess strong Documentation skills and knowledge sharing among Team, conducted data modeling sessions for different user groups, facilitated common data models between different applications, participated in requirement sessions to identify logical entities.
• Extensive experience in relational Data modeling, Dimensional data modeling, logical/Physical Design, ER Diagrams, and OLTP and OLAP System Study and Analysis.
• Proficient with Spark Core, Spark SQL, Spark MLlib, Spark GraphX, and Spark Streaming for processing and transforming complex data using in-memory computing capabilities written in Scala. Worked with Spark to improve the efficiency of existing algorithms using Spark Context, Spark SQL, Spark MLlib, Data Frame, Pair RDD, and Spark YARN.
• Extensive knowledge and experience in producing tables, reports, graphs, and listings using various procedures and handling large databases to perform complex data manipulations.
• Excellent knowledge in preparing required project documentation and tracking and reporting regularly on the status of projects to all project stakeholders.
• Experience in UNIX shell scripting for processing large volumes of data from varied sources and loading them into databases like Teradata.
• Strong experience and knowledge of real time data analytics using Spark Streaming, Kafka, and Flume.
• Proficient in Data Modeling Techniques using Star Schema, Snowflake Schema, Fact and Dimension tables, RDBMS, Physical and Logical data modeling for Data Warehouse and Data Mart.
• Experience with Data Analytics, Data Reporting, Ad-hoc Reporting, Graphs, Scales, PivotTables and OLAP reporting.
• Highly skilled in using visualization tools like Tableau, ggplot2, dash, PowerBI, flask for creating dashboards.
• SQL Reference Mapper, using Regular Expressions Successfully mapped over a hundred thousand SQL references inside of SQL Object source code, SSRS reports, and DT Packages.
• · Good experience in developing web applications and implementing Model View Control (MVC) architecture using server-side applications like Django, Flask, and Pyramid.
• Experience in application development using Java, RDBMS, TALEND and Linux shell scripting and DB2.
• Experienced in Software Development Lifecycle (SDLC) using SCRUM, Agile methodologies.