Srinivas Nandepu

Responsible for maintaining quality reference data in source by performing operations such as cleaning, transformation and ensuring integrity in a relational environment by working closely with the stakeholders & solution architect.

Involved in creating Hive tables, Loading with data and writing hive queries that will run internally in mapreduce way.

Used hive to analyze the partitioned and bucketed data.
Used hive Optimization techniques during joins and follow best practices in writing hive scripts Using HiveQL.

Implemented spark using python and sparksql for faster testing and processing data.

Experience in using Accumulator variables, Broadcast variables, RDD Caching.
Expertise in using Spark-SQL with various data sources like JSON, Parquet and Hive.
Using pyspark framework access data from hive and do aggregations and joins to implement the business logic.

Involved in converting Hive/SQL queries into Spark transformations using Spark RDDs,scala and python.

Implemented Spark using Python and utilizing data frames and spark sql api for faster processing of data
developing spark scripts, UDFS using Spark SQL queries for data aggregation, querying and writing data back into RDBMSthrough sqoop

Implemented spark using python and utilizing spark core, spark streaming and spark sql api for faster processing of data instead of Mapreduce.

Used Spark-SQL to load JSON data and create schema RDD and loaded it into Hive tables and handled structured data.

Experienced in performing Data Ingestion and Data Processing(Transformations and aggregations).
Handled ingestion of data from different data sources into HDFS using sqoop.

Experience of partitions and bucketing concepts in hive and designed for both managed and external tables in hive to optimize performance.
Experience with different file formats like AVRO, Parquet, ORC and Json.

Involved in functional studies and being part of walk troughs with stake holders.

Analyzing the requirements.

Created understanding documents for design and mapping.

Developed SAS code to import the EOC files from the different vendor Locations.

Implemented code to check the file format compliance and data integrity of EOC files.

Involved in clean-up activity and performance tuning of jobs as a part of SAS Migration from one version to another version.

Unit testing and documenting the Test results.

Involved into banking data preparation using SAS EG 4.2 for Management Information System.

Involved in SAS Campaign Management using SAS CI Studio.

Creation of files for various channels for the Barclays Marketing Team as per the input leads provided for campaigns such as Marketing (Cross Sell/Up Sell), Operational and Open Markets.

Respond to ad hoc requests by various departments; interact with various departments to clarify their need to view the data. Performs other tasks required as necessary to meet the needs of the business.

Accessing the oracle data using SQL using SAS ACCESS. Used both Implicit and Explicit Pass through.

Involved in creating SAS datasets from excel data by using Libname and Proc import techniques, as per requirement.

Creating SAS datasets – by combining many tables per business logic.

Deliver business reports to end users using SAS Output delivery system (ODS).

Create table metadata for source and target tables and created jobs to populate the target tables by applying various transformations (Table Loader, SQL Join, Splitter, Summary Statistics, Append) by using SAS Data Integration Studio.

Sub setting dataset using set, merge, sort, update and conditional statement.

Involved in development and enhancements of SAS Programs.

Resolving issues pertaining to data delivered to client .