Rajesh Surabhi

• Implemented AWS Data Lake for centralized access controls, ensuring secure data access resulting in annual cost savings and an increase in performance by 20%.
• Implemented efficient data ingestion pipelines to process structured and unstructured data into the data lake from 30+ data sources using AWS services and PySpark.
• Implemented and optimized the ETL workflows to enhance data processing speed and reliability.
• Created and maintained the Solution document of AWS Data Lake architectures, configurations, and best practices as we progressed with the project.

Designed and implemented a customer analysis platform using Big Data technologies hive, spark, hql, shell scripting orchestrated using Active Batch.

Been a major contributor for developing Prospect Cornerstone, a centralized data platform that hosts all the current and prospective customers in the US market which is used for understanding the trends of the customer base.

Implemented the aggregate tables present in this database which are updated once every month and the tableau reports are generated for the management board.

Developed SQLs along with the spark job that will update these aggregate tables.

Using this automation project decreased the manual effort of generating these monthly reports by 85% and after going live this module was reused to implement Customer retention program analysis, historical trends of the closed accounts and new customer promotional benefits dashboards.

• Designed compliance logic to consume and process the PHI raw user events from kafka and generate meaningful insights required for daily reports.
• Generated detailed studies on potential third-party data handling solutions, verifying compliance with internal needs and stakeholder requirements.
• Collaborated on ETL (Extract, Transform, Load) tasks, developed 3 interfaces in Snaplogic and maintained data integrity along with verifying pipeline stability .
• Monitored incoming data analytics requests and distributed results to support compliance strategies.

• Completed document writing which captured the requirements from stakeholders, recognized discrepancies and promptly addressed the same for resolution.
• Assisted in creating score cards required for internal visualization dashboards .
• Demonstrated strong organizational and time management skills while managing multiple projects.
• Proved successful working within tight deadlines in a fast-paced environment.