10 Years of experience as Data Engineer and Software development engineer with expertise on extraction, transformation and analysis of data using Pyspark and Hadoop ecosystem technologies. In-depth knowledge of Pyspark Architecture and its components such as HDFS, Hive, Spark Context, Spark SQL, and Spark Streaming. Good knowledge in P&C Insurance and CPG domain obtained from working with various clients.
Overview: Tata Consultancy, New York, USA
Python