Working as a Hadoop developer in GDI at Toyota Motor Company
Solid understanding on Big data components - Spark(Java, Scala), Hive, Hbase, Oozie, Kafka, Sqoop
Developed expertise in programming languages Java, SQL, Swift-2.
Very good understanding of Data Structures and algorithms.
Gained hands-on experience in iOS application development.
AGILE expertise
Overview
21
21
years of professional experience
1
1
Certification
Work History
Big Data Engineer
Assurance Partners
09.2016 - Current
Created Data Lake by extracting customer's data from various data sources into HDFS. This includes data from Teradata, Mainframes, RDBMS, CSV and Excel.
Involved in design and development of Data transformation framework components to support ETL process, which gets Single Complete Actionable View of 14 Customers.
Developed 9 ingestion module to ingest data into HDFS from heterogeneous data sources.
Used Apache Hive to run map reduce jobs on top of this HDFS data.
Built distributed in-memory applications using Spark and Spark SQL to do analytics efficiently on huge data sets.
These applications were built using Spark Java API and used YARN as resource manager.
Efficiently used spark transformations and actions to build simple/quick and complex ETL applications.
Used Apache Falcon to manage and schedule Spark Jobs on a Hadoop Cluster.
Falcon was also used to trigger various ooze workflows.
Involved in performance optimization of Spark jobs and designed efficient queries to query data from Hbase.
Designed internal and external table schemas in Hive with appropriate static and dynamic partitions for efficiency.
Involved in preparing design and unit and Integration tests documents .
Used GDP on validation protocols, test cases and changed control documents
Academic Project
Crime Investigation Systems
04.2014 - .1 -1
Developed an online intelligent decision support system, which manages complaints registered by common people.
These complaints are stored in MySQL database.
Instagram Clone (IOS) January 2014.
Developed Instagram clone application which exactly has the same features of Instagram application.
Software Development Intern
Groupon
08.2013 - 12.2013
Built an online e-tendering system with corrigendum support.
Provided a platform to upload tenders, where bidders can view and bid on them.
HTML was used to design the web pages and back end server side scripting is done using PHP.
Academic Project
EPA
11.2002 - 01.2007
Developed an WordPress application, which displays climate blogs.
Also built a discussion board to help users communicate and share their environmental news.
Used PHP to enhance the functionality.
Education
Bachelor of Science - Computer Sciences and Engineering
Tools: Eclipse, Maven, NetBeans, IntellIJ, Accurev, WinSCP and Apache Tomcat
Platforms: Linux, Windows and OS X
Methodologies: Agile and Waterfall model
Certification
Big Data Management, Theoretical Concepts in Computers and Computation, Data Structures and Algorithms Concepts, Software Engineering, Computer Architecture, Programming Languages, Artificial Intelligence, Database systems.
Timeline
Big Data Engineer
Assurance Partners
09.2016 - Current
Academic Project
Crime Investigation Systems
04.2014 - .1 -1
Software Development Intern
Groupon
08.2013 - 12.2013
Academic Project
EPA
11.2002 - 01.2007
Bachelor of Science - Computer Sciences and Engineering
Manager, General Financial Accounting and Planning/Payables; Financial Analysis at BDO Life Assurance Company, Inc. (formerly Generali Pilipinas Life Assurance, Inc.)Manager, General Financial Accounting and Planning/Payables; Financial Analysis at BDO Life Assurance Company, Inc. (formerly Generali Pilipinas Life Assurance, Inc.)
Behavioral Health Specialist/Special Education Co-Teacher at Community Council Learning AcademyBehavioral Health Specialist/Special Education Co-Teacher at Community Council Learning Academy