Franklin Stephen
San Antonio,TX
Summary
Over 17 years of IT experience, with a strong background in data engineering and software development. Expertise in designing and architecting scalable data solutions, including data pipelines and big data platforms. Proficient in ETL solution automation using Redpoint and skilled in big data technologies like PySpark, Hadoop, and Hive. Extensive experience with data lake house implementations, including MinIO object storage, Iceberg, and Kubernetes. Proven track record in migrating legacy data processing systems to modern data platforms. Specialized in creating automated data pipelines, enhancing data accessibility, and driving business insights. Strong programming skills in C#, Python, Java, and JavaScript. Committed to agile methodologies, with experience using GitLab and following SCRUM practices for project delivery. Experienced in providing solutions for go-to-market business strategies and optimizing data workflows. Expertise in Data Integration, Data Quality Solutions, providing logical and physical design and implementation. Expertise in Verities of ETL tools such as Talend, Redpoint and SSIS. Hands on experience with API interactions with the ETL tools. Hands on experience with AWS Glue. Proficient in OOPS concepts and design patterns. Skilled in developing business plans, requirements specifications, user documentation, and architectural systems research. Strong in design and integration problem solving skills. Open to new technologies and Quick learner.
Overview
18
18
years of professional experience
Work History
IT ENGINEER II
VERICAST
SAN ANTONIO
12.2023 - Current
- Spearheaded the complete design and implementation of the company's data lake house migration from HDFS to a cloud-native solution, leveraging MinIO for scalable object storage, and Apache Iceberg for efficient data querying. Developed robust ETL pipelines using PySpark for seamless data processing and integrated Airflow for automated workflow orchestration, driving operational efficiency and enabling advanced data analytics capabilities on a Kubernetes-based architecture.
- Built data pipelines using Apache Spark to process large amounts of structured and unstructured data.
- Developed automated processes for collecting, organizing, and analyzing big data.
- Analyzed large datasets to identify patterns and trends in data.
- Developed ETL jobs to extract, transform, and load data from various sources into the target system.
- Provided technical support to business users on using Big Data tools for their analytical needs.
- Collaborated with other members of the team to design efficient solutions for managing Big Data workloads.
- Conducted research on emerging technologies related to Big Data processing, storage, and analytics.
- Monitored production systems for identifying potential issues with performance or scalability.
- Identified areas where automation can be used to streamline development workflows.
- Implemented the gold, silver, and bronze layered architecture to structure data storage and processing, enhancing data governance and accessibility.
- Cleaned and manipulated raw data.
- Managed orchestration and workflow automation using Airflow, optimizing data processing pipelines, and improving operational efficiency.
APPLICATION DEVELOPER
VERICAST
SAN ANTONIO
08.2015 - 12.2023
- Created data pipelines using PySpark and orchestrated using Talend.
- Developed and maintained applications using Redpoint, focusing on ETL processes and data integration.
- Managed and optimized data warehousing solutions, ensuring efficient data storage and retrieval.
- Worked with big data technologies, such as MapR and Hadoop, designing and implementing data processing workflows and solutions.
- Designed and implemented data architectures to support business intelligence and reporting requirements.
- Ensured data quality and integrity across various data systems, contributing to accurate and reliable data analysis.
- Provided technical expertise and support for project planning, development, and deployment.
- Managed the installation and maintenance of MapR and Talend ecosystems, ensuring smooth operation and integration with existing systems.
- APPLICATION DEVELOPMENT & DATA SOLUTIONS:
- Automation of workflow to handle the daily, weekly, and monthly loads without manual intervention, which reduces the operation time by 90%.
- Maintain responsibility for the ongoing operation, monitoring, and maintenance of marketing database solutions in a 24/7 production environment, including after-hours on-call support.
- Migrations from legacy DataStage ETL system to SSIS and Talend.
SENIOR SOFTWARE ENGINEER
HARLAND CLARKE HOLDING
CHENNAI
01.2014 - 08.2015
- Led the design and development of complex software solutions, focusing on enhancing system functionality and performance.
- Utilized .NET technologies and C# to build robust applications and business logic.
- Provided technical leadership and guidance to junior developers, ensuring best practices and coding standards were followed.
- Assisted in defining technical requirements and project specifications, contributing to project planning and execution.
- Automation of data processing workflow to handle a large number of clients to use the product without manual intervention, which reduces the operation time by 90%.
- Conducted performance analysis and optimization of existing systems, addressing bottlenecks and improving system efficiency.
- Managed system updates and enhancements to meet evolving business needs and technological advancements.
SYSTEM ANALYST
CSC INDIA PVT LTD
CHENNAI
12.2007 - 01.2014
- Complete end to end implementation of business logics, data access layer logics.
- Received and analyzed change requests and design changes from the design management team, ensuring alignment with project goals.
- Performed thorough analysis and review of change requests and issues to ensure effective solutions.
- Wrote detailed technical designs for new features and modifications, guiding the development process and ensuring clarity.
- Mentored team members, conducted code reviews, and provided guidance on complex logic and technical challenges.
SOFTWARE ENGINEER
KAVNIYA TECHNOLOGY SOLUTIONS
CHENNAI
03.2007 - 12.2007
- Developed applications using .NET technologies, focusing on web services and integration with SQL databases
- : Implemented business logic and created user interfaces to support various business processes
- Worked with SQL databases to design and manage data storage solutions, ensuring data integrity and accessibility
- Conducted database queries and optimizations to enhance application performance and reliability
- APPLICATION DEVELOPMENT:
Education
Bachelor of Engineering -
01.2005
Diploma in Computer Technology -
01.2002
Higher Secondary School -
01.1999
Secondary School -
01.1997
Skills
- BIG DATA TECHNOLOGIES: MinIO, S3, PySpark, Hadoop, Hive, HDFS, MapR, Iceberg, Kubernetes
- DATA ENGINEERING & ETL TOOLS: Redpoint, Talend, SSIS, AWS Glue, Apache Ranger, Airflow, Oozie, Jupyter Notebook
- PROGRAMMING & SCRIPTING LANGUAGES: Python, C#, JavaScript, SQL, Java
- DATA FORMATS: Parquet, CSV, Excel, ORC
- CONFIGURATION & SCRIPTING: YAML, JSON, XML
- ADDITIONAL TOOLS & TECHNOLOGIES: GitLab, SQL Server, ServiceNow, VS Code, Superset, Hue
- Data integration
- API Development
- ETL development
- Data Migration
- Machine Learning
- Agile Methodology
- Data Warehousing
- Data storage
- Data-driven decision-making
- Data architecture
- Data Security
Timeline
IT ENGINEER II
VERICAST
12.2023 - Current
APPLICATION DEVELOPER
VERICAST
08.2015 - 12.2023
SENIOR SOFTWARE ENGINEER
HARLAND CLARKE HOLDING
01.2014 - 08.2015
SYSTEM ANALYST
CSC INDIA PVT LTD
12.2007 - 01.2014
SOFTWARE ENGINEER
KAVNIYA TECHNOLOGY SOLUTIONS
03.2007 - 12.2007
Bachelor of Engineering -
Diploma in Computer Technology -
Higher Secondary School -
Secondary School -
Similar Profiles
Shawn WilliamsShawn Williams
Production Supervisor at VericastProduction Supervisor at Vericast
Karen OsborneKaren Osborne
Peer Coach, SENIOR SALES EXECUTIVE at VericastPeer Coach, SENIOR SALES EXECUTIVE at Vericast
Makayla HamlettMakayla Hamlett
Graphic Specialist I & Four51 Administrator at VericastGraphic Specialist I & Four51 Administrator at Vericast
RYDEN CLAYMANRYDEN CLAYMAN
Shared Services Intern at VericastShared Services Intern at Vericast
Collin DoanCollin Doan
Sales Associate at Sams Club DistributionSales Associate at Sams Club Distribution