Nikhil Natesh
Nesconset,NY
Summary
Innovative and forward-thinking Applications Engineer with a proven track record of developing and deploying advanced AI solutions. I specialize in generative AI, machine learning, and deep learning, crafting production-ready Software and X-Ray systems that solve real-world challenges. My experience ranges from fine-tuning LLaMA2 models to designing robust evaluation frameworks using state-of-the-art techniques. I thrive in collaborative environments, integrating cutting-edge tools like Whisper API, LangChain, and OpenAI’s GPT models to enhance user experiences. Whether it's secure deployment using Docker and Podman or developing enterprise-grade applications with C# and SQL Server, I’m dedicated to driving innovation and excellence in every project.
Overview
3
3
years of professional experience
1
1
Certification
Work History
AI / Applications Engineer
VJ Technologies
Bohemia, NY
04.2024 - Current
- Trained deep learning models for defect detection, utilizing U-Net and ConvNextV2 architectures, achieving high accuracy in x-ray image analysis.
- Implemented AES and RSA encryption techniques to secure AI model weights and Python code, ensuring data protection in deployment.
- Developed a customized chatbot for the company using Radiation models and Mistral, leveraging Langchain and FAISS for efficient PDF query handling and vector database integration.
- Fine-tuned pre-trained models, optimizing their performance for defect detection tasks and improving model accuracy.
- Delivered presentations on AI and deep learning architectures (CNN, U-Net), demonstrating the implementation of AI in x-ray systems to internal teams and clients.
- Deployed AI models into secure environments using Podman Desktop containers, ensuring scalability and performance optimization.
- Developed comprehensive evaluation frameworks for generative AI by applying NLP/CV metrics, LLMaaJ techniques, human evaluation, and RAG methods to rigorously benchmark model performance.
- Produced production-ready code for model evaluation, enabling smooth handoffs to engineering teams and seamless integration into real-world applications.
- Collaborated closely with cross-functional teams—including engineering and data specialists—to embed advanced evaluation capabilities into various products, ultimately enhancing user experience.
- Designed and executed experiments to test new evaluation algorithms, continuously exploring emerging technologies and industry trends to drive innovation.
- Provided mentorship on best practices for model evaluation using Python, TensorFlow, and PyTorch, contributing to a high-performing, collaborative team culture.
- Utilized Retrieval-Augmented Generation (RAG) techniques with Langchain to build a robust chatbot capable of answering questions based on company-specific documents.
- Collaborated with cross-disciplinary teams to integrate AI-driven solutions into imaging systems, enhancing product performance and customer satisfaction.
- Troubleshot and optimized imaging-related issues in both in-house and customer systems worldwide.
- Managed backend infrastructure for AI-driven systems, including developing RESTful APIs for model deployment and interaction.
- Created and maintained C# solutions for customers, integrating their production data stored in SQL Server and writing complex queries to manage and analyze the data efficiently.
- Provided training and support on AI model integration, deployment, and performance tuning.
- Followed ASTM and NDT protocols for testing aluminum castings for AI-based defect detection, ensuring quality and compliance in testing processes.
- Collaborated with cross-disciplinary engineering teams (mechanical, electrical, software, imaging) to review, define, and design integrated system solutions meeting the requirements of worldwide customers.
- Wrote C++ code in the Arduino IDE for synchronizing X-ray machines with detectors, ensuring seamless operation in real-time and accurate data acquisition.
- Troubleshot imaging-related problems for both in-house and field systems, ensuring consistent and reliable system performance.
- Developed and maintained best practices and quality processes for the entire imaging chain, ensuring high-quality deliverables.
- Traveled to customer sites worldwide (approx. 50%) to perform application studies, training, inspections, or demonstrations, and to participate in system installation, repairs, or troubleshooting.
Generative AI Engineer
Globex IT Solutions
South Plainfield, NJ
08.2022 - 03.2024
- Led the development of an emotion-detecting chatbot, utilizing Streamlit to create an intuitive, user-friendly interface for seamless interaction.
- Integrated AI and natural language processing techniques by fine-tuning LLaMA2 models, improving emotional intelligence and response accuracy.
- Enhanced real-time user communication by incorporating OpenAI's Whisper technology for precise voice-to-text capabilities.
- Designed a user-centric chatbot interface, ensuring adaptability and scalability to accommodate various user inputs and scenarios.
- Implemented LangChain's Model I/O module to streamline the interaction between language models and application-specific tasks, improving efficiency in model deployment.
- Developed few-shot prompt templates and incorporated token usage tracking, optimizing performance and ensuring cost-effective utilization of language models.
- Utilized LangChain's Retrieval module to effectively interface with application-specific data, enhancing the chatbot's ability to provide accurate, context-driven responses.
Education
Master's - Information Systems & Technology
Wilmington University
New Castle, DE08.2022
Bachelor's - Mechanical Engineering
Geetanjali Institute of Engineering & Technology
Hyderabad, India12.2019
Skills
Languages:
Python, R, C#, C, SQL, JavaScript, HTML, CSS
Libraries & Frameworks:
Pandas, NumPy, Matplotlib, SciKit Learn, TensorFlow, Keras, PyTorch, Streamlit, LangChain, FAISS, Web Scraping, OpenAI API
Machine Learning & Deep Learning:
Extensive experience with traditional ML algorithms and deep learning architectures (CNN, RNN, LSTM, GANs), transformers, fine-tuning LLaMA2 models, few-shot learning, and generative AI techniques Proven ability to develop and evaluate models using evaluation frameworks for NLP/CV metrics, LLMaaJ, human evaluation, confidence estimation, and RAG methods
Generative AI:
OpenAI API (GPT, DALL-E, Davinci), LangChain, Prompt Engineering, Retrieval-Augmented Generation (RAG), Fine-Tuning, Llama 2, Vector Databases, Whisper API, Model I/O Integration
Model Deployment:
Skilled in deploying production-ready AI models using Docker, Podman Desktop, Kubernetes, and cloud services (AWS, Azure, GCP) Expertise in integrating evaluation pipelines into applications to optimize risk, profitability, and user experience
Databases:
Proficient in SQL (MySQL, PostgreSQL) and NoSQL (MongoDB, Firebase) for managing and analyzing large datasets, Microsoft Access, ODBC DSN
Computer Vision:
Image Processing, Object Detection, Segmentation, X-ray Defect Detection using Deep Learning Models (eg, UPerNet, ConvNextV2)
Additional Tools & Technologies:
Experience with Whisper API for voice-to-text integration, advanced model evaluation techniques, and innovative methods to optimize AI systems for real-world applications
Certification
- Generative AI Models & Architecture
- Applied Generative AI Specialization
- LLM Building
- Machine Learning
- Deep Learning
- RAG with OpenAI
- Prompt Engineering
- Azure AI Fundamentals & ChatGPT
- AWS Cloud
- Cybersecurity and Infrastructure Security Agency (CISA)
- Power BI
- Python
- SQL
Project: Implementing a Variational Autoencoder (VAE) with TensorFlow for Image Generation Using the MNIST Dataset
https://github.com/NikhilNatesh/VAE-with-TensorFlow.git
Project: Generating Fake Images with Generative Adversarial Networks (GANs)
https://github.com/NikhilNatesh/Fake-Images-by-GANs.git
Project: Falcon finetuning on Instacart Dataset
https://github.com/NikhilNatesh/Falcon_Finetuning_7B.git
Project: Radiation Chatbot Without Internet with AI Models using Gardio UI
https://github.com/NikhilNatesh/Radiation-Chatbot.git
Timeline
AI / Applications Engineer
VJ Technologies
04.2024 - Current
Generative AI Engineer
Globex IT Solutions
08.2022 - 03.2024
Master's - Information Systems & Technology
Wilmington University
Bachelor's - Mechanical Engineering
Geetanjali Institute of Engineering & Technology
Similar Profiles
Christopher GillChristopher Gill
Electrical Engineer at VJ TechnologiesElectrical Engineer at VJ Technologies
Holly FreyHolly Frey
Farm Hand at ELA Frey and VJ GradyFarm Hand at ELA Frey and VJ Grady
SANMAN SHETTYSANMAN SHETTY
Scientist II Downstream process transfer (Team lead) at VJ Biosciences Pvt LtdScientist II Downstream process transfer (Team lead) at VJ Biosciences Pvt Ltd