Karthik Nandanavanam
Midvale,UT
Summary
With over 14 years of experience in software design, development, testing, debugging, performance tuning, data discovery, and metrics analysis, currently serving as a Staff Software Engineer at Qualtrics LLC. Part of the Data Platform Team, responsible for coding, testing, deployment, data storage, and database management for scalable and highly available systems within a hybrid global cloud infrastructure. In addition to technical responsibilities, also mentor new team members, continuously improve system architecture, collaborate with multiple teams, and address vulnerabilities. Previously, made significant contributions to the Big Data Team as a Principal Developer at Overstock Inc.
Overview
13
13
years of professional experience
1
1
Certification
Work History
Staff Software Engineer
Qualtrics
08.2020 - Current
- Developed microservices for automated dataset processing, optimizing Spark SQL for enhanced performance.
- Managed MongoDB, achieving a 30x improvement in read/write speed and an 80% reduction in transformation time.
- Rewrote Spark processing code to enhance flexibility and performance.
- Implemented auto-scaling on Kubernetes, reducing costs by 75%.
- Proposed future architecture for the Transformation Service.
- Served as a tech leader, making design decisions, onboarding teams for Transform map datasets, and contributing to company-wide coding standards.
Principal Software Engineer
Overstock
09.2018 - 08.2020
- Developed Data Quality Metrics and APIs, ensuring reliable and accurate data insights.
- Transformed legacy Pig Jobs to Spark, enhancing performance and maintainability.
- Designed and optimized Sponsored Product Ranking and CPC calculations, improving ad targeting efficiency.
- Analyzed customer behavior through cross-device fingerprinting, contributing to more personalized user experiences.
- Developed a customer segmentation system for on-site and third-party campaigns via MParticle, collaborating with multiple teams to integrate data platforms.
Big Data Engineer ||
Overstock
06.2016 - 08.2018
- Developed utility APIs for processing and integration tools (Pig, Sqoop, Hive, Kafka, etc.).
- Implemented real-time monitoring for abandoned carts, email campaigns, and CDN traffic costs.
- Created an in-house Omniture Tracking System for near real-time data reporting, saving $500K annually.
- Developed a customer keyword path identification system using the Apriori algorithm.
- Enhanced SEO with long-tail search keywords for high-value products.
Software Engineer II
Overstock
01.2014 - 06.2016
- Developed generic processes for archiving, compressing, rectifying, and exporting data in Hadoop.
- Created and monitored an in-house Omniture Tracking System, tracking key metrics such as product views, scroll pages, and click-through rates to improve site rankings and recommendations.
- Developed APIs and reusable functions for Hadoop tools (Pig, Sqoop, Hive, etc.), enhancing data integration and processing capabilities.
- Implemented cart tracking, keyword usage, click tracking, and long-tail search keywords to enhance SEO and manage traffic costs.
- Archived CDN image logs and bot requests, managing traffic costs and improving SEO through Google Bot Indexing.
Software Engineer I
Overstock
01.2011 - 12.2013
- Developed front-end and back-end systems to manage attributes for overstock products, using Java, Spring, REST, and other technologies.
- Created applications and Market Partner Web Services for outsourcing overstock products to third-party sites, handling orders and returns.
- Built a Java sourcing engine to manage order operations, replacing the ERP system and improving efficiency.
- Utilized UPS Service APIs to build accurate delivery estimates for shipments.
- Created a comparator project to compare different versions of the Java sourcing engine, ensuring consistency and performance.
Education
Master of Science - Computer Science
University of Akron
Akron, OH12.2010
Bachelor of Science - Computer Science
NBKR Institute of Science And Technology
India 04.2008
Skills
- AWS: Glue, Athena, EC2, Aurora, Kinesis, Kinesis Firehose, S3, DynamoDb, Lambda, Cloudformation, Cloudwatch, IAM
- Metrics: Grafana, Prometheus, Qualtrics Dashboards
- Search Engines: Elasticsearch, Kibana
- SQL / NoSQL / Graph: MySQL, Oracle, TeraData, Sqllite3, Hive, Phoenix, HBase, Cassandra, MongoDB, MemSql, Neo4J
- Messaging Services: JMS, Kafka, RabbitMQ
- Caching: MemCache, Redis, Guava CacheBuilder, Caffeine
- Languages: Scala, Java, Pig, Basics of JavaScript, Python 3
- Java APIs: Spring boot, Hibernate, REST, Regex, log4j2, Guava, JSoup
- Scala APIs: Scallop, PureConfig, Phantom, Finagle
- Third-party APIs: Maxmind GeoIP2, DeviceAtlas, Facebook Ads, DoubleClick, MParticle, UPS, Sears
- IDEs: Intellij, PyCharm, Jupyter, Atom, Visual Studio
- OS: Ubuntu, Cent OS, MacOS
- File compressions: Snappy, bzip2, zip, targz
- File formats: Text, Apache Log, CSV, JSON, XML, YAML, ORC, Parquet, Avro, SequenceFile, RCFile, Properties, rpm, jar
- CI/CD: Jenkins, Maven, SBT, Git, Kubernetes, Nomad, Docker, Splunk, SumoLogic, Graphite, Hashicorp Vault, consul, JIRA
BigData: Mapreduce, Yarn, Storm, Apache Spark, Spark GraphX, Apache Sqoop, Flume, Oozie, AirFlow, NiFi, Zeppelin
Certification
- Java SE Certification
- Amazon Web Cloud Practitioner
Timeline
Staff Software Engineer
Qualtrics
08.2020 - Current
Principal Software Engineer
Overstock
09.2018 - 08.2020
Big Data Engineer ||
Overstock
06.2016 - 08.2018
Software Engineer II
Overstock
01.2014 - 06.2016
Software Engineer I
Overstock
01.2011 - 12.2013
Master of Science - Computer Science
University of Akron
Bachelor of Science - Computer Science
NBKR Institute of Science And Technology
- Java SE Certification
- Amazon Web Cloud Practitioner