Experienced Principal Solutions Architect and Cyber Operations Specialist with extensive expertise in architecting and managing complex cloud and security solutions. Proficient in DataOps, DevOps, CloudOps, MLOps, and CyberOps. Skilled in designing, automating, and refining cloud infrastructure, adept at orchestrating advanced data pipelines, and integrating state-of-the-art technologies including AWS, Azure, Confluent Kafka, and Kubernetes. Proven track record in leading large-scale projects, directing cross-functional teams, and deploying innovative solutions within dynamic technology landscapes. Enthusiastic about leveraging machine learning to enhance cloud architecture capabilities and employing cutting-edge security strategies to protect information systems. Committed to lifelong learning and professional growth.
Hi, I’m
Chaitanya Sistla
Principal Solutions Architect
Frisco,TX
Summary
Overview
7
years of professional experience
16
Certificates
Work History
Earlywarning Services LLC
DevOps Engineer II
2 2021 - 1 2022
Job overview
- Managed and utilized Cloudera-based Hadoop distributions (CDH and CDP), including HBase, Spark, Hive, and Kafka, demonstrating hands-on expertise in complex data environments and big data processing.
- Achieved a 20% increase in system efficiency through meticulous performance tuning strategies on Cloudera, leading to a 25% reduction in critical task processing time across multiple Hadoop clusters.
- Integrated certificate management solutions with existing IT infrastructure for automated certificate procurement and lifecycle management, enhancing security and compliance within Cloudera environments.
- Configured HashiCorp Vault for dynamic secret generation, utilizing IAM policies for secure and controlled access to sensitive information, enhancing data security in Cloudera platforms.
- Employed service discovery and configuration tools for implementing a microservices architecture with secure communication, enhancing application scalability and reliability within Cloudera-based infrastructures.
- Collaborated with development teams to optimize slow-performing jobs and queries on Cloudera services, resulting in a 30% improvement in system responsiveness. Implemented robust security measures, including Kerberos authentication and diverse TLS levels, reducing vulnerabilities in Hadoop clusters.
- Automated 70% of routine tasks using customized scripts, enabling staff to focus on critical tasks. Leveraged configuration management tools to reduce errors and streamline the deployment process across Cloudera environments.
- Successfully managed a 300-node Cloudera Hadoop cluster with improved performance and stability. Configured environments across Cloudera and GCP, enhancing system adaptability and resilience.
- Implemented comprehensive identity and access management controls for data security, resulting in a significant reduction in unauthorized access and ensuring compliance with security standards.
- Automated snapshot processes and managed data replication across multiple regions, improving system stability and data transfer efficiency within Cloudera environments.
- Proficient in employing Apache Spark on Cloudera for data integration and large-scale processing, contributing to advanced data solutions and analytics capabilities.
- Extensive experience in using JSON for data serialization and communication in Cloudera-based web services and RESTful APIs.
- Proficient in building and deploying microservices in Docker containers on Cloudera, using containerization services and orchestration tools for scalable and efficient application management.
- Skilled in deploying and managing microservices on Kubernetes, with experience in setting up clusters, managing pods, and ensuring high availability and scalability within Cloudera environments.
- Configured environments across Cloudera and other cloud platforms, enhancing system adaptability and performance through advanced configuration management techniques.
- Deployed and managed Apache Kafka on AWS, ensuring high throughput and low latency for streaming data applications.
- Implemented Aerospike databases on AWS, optimizing performance and scalability for real-time data processing needs.
- Managed Elasticsearch clusters on AWS, enabling efficient data search and analysis capabilities across large datasets.
Clairvoyant LLC
DevOps Engineer Contractor | Early Warning
2 2019 - 2 2021
Job overview
- Architected and managed complex data streaming solutions using Confluent Kafka, implementing ksqlDB, Kafka Streams, Kafka REST, and Kafka Connectors to enable real-time data processing and integration.
- Optimized performance and scalability of Confluent Kafka deployments, enhancing data throughput and reducing latency for critical streaming applications across AWS environments.
- Deployed and configured Aerospike databases to support high-performance, low-latency data storage and retrieval, enabling real-time analytics and decision-making within AWS infrastructure.
- Managed Elasticsearch and Apache Solr clusters on AWS, providing robust search and analytics capabilities across large datasets, improving data accessibility and insight generation.
- Developed and integrated Mulesoft APIs to streamline data exchange and application connectivity, enhancing interoperability and data flow across enterprise systems.
- Implemented microservices architecture using Docker and Kubernetes, orchestrating containers for efficient application deployment and scaling within Confluent Kafka environments on AWS.
- Automated deployment and management processes using Jenkins and custom scripts, optimizing infrastructure provisioning and reducing operational overhead within AWS.
- Enhanced data security by implementing IAM policies and encryption protocols, ensuring secure access and data protection within Confluent Kafka and associated data platforms.
- Designed and deployed comprehensive monitoring solutions using Grafana and Prometheus to provide real-time insights into system performance and health on AWS.
- Facilitated cloud migration projects within AWS, transitioning workloads and optimizing cloud resource utilization for cost savings and enhanced performance.
- Developed complex data pipelines with Kafka Streams and Kafka Connectors to integrate various data sources and destinations, ensuring seamless data flow and processing.
- Improved system efficiency by 30% through performance tuning and optimization of data streaming and processing frameworks, enhancing overall application responsiveness.
- Collaborated with cross-functional teams to troubleshoot and resolve system issues, providing expertise in Confluent Kafka and related technologies to ensure system stability and reliability.
- Implemented advanced search capabilities using Elasticsearch and Apache Solr on AWS, enabling fast and efficient information retrieval and analysis for diverse applications.
- Streamlined API management and data integration using Mulesoft, enhancing connectivity and data sharing across cloud and on-premise environments.
B1IT Solutions | ONEngine
Principal Solutions Architect
03.2024 - Current
Job overview
- Designed and implemented data management solutions using Airbyte to efficiently pull data from QuickBooks, PostgreSQL, MSSQL, and AuroraDB into Snowflake, improving data integration and accessibility.
- Secured the entire cloud platform by deploying OpenVPN, configuring Network Access Control Lists (NACLs), AWS Service Control Policies (SCPs), and AWS Web Application Firewall (WAF), ensuring robust security measures.
- Built a comprehensive SIEM data lake by aggregating and analyzing logs from VPC and OpenVPN into OpenObserve, enhancing security monitoring and incident response capabilities.
- Deployed cloud sensors and implemented Extended Detection and Response (XDR) and Endpoint Detection and Response (EDR) solutions using Wazuh, strengthening threat detection and mitigation strategies.
- Successfully configured and deployed the Retool platform on Amazon ECS, enabling rapid application development and operational efficiency.
- Engineered a complex Amazon EKS deployment with multiple namespaces to support diverse application workloads, optimizing resource management and isolation.
- Leveraged AWS security services, including Identity and Access Management (IAM), CloudTrail, and AWS Config, to establish a robust security framework, ensuring secure access controls, audit trails, and configuration compliance across all AWS resources.
- Utilized AWS GuardDuty to monitor and detect potential security threats, implementing automated alerts and responses to enhance the security posture and incident response capabilities of cloud environments.
- Integrated AWS Security Hub to consolidate and manage security findings from multiple AWS services, streamlining security operations and providing a unified view of the organization’s security status, enabling proactive risk management.
- Implemented AWS GuardDuty for real-time threat detection and analysis, integrating with AWS Lambda for automated incident response actions to mitigate potential security breaches swiftly.
- Conducted regular security reviews using AWS Security Hub, identifying vulnerabilities and implementing remediation strategies to continuously improve the security posture of cloud infrastructure.
- Performed comprehensive risk assessments using AWS security tools to identify potential vulnerabilities and implement mitigation strategies, reducing the risk of data breaches and ensuring data integrity.
- Implemented AWS Shield for DDoS protection, safeguarding applications against volumetric attacks and ensuring high availability and performance of critical services.
- Implemented robust monitoring and logging solutions using UptimeRobot and OpenObserve, providing real-time insights and high availability for cloud applications.
- Configured OpenVPN with restricted internet access and disabled split tunneling for various user groups, enhancing data privacy and network security.
- Set up Apache Airflow to automate workflows and optimized the MLOps infrastructure, facilitating efficient machine learning model training and deployment.
- Deployed honeypots to attract and analyze attacker behavior, contributing to proactive threat intelligence and enhanced cybersecurity defenses.
- Utilized Syft and Grype to perform comprehensive vulnerability assessments on container images, ensuring the integrity and security of containerized applications.
- Implemented Gitleaks for automated detection of hardcoded secrets and sensitive information in source code repositories, enhancing code security and compliance.
- Integrated anomaly detection mechanisms within cloud environments to identify and respond to unusual activities, improving overall security posture.
- Ensured compliance with AWS security best practices through the strategic implementation of AWS SCPs and WAF, safeguarding cloud resources.
- Established continuous security monitoring protocols using OpenObserve, enhancing visibility into cloud operations and facilitating quick incident response.
- Spearheaded the implementation of 69 SOC 2 controls across security, compliance, DevOps, IT, and engineering, ensuring all processes met industry standards for data protection and integrity.
- Collaborated with security, IT, and engineering teams to integrate SOC 2 controls into daily operations, fostering a unified approach to risk management and compliance across departments.
- Embedded compliance and security protocols into DevOps pipelines, aligning continuous integration and deployment processes with SOC 2 requirements to enhance operational security.
- Developed and enforced comprehensive security policies covering all 69 SOC 2 controls, ensuring systematic and consistent application across all IT and engineering activities.
- Conducted in-depth risk assessments to identify potential security threats, implementing SOC 2 controls to mitigate risks and strengthen the organization's overall security posture.
- Led internal audits to verify adherence to SOC 2 controls, producing detailed reports that highlighted compliance achievements and pinpointed areas for further improvement.
- Implemented feedback loops and continuous improvement initiatives to refine the application of SOC 2 controls, ensuring ongoing alignment with evolving security and compliance standards.
- Developed and managed CI/CD pipelines using Env0 and Jenkins to automate infrastructure provisioning and dynamic shutdowns, significantly reducing deployment time and operational costs.
- Implemented a comprehensive FinOps strategy to optimize cloud spending, achieving cost savings through resource optimization, usage analysis, and dynamic infrastructure management.
- Led the successful migration of cloud environments across AWS organization accounts, ensuring seamless transitions with minimal downtime and optimized resource allocation.
- Set up and configured Airbyte transformers for efficient data ingestion into Snowflake, streamlining data integration processes and enhancing data accessibility for analytics.
- Implemented network policies and CIS (Center for Internet Security) scanners to ensure security compliance and protect data within Snowflake environments.
- Utilized TrustCloud, a Governance, Risk, and Compliance (GRC) tool, to automate security controls and streamline compliance processes, enhancing the organization's overall security posture.
- Achieved significant cost savings by implementing dynamic shutdowns and automated infrastructure provisioning, reducing unnecessary resource consumption and optimizing cloud expenses.
Securonix
Senior Cloud Service Engineer
03.2022 - 02.2024
Job overview
- Designed and implemented a dynamic Jenkins worker/node architecture on AWS, leveraging EC2 and ECS for on-demand scaling of build and test environments, optimizing resource utilization and reducing build times.
- Advanced proficiency in managing Azure services including Azure Data Factory (ADF), Logic Apps, Azure Kubernetes Service (AKS)
- Utilized Terraform to automate the provisioning of AWS resources for Kafka, ensuring a repeatable and scalable architecture.
- Extensive experience in Azure infrastructure management, including VMs, network configurations, and security implementations.
- Tuned Kafka and AWS RDS instances for optimal performance, ensuring high throughput and low latency in data processing and storage.
- Implemented and managed Kafka and Solr clusters on AWS, ensuring smooth data processing and search functionality.
- Expertise in implementing and managing AWS Load Balancers (ELB, ALB, NLB), optimizing traffic distribution for high availability.
- Demonstrated ability to optimize Azure environments for cost-efficiency, performance, and reliability.
- Skilled in orchestrating containerized applications using AWS ECS and EKS.
- Skilled in utilizing Azure CLI and Azure PowerShell for automation and management tasks.
- Implemented Ansible’s dynamic inventory scripts to manage configurations across AWS.
- Developed sophisticated data transformation and conflict resolution strategies to ensure data consistency across source and target systems.
- Implemented Infrastructure as Code using Terraform for AWS and managed configurations with Ansible.
- Configured and implemented automated machine image creation using Packer on AWS.
- Developed and automated tasks using Python programming and Bash scripting on AWS.
- Proven track record in migrating applications and services to Azure, ensuring minimal downtime and optimal performance.
- Experience in deploying and managing database solutions in the cloud, ensuring high availability and disaster recovery capabilities.
- Experience with Terraform Cloud for collaborating on and managing IaC configurations.
- Conducted cloud spend analysis using AWS Cost Explorer and Infracost, identifying optimization opportunities.
- Proficient in scripting with Python and Azure PowerShell to automate tasks and integrate systems.
- Designed and implemented complex IAM policies to enforce least privilege access across AWS environments, ensuring that users and applications have the appropriate permissions while minimizing potential security risks.
- Configured AWS CloudTrail to capture and analyze API activity logs, enabling detailed auditing and compliance reporting for AWS resources and enhancing transparency and accountability.
- Employed AWS Config to continuously monitor and assess resource configurations, identifying deviations from established best practices and automating remediation actions to maintain compliance with security standards.
Plexus Worldwide
Senior DevOps Engineer
01.2022 - 03.2022
Job overview
- Streamlined deployment processes by implementing Jenkins pipelines and integrating vulnerability check tools, significantly enhancing deployment efficiency and ensuring robust security measures throughout the development lifecycle .
- Strengthened internal and external security measures by developing and implementing Terraform modules, effectively securing AWS infrastructure across four enclaves. Collaborated closely with development teams to define efficient infrastructure and deployment processes, fostering a collaborative and agile work environment .
- Demonstrated adaptability and problem-solving skills by creating both internal and customer-facing software solutions . Conducted extensive research on cloud-based services, successfully building and presenting proof of concepts (PoCs). Documented best practices and process flows for cloud architecture, facilitating seamless deployment and promoting a culture of knowledge sharing within the team.
- Integrated Oracle GoldenGate into disaster recovery plans, ensuring data resilience and availability in case of system failures.
- Utilized NewRelic for end-to-end application performance monitoring, from user experience tracking to server-side metrics.
- Managed AWS S3 for scalable and secure cloud storage solutions, including data backup, archiving, and hosting static websites.
Clairvoyant LLC
Software Engineer
09.2018 - 02.2019
Job overview
- Demonstrated proficiency in managing Mysql and NoSQL databases, executing range of operations including Replace, Insert, Delete, Update, and Create. Applied techniques such as discretization and binning for data manipulation and implemented robust data wrangling methodologies , including data cleaning, transformation, merging, and reshaping of data frames.
- Spearheaded Data Lineage working group, prioritizing and scoping essential efforts to establish comprehensive front-to-back physical lineage from source to upstream systems for Investment Banking and Wealth Management business functions. Documented data lineage, table, and column names, data definitions, and valid values, providing vital insights and data governance metrics to stakeholders and executives .
- Conducted thorough data analysis on real-time and historical data, including comprehensive Data Profiling and Mining activities . Utilized SQLALCHEMY for effective collaboration with Mysql database. Created and delivered insightful Dashboard/Stories leveraging Tableau (Lumera) and Excel, facilitating comprehensive data visualization to present current impacts and growth trends effectively.
Education
Illinois Institute of TechnologyChicago, IL
Master's from computer science
08.2016 - 2018.06
University Overview
GITAM UniversityVisakhapatnam
Bachelor's from Information Technology
06.2012 - 2016.05
University Overview
Skills
Confluent Kafka, Elasticsearch, Neo4j, Hadoop, ClickHouse, Cloudera, Hortonworks, Streamsets, Mulesoft, Apache Spark, HBase, Airflow, Dagster, Solr, Zookeeper, Yarn, Mapreduce, Hive, Oozie, Impala, Key Trustee Server (Cloudera KTS), Cloudera KMS, Ranger, Sentry, Kudu, Nifi, Airbyte
Certification
AWS Certified DevOps Engineer Professional, BK8VN152N2B1QB3H
Timeline
Principal Solutions Architect
B1IT Solutions | ONEngine
03.2024 - Current
Senior Cloud Service Engineer
Securonix
03.2022 - 02.2024
Senior DevOps Engineer
Plexus Worldwide
01.2022 - 03.2022
Software Engineer
Clairvoyant LLC
09.2018 - 02.2019
Illinois Institute of Technology
Master's from computer science
08.2016 - 2018.06
GITAM University
Bachelor's from Information Technology
06.2012 - 2016.05
DevOps Engineer II
Earlywarning Services LLC
2 2021 - 1 2022
DevOps Engineer Contractor | Early Warning
Clairvoyant LLC
2 2019 - 2 2021
Similar Profiles
Rubi RoblesRubi Robles
Soldering Technician at EMS LLC (Engineering Manufacturing Services LLC)Soldering Technician at EMS LLC (Engineering Manufacturing Services LLC)
Owen MurphyOwen Murphy
Accounting Clerk at EZ Accounting Services & Tax Services LLCAccounting Clerk at EZ Accounting Services & Tax Services LLC
VIVIAN SANTILLANESVIVIAN SANTILLANES
Security Site Manager at Weiser Security Services / Securitas Security Services - Coupang Global LLCSecurity Site Manager at Weiser Security Services / Securitas Security Services - Coupang Global LLC