Nithisha
Summary
Software Development Engineer with 3 years of experience in designing scalable data solutions using Azure (Data Factory, Databricks, Synapse) and AWS (S3, Redshift, Glue). Proficient in ETL development, data modelling (Star & Snowflake Schema), and real-time processing with Kafka and Spark Streaming. Skilled in Python, SQL, and PySpark for data transformation, working with relational (SQL Server, MySQL) and NoSQL (Snowflake, MongoDB) databases. Experienced in data governance, quality, and visualization using Power BI. Strong collaborator with Agile expertise and a results-driven approach to data engineering.
Overview
3
3
years of professional experience
Work History
Software Development Engineer
AT&T
01.2024 - Current
- Designed end-to-end data solutions using Azure services, including Data Factory, Synapse, ADLS, and HDInsight, to optimize data processing, storage, and reporting.
- Migrated application logic to Azure, improving data accessibility, efficiency, and cost-effectiveness by 20%.
- Developed scalable ETL pipelines using Azure Data Factory, SSIS, Python, and SQL for seamless data transformation and integration.
- Ensured data governance, security, and compliance while building Power BI and Tableau dashboards integrating data from SQL Server, Oracle, and Excel to drive data-driven decision-making.
- Led data architecture discussions, managed on-premises and cloud data platforms (SQL Server, SSIS, SSRS, SSAS), and implemented DevOps automation for resource provisioning and deployment.
- Conducted gap analyses, collaborated with stakeholders, and applied best practices for scalable data management and reporting solutions.
Software Development Engineer
Charle's Schwab
02.2023 - 11.2023
- Experienced in leveraging AWS services, including S3 for scalable data storage, EMR for large-scale data processing, Glue for serverless ETL automation, and Redshift for advanced analytics
- Led data warehouse migrations to Snowflake, optimizing query performance and reducing operational costs
- Implemented real-time data ingestion pipelines using Kafka and Spark Streaming, enabling rapid insights and timely decision-making
- Built and deployed Spark applications in Databricks for data transformation and analysis
- Maintained data integration programs across Hadoop and RDBMS environments to ensure seamless interoperability
- Automated ETL workflows using Apache Airflow for Change Data Capture (CDC) processes, improving operational efficiency and reducing data latency
- Utilized Sqoop for seamless RDBMS-to-HDFS data transfers, integrated data from lakes and EDWs using SQL and PySpark, and provided stakeholders with actionable insights through advanced reporting and analytics
Software Development Associate
Accenture
11.2021 - 07.2022
- Designed and implemented a cloud-based Data Lake in AWS using Apache Spark and Hadoop for scalable data storage and processing
- Developed Spark and Hive jobs to transform and summarize large datasets efficiently, leveraging Scala, Spark-SQL/Streaming, and RDD transformations to enhance system performance
- Built data pipelines using Kafka, HBase, Spark, and Hive to process and analyse customer behavioural data
- Utilized Sqoop for seamless data migration from Oracle to Hadoop, optimizing storage with Parquet format
- Created Hive External tables to facilitate data staging and implemented in-memory computation in Spark RDD for faster processing
Education
Masters - Computer Science
Trine University
Allen park, MI12.2023
Bachelors - Information Technology
Vignan's Lara
12.2021
Skillset
Hadoop, Hive, YARN, Kafka, Sqoop, Oozie, Zookeeper, Spark, MySQL, SQL Server, PostgreSQL, Oracle, HBase, Snowflake, Cassandra, MongoDB, Amazon Web Services (AWS), Amazon Redshift, Microsoft Azure, Azure Blob Storage, Azure Data Factory, Power BI, Tableau, SSRS, SQL, PL/SQL, T-SQL, Unix, Python, Linux, Windows, macOS, Agile, Scrum, Waterfall
Timeline
Software Development Engineer
AT&T
01.2024 - Current
Software Development Engineer
Charle's Schwab
02.2023 - 11.2023
Software Development Associate
Accenture
11.2021 - 07.2022
Masters - Computer Science
Trine University
Bachelors - Information Technology
Vignan's Lara
Similar Profiles
Elda BenitezElda Benitez
Sales Manager Representative at AT&TSales Manager Representative at AT&T
MURICEO FELIXMURICEO FELIX
Premier Service Consultant at AT&TPremier Service Consultant at AT&T
Brandon GrissomBrandon Grissom
Wire Technician at AT&TWire Technician at AT&T
Kathy ValladaresKathy Valladares
Associate Director at AT&TAssociate Director at AT&T
SUJAY HEGDESUJAY HEGDE
Software Development Engineer 3(Staff Software Engineer) at AtlassianSoftware Development Engineer 3(Staff Software Engineer) at Atlassian