Summary
Overview
Work History
Education
Skills
Certification
Timeline
Generic

Shankar Perumalla

Franklin,MA

Summary

Accomplished Sr. Data Engineer with a proven track record at the Dept. of Elementary and Secondary Education, enhancing data processing efficiency by implementing ELT integration patterns using PySpark. Expert in leveraging AWS and Tableau 2022, demonstrating innovative problem-solving skills and a collaborative approach with IT and business teams. Achieved seamless migration of ODI mappings to PySpark jobs, significantly streamlining data transformation processes.

Overview

14
14
years of professional experience
1
1
Certification

Work History

Sr. Data Engineer / Developer

Dept. of Elementary and Secondary Education
Boston, USA
09.2017 - Current
  • Designed and implemented ELT integration patterns using PySpark, enhancing data processing efficiency
  • Spearheaded the development of a framework to seamlessly migrate existing ODI mappings to PySpark jobs, streamlining the data transformation process
  • Utilized PySpark and SparkSQL to orchestrate data processing on Apache Spark within Amazon EMR, leveraging STMs to drive critical transformations
  • Designed packages in SSIS with various complex transformations such as derived column,, conditional split, lookup, aggregation, execution SQL tasks
  • Used CDC, Transfer Data Encryption TDE and Policy based management in SSIS
  • Build Synchronous and Asynchronous scripting component for different modes of output
  • Developed diverse Tableau data visualizations, including Cross tabs, Heat maps, Box and Whisker charts, Scatter Plots, Geographic Maps, Pie Charts, Bar Charts, and Density Charts
  • Implemented complex chart features, such as donut charts and bar charts within tooltips
  • Leveraged advanced analysis techniques, actions, calculations, parameters, background images, maps, trend lines, statistics, and table calculation
  • Successfully completed a Proof of Concept (POC) focused on migrating Tableau dashboards to PowerBI
  • In the POC, harnessed PowerBI's capabilities for advanced analytics, encompassing actions, calculations, parameters, background images, map visualizations, trend lines, groupings, hierarchies, detailed summary reports, and Key Performance Indicator (KPI) dashboards
  • Wrote complex queries in T-SQL, Oracle, and Snowflake data bases using joins, correlated and non-correlated sub-queries for business requirement
  • Used advanced features of T-SQL in order to design and tune T-SQL to interface the database and other applications in most efficient manner
  • Utilizing Microsoft Office 365 including Word, Excel, PowerPoint, and Outlook
  • Collaborated effectively with both Business and IT teams to propose innovative solutions and strategies tailored to business needs
  • Environment: Python, AWS, Tableau Desktop 2022.x Tableau server / Administrator, SSIS, PowerBI Desktop, Snowflake, Oracle, MS SQL Server, Jira, Microsoft Office 365

Sr. BI Analyst

United Health Group
Chicago, USA
09.2016 - 09.2017
  • Conducted in-depth analysis and reviewed functional documents, creating technical specifications for Tableau, BODS, and BO
  • Provided post-development support for reports during the given warranty period
  • Engaged in direct communication with clients to understand the business impact in case of job failures
  • Prepared comprehensive Interface Detail Design documents, including DataFlow Design, Functional Design, Workflow Design, and important briefing documents, aligning them with business requirements
  • Extracted data from various sources, such as IBM Netezza, text files, and Excel documents, to meet data integration needs
  • Implemented dynamic frontend workarounds on Tableau dashboards, allowing selected areas to be hidden based on user privileges
  • Assisted client reporting teams in transitioning from traditional static Excel reporting to interactive and powerful Tableau dashboards
  • Analyzed relational database models to design Tableau associative data models, catering to specific business requirements
  • Developed dashboards with multiple worksheets, linear graphs, pie charts, and crosstab, employing Tableau functionalities like sets, parameters, and groups
  • Conducted research and troubleshooting of technical issues, providing ongoing Tableau-based application consultation to the development team
  • Collaborated with peers on data validations and participated in code reviews to ensure high-quality deliverables
  • Conducted Tableau functionality demos for prospective Line of Business and actively trained end users on Tableau capabilities
  • Leveraged data blending and embed functionalities in Tableau to enhance data insights
  • Managed report schedules, data connections, projects, and groups in Tableau Server to streamline reporting processes
  • Environment: Tableau Desktop 2019.2, 10.4 Tableau server / Administrator, IBM Netezza, SAP Business Objects, MS Excel

Senior Consultant

Capgemini
Hyderabad, India
03.2013 - 08.2016
  • Company Overview: HSBC Holdings plc
  • Led a team of five members, closely collaborating on requirements gathering to support Customer Classification Final regulations and specific UK requirements
  • Adhered to CMMi Level 3 standards in documentation and code development, creating functional specification and technical specification documents
  • Developed logical and physical data models using ERWIN and Star Schema, capturing current state/future state data elements and data flows
  • Utilized ERWIN for reverse engineering and customized hosting based on business requirements for existing models
  • Designed Cognos 10.1.1 reports with calculations, filters, drill-throughs, and charts, enabling easy access to different summary reports through a common portal
  • Built various types of reports using Cognos, including list reports, drill-through reports, and master-detail reports
  • Leveraged Cognos Report Studio and Query Studio for creating complex reports involving multiple prompts and burst reports
  • Demonstrated deep expertise in designing and developing Tableau visualization solutions, gathering user requirements, and analyzing software solutions accordingly
  • Created dashboards and reports in Tableau 10.2, maintaining server activities, user activity, and customized views on Server Analysis
  • Prepared business requirement documents and plans for creating Tableau dashboards
  • Utilized calculations and parameters in Tableau for dashboard preparation and maintenance
  • Automated administrative activities using Tabcmd, ensuring efficiency and ease of use
  • Played a consultant role, providing solutions and expertise to customers
  • Conducted Tableau training for business users, educating them on Tableau's capabilities
  • Employed advanced analysis techniques like Actions, Calculations, Parameters, Background images, and Maps in Tableau
  • Developed interactive dashboards and ad-hoc reporting
  • Wrote custom HQLs to extract data from Hive Tables
  • Administered projects, groups, users, and user groups in Tableau, scheduling report instances as needed
  • Assisted users in creating and modifying worksheets and data visualization dashboards
  • Managed Tableau server logons and security checks, ensuring proper permission sets for users, groups, and projects
  • Collaborated with Business Analysts and Data Modelers, defining mapping documents and design processes for various data sources and targets
  • Published dashboards on the Tableau server, granting appropriate access to associated groups as Interactors or Viewers
  • Proficiently utilized Tabcmd commands for creating backups and restoring backups of the Tableau repository
  • Actively engaged with business stakeholders, gathering and understanding user requirements
  • HSBC Holdings plc
  • Environment: IBM Cognos 10, Tableau Desktop 10.2, Tableau server / Administrator, Horton Works, Jira, Automic

Consultant

Capgemini
Hyderabad, India
09.2012 - 03.2013
  • Company Overview: AIG Chartis
  • Proficiently utilized Cognos Framework Manager, Report Studio, Analysis Studio, and Transformer to deliver comprehensive reporting solutions
  • Translated reporting requirements and business data models into a Framework Manager model, ensuring alignment with reporting needs
  • Created Data Source Query subjects, Model query subjects, and Stored Procedure Query subjects in Framework Manager, tailored to specific business requirements
  • Designed logical models adhering to star schema concepts and various views (import, business, and external) to meet business needs
  • Employed DMR metadata modeling in Framework Manager for dimensional data, successfully publishing packages in the portal
  • Implemented Framework Manager security to manage data access, object-level access, and package access effectively
  • Developed Dimensional Reports (DMR Reports) utilizing different OLAP data sources for data exploration
  • Created diverse types of reports, including Simple lists, Complex Lists, Cross tabs, Drill-through, and Dashboards for various Lines of Business
  • Utilized conditional formatting, conditional blocks, Render variables, Functions, and Conditional Variables to enhance report presentation
  • Designed Prompts, Cascading prompts, and Date Range Reports to enable dynamic selection of values by users
  • Developed Executive Dashboard reports using Cognos Report Studio for high-level data insights
  • Leveraged Business Insight and Business Insight Advanced to create rich Dashboards and reports
  • Incorporated HTML/JavaScript in Cognos report studio reports as required, enhancing report interactivity
  • Actively involved in customizing Cognos connection and implementing appropriate reports and security measures
  • Administered Cognos, assigning User groups and User roles with access permissions for seamless reporting access
  • Efficiently deployed reports and packages from development to testing and production environments
  • Skillfully resolved issues arising from User Acceptance Testing (UAT), ensuring smooth report functionality
  • Ensured timely delivery and development of reports and reporting applications, meeting customer requirements effectively
  • AIG Chartis
  • Environment: Cognos 10.1 (Framework Manager, Cognos Connection, Query Studio, Report Studio), SQL Server 2008 and Windows 2008 Server

Software Developer

Trinus / Mannara Technologies
Mumbai, India
11.2010 - 08.2012
  • Company Overview: Kaiser Permanente
  • Collaborated with users to define reporting requirements for various services and processes, utilizing Cognos 8.2 series
  • Organized reporting applications, such as Report Studio, into categorized folders within Framework Manager, specifically for the sales and distribution department
  • Developed Extraction, Transformation, and Loading (ETL) Packages using Microsoft SSIS 2005, ensuring efficient data processing
  • Modeled metadata from SQL Server 2005 data sources for utilization in Report Studio and Query Studio, streamlining data access
  • Created professional reports in Report Studio and ad hoc reports in Query Studio, catering to diverse reporting needs
  • Actively involved in Query Optimization, employing techniques to improve query performance
  • Additionally, developed Query Prompts, Prompt pages, and Conditional variables for enhanced interactivity
  • Participated in the analysis of financial statement reports (Monthly/Quarterly/Yearly), providing support and maintenance for reports within the Cognos 8 BI environment
  • Scheduled reports in Cognos Connection, configuring them to run on a daily, weekly, or monthly basis, ensuring timely and automated report delivery
  • Prepared comprehensive Functional and Technical specifications, Use Cases, Test Cases, and report specification documents, streamlining the development process
  • Deeply engaged in the development, Unit Testing, System Testing, and User Acceptance Testing phases, ensuring high-quality deliverables and user satisfaction
  • Kaiser Permanente
  • Environment: Cognos 8.2, SSIS 2005, SQL Server 2005 and Windows 2003 server

Education

Master of Computer Applications -

Jawaharlal Nehru Technological University
Hyderabad, India
01.2010

Bachelor of Computer Science -

Osmania University
India
01.2006

Skills

  • AWS
  • Azure
  • Databricks
  • Tableau 2022
  • Tableau 2021
  • Looker
  • IBM Cognos 11
  • IBM Cognos 10X
  • IBM Cognos 8X
  • Cognos TM1 94
  • SSRS 2014
  • SSIS 2019
  • Data stage 85
  • ERwin 9x
  • Snowflake
  • Netezza
  • Terada
  • DB2
  • Oracle
  • MS SQL Server
  • Windows
  • Linux
  • Mac
  • Microsoft Office 365
  • TOAD version 86
  • HP Quality Center
  • HTML
  • Java Script

Certification

  • Cloudera Certified Associate (Spark and Hadoop Developer)
  • IBM Cognos 10 BI Author
  • Microsoft Business Intelligence Development and Maintenance

Timeline

Sr. Data Engineer / Developer

Dept. of Elementary and Secondary Education
09.2017 - Current

Sr. BI Analyst

United Health Group
09.2016 - 09.2017

Senior Consultant

Capgemini
03.2013 - 08.2016

Consultant

Capgemini
09.2012 - 03.2013

Software Developer

Trinus / Mannara Technologies
11.2010 - 08.2012

Master of Computer Applications -

Jawaharlal Nehru Technological University

Bachelor of Computer Science -

Osmania University

Similar Profiles

  • Dineen Casilli

    Dineen CasilliDineen Casilli

    Administrative Officer at MA Dept. of Elementary and Secondary EducationAdministrative Officer at MA Dept. of Elementary and Secondary Education

  • Elizabeth A. Savidge

    Elizabeth A. SavidgeElizabeth A. Savidge

    Missouri Leadership Development Specialist (MLDS) at Dept of Elementary and Secondary EducationMissouri Leadership Development Specialist (MLDS) at Dept of Elementary and Secondary Education

  • Sara Taj

    Sara TajSara Taj

    Primary School Teacher at Elementary & Secondary Education Dept,KPKPrimary School Teacher at Elementary & Secondary Education Dept,KPK

  • Michael Goss

    Michael GossMichael Goss

    Firefighter/Paramedic at Foxborough Fire DepartmentFirefighter/Paramedic at Foxborough Fire Department

  • Rosalind Hobbs

    Rosalind HobbsRosalind Hobbs

    Lead at DHL Supply ChainLead at DHL Supply Chain

CREATE PROFILE
Shankar Perumalla