Stata, Excel, Microsoft Office (Word, Powerpoint)
Quantitative Research Expert with eight years of research experience in the international context specializing in Survey Research, Fieldwork Management, Data Quality Assurance, and Quantitative Analysis of large and complex datasets. Detail-oriented professional with extensive experience managing and supporting international research projects focused on agriculture, micro-finance, education, nutrition, poverty, and women's empowerment. Thoughtful analyst with a passion for asking big questions and telling stories with data.
Survey Design, Engineering, and Implementation
undefinedStata, Excel, Microsoft Office (Word, Powerpoint)
SurveyCTO, Qualtrics, Snap Survey, Tangerine
SPSS, Python, SQL, Tableau
Primary Quantitative Analyst, USAID/Pakistan Reading Project (PRP) Endline Assessment (September 2020 – Present). USAID/Pakistan engaged NORC to conduct the endline assessment for the Pakistan Reading Project (PRP), a $165 million, seven-year initiative launched in July 2013. The endline assessment involved conducting Early Grade Reading Assessments (EGRAs) via tablet with students who recently completed grade 2 in two PRP intervention provinces (N=3,500 students across 279 schools). Alex served as primary quantitative analyst for the endline evaluation where he conducted all data processing, post-processing quality review, cleaning, merging, indicator construction, and regression analysis on endline EGRA, teacher, and head teacher data, separately for each region. In addition, Alex successfully replicated results from prior rounds and used this information to generate endline indicators in an identical way as well as impute important population information used to generate the final sampling weights. This also included the presentation of OLS regression results of reading outcomes on various indicators typically associated with reading performance. During the analysis phase, Alex was responsible for the generation of all quantitative output including tables and figures including the generation of dozens of attractive charts and graphics used during a mission-wide presentation of results. During the mission-wide presentation, Alex presented findings on the time series estimators or estimated “COVID impact” on reading outcomes. Following the presentation, Alex was responsible for producing report sections including in-depth write-ups for all quantitative results across several evaluation questions including discussions of endline levels, changes in reading scores over time, differences across treatment groups, and differences across gender of student. Once accepted, results were ultimately presented to government officials at region-level dissemination events as well as the CIES 2022 Conference.
Primary Quantitative Analyst, USAID/Nepal Assessment of Effectiveness of Local Governments in Nepal to Address the COVID-19 Crisis (June 2020 – May 2021). Under the DRG-LER Contract, USAID/Nepal asked NORC to design and undertake research on the Nepali local governments’ (LGs) response to COVID-19. Alex served as primary quantitative analyst for this project, where he was responsible for the management and implementation of the quantitative data collection and associated analysis. During the design phase, Alex was responsible for drafting the Concept Note, subcontracting with local data collection firm Solutions Limited, and drawing the quasi-random municipal-level and respondent-level samples. Alex also drafted the quantitative survey instruments based on the evaluation questions and initial findings from the qualitative data collection and programmed both instruments using Qualtrics. During the field period, Alex disseminated the survey via e-mail and monitored survey results and questions from respondents in real-time while also managing a team of enumerators who conducted supplemental interviews via phone. Following successful completion of data collection, Alex conducted all data cleaning and analysis including generating attractive graphics presenting all survey results and producing associated write-ups. These graphics were ultimately used to present quantitative results during two separate mission-wide presentations with relevant USAID stakeholders.
Primary Quantitative Analyst, Endline Performance Evaluation of the USAID/Kenya and East Africa (USAID/KEA) Tusome Initiative (May 2019 – December 2020). Through the Reading and Access (R&A) contracting mechanism, USAID/KEA engaged NORC to conduct the Endline Performance Evaluation of the Tusome Project, also known as the “Let’s Read!” Initiative. For this evaluation, Alex performed all survey programming, real-time data quality review, and coordination of subcontractor data collection activities (N=5,000+ students across 204 schools in Kenya). Prior to survey launch, Alex was responsible for programming and pre-testing of all survey tools including a complex sampling tool to randomly sample students according to sampling protocol depending on how many boys/girls were in the class, the Early Grade Reading Assessment (EGRA) itself, supplementary pupil interview, teacher interview, head teacher interview, and classroom observation tool. The EGRA tool was programmed in Tangerine while all other instruments were programmed in SurveyCTO, with special attention paid to ensure programming matched exactly with what was done in prior rounds where applicable. Following survey launch, Alex performed all data management and quality review tasks including extensive reconciliation across surveys to confirm each school was complete before giving teams approval to proceed. Given the scale and very aggressive 3‐week window for data collection based on MOE approvals, data was downloaded and in‐depth DQR was conducted daily to catch and address issues with specific cases, teams, or enumerators in real‐time. In addition, significant oversight and other quality control measures were taken including matching and review of co-enumerations to generate inter-enumerator reliability scores, and back check surveys on a random sample of schools, to check if percentage of difference was within an acceptable margin of error. In tandem, these checks were used to flag enumerators or teams with low rate of agreement or other stability issues for retraining as necessary. Following the successful completion of data collection, Alex conducted initial cleaning and analysis of EGRA survey data, constructed various datasets and indicators of interest, performed statistical tests to determine magnitude and significance of changes across rounds, and produced tables and visualizations of key indicators used to debrief the client and other relevant stakeholders on preliminary findings.
Survey and Data Quality Manager, Endline Impact Evaluation of the U.S. Department of Labor (DoL), Bureau of International Affairs (ILAB) Assessing Progress in Reducing Child Labor in Cocoa Production in Cocoa Growing Areas of Côte d’Ivoire and Ghana Project (October 2018 – December 2020). NORC was contracted by ILAB to conduct the Endline for an Impact Evaluation of a child labor in cocoa project being implemented in Côte d’Ivoire and Ghana. For this evaluation, Alex served as Survey and Data Manager, managing an extremely complex data quality review / monitoring system for all evaluation surveys. In practice, this entailed concurrent monitoring of 6 separate survey instruments across 2 distinct populations (Main and Industry farmers) in both Ghana and Cote d'Ivoire for a total of 24 concurrent surveys. The total sample included over 10,000 youth from more than 5,000 households. Data Management responsibilities included performing daily data quality review, processing of all cleaning and ID fixes, reporting of critical feedback to the subcontractor, producing regular progress reports for ILAB, and internal reporting of progress and major updates. The primary challenge was to conduct real-time reconciliation across all surveys and compare with field reports to ensure all data was being collected and to take action to correct any missing, unusable, or otherwise low-quality data. In addition, given the scale of the project, significant time was spent performing enumerator stability checks to diagnose bias or even fraud among enumerators. Alex’s role included significant communication with the subcontractor to ensure the timeline was adhered to, targets were being achieved, and that teams were following sampling protocol and survey protocols. Over the course of the data collection, multiple teams and enumerators were flagged as having quality issues in each country. In some cases, this resulted in retraining of all enumerators on certain questions and procedures, targeted retraining of certain enumerators on specific questions and modules, or even the dismissal of several enumerators suspected of fraud in each country (necessitating the replacement of all of their cases). Since the data collection timelines overlapped, there were several weeks where these DQR tasks were being managed concurrently. Following successful completion of data collection in both countries, Alex cleaned and prepared data for delivery, including construction of various indicators for analysis.
Trainer and Data Manager, Impact Evaluation of the USAID/Eastern and Southern Caribbean (USAID/ESC) Community, Family and Youth Resilience (CFYR) Program (July 2017 – January 2020). NORC has been contracted by USAID/ESC and Social Impact as a data collection subcontractor for an Impact Evaluation of the Community, Family and Youth Resilience (CFYR) family counseling program, which seeks to reduce the likelihood that targeted youth aged 10-17 will be involved in the criminal justice system by reducing likelihood that the youth will be engaged in crime or violence in Guyana, St. Lucia, and St. Kitts and Nevis. Since Baseline, Alex has been involved in various facets of the project across each of the three round to ensure the successful implementation of the two RCT panel surveys, the Youth Service Eligibility Tool (YSET) and the Caregiver Survey. At Baseline and Midline, Alex led or co-led all enumerator training activities, including drafting of training materials, finalization of survey tools, and travelling to each of the countries to train enumerators and supervisors on survey requirements and best-practices. During Baseline, Alex also led cognitive testing activities, hosting focus group discussions with local parents in each country to ensure language used in the Caregiver survey was appropriate and well understood. In addition, Alex served as Data Manager, performing all data monitoring, DQA, and cleaning tasks. This also involved regular communication, data delivery, and sample reconciliation with the implementer to allow for continued implementation of the CFYR project, as well as similar communication with the PIs to ensure they had everything they needed to conduct analysis. At Endline, Alex moved to a more advisory role, building capacity of additional NORC staff to conduct the remaining data tasks and enumerator trainings, while also retaining data management responsibilities for all surveys in Guyana. Over the course of the evaluation, Alex led more than 10 enumerator trainings and focus groups in Guyana, St. Lucia, and/or St. Kitts over six total in-country field visits.
Analyst and Data Collection Manager, Impact Evaluation of the IFC’s Global Agriculture and Food Security Program Private Sector Window (GAFSP PrSW) Investment in the Malawi Mangoes Outgrower Program (August 2016 – May 2019). NORC was contracted by the IFC to conduct an Impact Evaluation of the IFC’s GAFSP PrSW investment in the Malawi Mangoes Outgrower Program. The IE involved a 2.5 hour Baseline-Endline RCT panel tablet survey of 1,500 Outgrower farmer households. Alex acted as Analyst and Data Collection Manager across both rounds of the evaluation, supporting the Evaluation Manager with questionnaire design, survey testing, drafting of training materials, data collection management, data quality review, analysis, and write-up of survey results. At Endline, Alex travelled to Salima, Malawi to train field supervisors and enumerators and to oversee the Endline Pilot. During both fielding periods, Alex provided oversight of the data management process by conducting daily data quality review (including backcheck reconciliation) to ensure the high quality data collection was carried out according to the sampling protocol and EDR. Alex performed all baseline data analysis including the construction of all indicators, imputation of data, output of results, and data visualization. Finally, Alex contributed substantially to the writing of the draft baseline report including all data descriptions including demographics, hunger and food security, poverty, agricultural production, and female empowerment. This also included multiple rounds of editing based on client comments.
Analyst and Survey Programmer, Performance Evaluation of USAID/Georgia the Momavlis Taoba (“Future Generations”) Civic Education Program (September 2015 – January 2018). NORC was contracted to conduct an impact evaluation of the USAID/Georgia Performance Evaluation of the Momavlis Taoba (MT) (“Future Generations”) Project, which aims to promote greater civic engagement of young people and expand and institutionalize secondary school civics education curricula and practical applications in the former Republic of Georgia. As part of the IE, NORC administered a three-round panel survey to students in schools throughout the Republic of Georgia, with nearly 10,000 surveys completed per round for a total of over 30,000 completed surveys. In his role as Analyst and Survey Programmer, Alex programmed the English and Georgian PAPI survey tools using Snap Survey Professional 11. Alex was also involved in the design of the survey instrument and worked to obtain IRB approval across each wave. At Baseline, Alex travelled to Tbilisi for two weeks in October-November 2015 where he provided Data Entry Training to local partner CRRC, observed enumerator training, and was on-call to resolve any survey-related issues as needed. In preparation for field work, Alex drafted training manuals and Powerpoint slides to train data entry staff. Following the administration of the each round of the survey, Alex performed extensive data cleaning and quality review, collaborated with CRRC to correct issues and update protocols as needed based on findings, and produced a summary statistics report for USAID. Following the completion of the IE, Alex supported the PI with the drafting of a final Evaluation Report.
Panelist, Comparative and International Education Society (CIES) Conference 2022, Attaining Literacy, Pedagogical, and Development Goals During COVID-19, Formal Paper Presentation of "Evidence from USAID's Pakistan Reading Project (PRP) in the Context of COVID-19"
Malawi, Guyana, St. Kitts and Nevis, the Republic of Georgia
Primary Quantitative Analyst, USAID/Pakistan Reading Project (PRP) Endline Assessment (September 2020 – Present). USAID/Pakistan engaged NORC to conduct the endline assessment for the Pakistan Reading Project (PRP), a $165 million, seven-year initiative launched in July 2013. The endline assessment involved conducting Early Grade Reading Assessments (EGRAs) via tablet with students who recently completed grade 2 in two PRP intervention provinces (N=3,500 students across 279 schools). Alex served as primary quantitative analyst for the endline evaluation where he conducted all data processing, post-processing quality review, cleaning, merging, indicator construction, weighting, and regression analysis on endline EGRA, teacher, and head teacher data, separately for each region. This also included the presentation of OLS regression results of reading outcomes on various indicators typically associated with reading performance. During the analysis phase, Alex was responsible for the generation of all quantitative output including tables and figures including the generation of dozens of attractive charts and graphics used during a mission-wide presentation of results. During the mission-wide presentation, Alex presented findings on the time series estimators or estimated “COVID impact” on reading outcomes. Following the presentation, Alex was responsible for producing report sections including in-depth write-ups for all quantitative results across several evaluation questions. Once accepted, results were ultimately presented to government officials at region-level dissemination events as well as the CIES 2022 Conference.
Primary Quantitative Analyst, USAID/Nepal Assessment of Effectiveness of Local Governments in Nepal to Address the COVID-19 Crisis (June 2020 – May 2021). Under the DRG-LER Contract, USAID/Nepal asked NORC to design and undertake research on the Nepali local governments’ (LGs) response to COVID-19. Alex served as primary quantitative analyst for this project, where he was responsible for the management and implementation of the quantitative data collection and associated analysis. During the design phase, Alex was responsible for drafting the Concept Note, subcontracting with local data collection firm Solutions Limited, and drawing the quasi-random municipal-level and respondent-level samples. Alex also drafted the quantitative survey instruments based on the evaluation questions and initial findings from the qualitative data collection and programmed both instruments using Qualtrics. During the field period, Alex disseminated the survey via e-mail and monitored survey results and questions from respondents in real-time while also managing a team of enumerators who conducted supplemental interviews via phone. Following successful completion of data collection, Alex conducted all data cleaning and analysis including generating attractive graphics presenting all survey results and producing associated write-ups. These graphics were ultimately used to present quantitative results during two separate mission-wide presentations with relevant USAID stakeholders.
Primary Quantitative Analyst, Endline Performance Evaluation of the USAID/Kenya and East Africa (USAID/KEA) Tusome Initiative (May 2019 – December 2020). USAID/KEA engaged NORC to conduct the Endline Performance Evaluation of the Tusome Project, also known as the “Let’s Read!” Initiative. For this evaluation, Alex performed all survey programming, real-time data quality review, and coordination of subcontractor data collection activities (N=5,000+ students across 204 schools in Kenya). Prior to survey launch, Alex was responsible for programming and pre-testing of all survey tools in SurveyCTO and Tangerine including a complex sampling tool to randomly sample students. Following survey launch, Alex performed all data management and quality review tasks including extensive reconciliation across surveys to confirm each school was complete before giving teams approval to proceed. Given the scale and very aggressive window for data collection, in‐depth DQR was conducted daily to catch and address issues with specific cases, teams, or enumerators in real‐time. In addition, significant oversight and other quality control measures were taken including matching and review of co-enumerations to generate inter-enumerator reliability scores, and back check surveys on a random sample of schools. In tandem, these checks were used to flag enumerators or teams with low rate of agreement or other stability issues for retraining as necessary. Following the successful completion of data collection, Alex conducted initial cleaning and analysis of EGRA survey data, constructed various datasets and indicators of interest, performed statistical tests to determine magnitude and significance of changes across rounds, and produced tables and visualizations of key indicators used to debrief the client and other relevant stakeholders on preliminary findings.
Survey and Data Quality Manager, Endline Impact Evaluation of the U.S. Department of Labor (DoL), Bureau of International Affairs (ILAB) Assessing Progress in Reducing Child Labor in Cocoa Production in Cocoa Growing Areas of Côte d’Ivoire and Ghana Project (October 2018 – December 2020). NORC was contracted by ILAB to conduct the Endline for an Impact Evaluation of a child labor in cocoa project being implemented in Côte d’Ivoire and Ghana. For this evaluation, Alex served as Survey and Data Manager, managing an extremely complex data quality review / monitoring system for all evaluation surveys. In practice, this entailed concurrent monitoring of 6 separate survey instruments across 2 distinct populations in both Ghana and Cote d'Ivoire for a total of 24 concurrent surveys. The total sample included over 10,000 youth from more than 5,000 households. Data Management responsibilities included performing daily data quality review, processing of all cleaning and ID fixes, reporting of critical feedback to the subcontractor, producing regular progress reports for ILAB, and internal reporting of progress and major updates. The primary challenge was to conduct real-time reconciliation across all surveys and compare with field reports to ensure all data was being collected and to take action to correct any missing, unusable, or otherwise low-quality data. In addition, given the scale of the project, significant time was spent performing enumerator stability checks to diagnose bias or even fraud among enumerators. Alex’s role included significant communication with the subcontractor to ensure the timeline was adhered to, targets were being achieved, and that teams were following sampling protocol and survey protocols. Over the course of the data collection, multiple teams and enumerators were flagged as having quality issues in each country. In some cases, this resulted in retraining of all enumerators on certain questions and procedures, targeted retraining of certain enumerators on specific questions and modules, or even the dismissal of several enumerators suspected of fraud in each country (necessitating the replacement of all of their cases). Since the data collection timelines overlapped, there were several weeks where these DQR tasks were being managed concurrently. Following successful completion of data collection in both countries, Alex cleaned and prepared data for delivery, including construction of various indicators for analysis.
Trainer and Data Manager, Impact Evaluation of the USAID/Eastern and Southern Caribbean (USAID/ESC) Community, Family and Youth Resilience (CFYR) Program (July 2017 – January 2020). NORC has been contracted by USAID/ESC and Social Impact as a data collection subcontractor for an Impact Evaluation of the Community, Family and Youth Resilience (CFYR) family counseling program, which seeks to reduce the likelihood that targeted youth aged 10-17 will be involved in the criminal justice system by reducing likelihood that the youth will be engaged in crime or violence in Guyana, St. Lucia, and St. Kitts and Nevis. Since Baseline, Alex has been involved in various facets of the project across each of the three round to ensure the successful implementation of the two RCT panel surveys, the Youth Service Eligibility Tool (YSET) and the Caregiver Survey. At Baseline and Midline, Alex led or co-led all enumerator training activities, including drafting of training materials, finalization of survey tools, and travelling to each of the countries to train enumerators and supervisors on survey requirements and best-practices. During Baseline, Alex also led cognitive testing activities, hosting focus group discussions with local parents in each country to ensure language used in the Caregiver survey was appropriate and well understood. In addition, Alex served as Data Manager, performing all data monitoring, DQA, and cleaning tasks. This also involved regular communication, data delivery, and sample reconciliation with the implementer to allow for continued implementation of the CFYR project, as well as similar communication with the PIs to ensure they had everything they needed to conduct analysis. At Endline, Alex moved to a more advisory role, building capacity of additional NORC staff to conduct the remaining data tasks and enumerator trainings, while also retaining data management responsibilities for all surveys in Guyana. Over the course of the evaluation, Alex led more than 10 enumerator trainings and focus groups in Guyana, St. Lucia, and/or St. Kitts over six total in-country field visits.
Analyst and Data Collection Manager, Impact Evaluation of the IFC’s Global Agriculture and Food Security Program Private Sector Window (GAFSP PrSW) Investment in the Malawi Mangoes Outgrower Program (August 2016 – May 2019). NORC was contracted by the IFC to conduct an Impact Evaluation of the IFC’s GAFSP PrSW investment in the Malawi Mangoes Outgrower Program which required a 2.5 hour multi-round RCT panel survey of 1,500 farmer households. Alex acted as Analyst and Data Collection Manager across both rounds of the evaluation, supporting the Evaluation Manager with questionnaire design, survey testing, drafting of training materials, data collection management, data quality review, analysis, and write-up of survey results. At Endline, Alex travelled to Salima, Malawi to train field supervisors and enumerators and to oversee the Endline Pilot. During both fielding periods, Alex provided oversight of the data management process by conducting daily data quality review (including backcheck reconciliation) to ensure the high quality data collection was carried out according to the sampling protocol and EDR. Alex performed all baseline data analysis including the construction of all indicators, imputation of data, output of results, and data visualization. Finally, Alex contributed substantially to the writing of the draft baseline report including all data descriptions including demographics, hunger and food security, poverty, agricultural production, and female empowerment. This also included multiple rounds of editing based on client comments.
Analyst and Survey Programmer, Performance Evaluation of USAID/Georgia the Momavlis Taoba (“Future Generations”) Civic Education Program (September 2015 – January 2018). As part of an impact evaluation of the USAID/Georgia Performance Evaluation of the Momavlis Taoba (MT) (“Future Generations”) Project, NORC administered a three-round panel survey to students in schools throughout the Republic of Georgia, with nearly 10,000 surveys completed per round for a total of over 30,000 completed surveys. In his role as Analyst and Survey Programmer, Alex programmed the English and Georgian PAPI survey tools using Snap Survey Professional 11. Alex was also involved in the design of the survey instrument and worked to obtain IRB approval across each wave. At Baseline, Alex travelled to Tbilisi where he provided Data Entry Training to local partner CRRC, observed enumerator training, and was on-call to resolve any survey-related issues as needed. In preparation for field work, Alex drafted training manuals and Powerpoint slides to train data entry staff. Following the administration of the each round of the survey, Alex performed extensive data cleaning and quality review, collaborated with CRRC to correct issues and update protocols as needed based on findings, and produced a summary statistics report for USAID. Following the completion of the IE, Alex supported the PI with the drafting of a final Evaluation Report.
Malawi, Guyana, St. Kitts and Nevis, the Republic of Georgia
Panelist, Comparative and International Education Society (CIES) Conference 2022, Attaining Literacy, Pedagogical, and Development Goals During COVID-19, Formal Paper Presentation of "Evidence from USAID's Pakistan Reading Project (PRP) in the Context of COVID-19"
Primary Quantitative Analyst, USAID/Pakistan Reading Project (PRP) Endline Assessment (September 2020 – Present). Served as Primary Quantitative Analyst for the endline evaluation of the USAID/Pakistan PRP project, a $165 million, seven-year initiative launched in July 2013. The endline assessment involved conducting Early Grade Reading Assessments (EGRAs) via tablet with grade 2 students in two PRP intervention provinces (N=3,500 across 279 schools). Responsible for post-processing quality review, data cleaning, indicator construction, weighting, and regression analysis on endline EGRA, teacher, and head teacher data, separately for each region. This also included the presentation of OLS regression results of reading outcomes on various indicators associated with reading performance. During the analysis phase, responsible for the generation of all quantitative output including tables and dozens of attractive charts, figures, and graphics as well as in-depth write-ups across several evaluation questions. Presented results on the time series estimators or estimated “COVID impact” on reading outcomes to USAID/Pakistan mission, separately to regional-level government officials, and at the CIES Conference 2022.
Primary Quantitative Analyst, USAID/Nepal Assessment of Effectiveness of Local Governments in Nepal to Address the COVID-19 Crisis (June 2020 – May 2021). Served as Primary Quantitative Analyst for a USAID/Nepal assessment of the effectiveness of Nepali local governments’ response to COVID-19 where he was responsible for the management and implementation of the quantitative data collection and associated analysis. Responsible for drafting the Concept Note, subcontracting with local data collection firm Solutions Limited, and drawing the quasi-random municipal-level and respondent-level samples. Also responsible for programming the quantitative survey instruments based on the evaluation questions and initial findings from the qualitative data collection. During the field period, disseminated the survey via e-mail and monitored results and questions from respondents in real-time while also managing a team of enumerators who conducted interviews via phone. Following completion of fieldwork, conducted all data cleaning and analysis including generating attractive graphics presenting all survey results and producing associated write-ups. These graphics were ultimately used to present quantitative results during two separate mission-wide presentations with relevant USAID stakeholders.
Primary Quantitative Analyst, Endline Performance Evaluation of the USAID/Kenya and East Africa (USAID/KEA) Tusome Initiative (May 2019 – December 2020). Served as Primary Quantitative Analyst for the endline performance evaluation of the USAID/KEA Tusome "Let's Read" Initiative (N=5,000+ students across 204 schools). Primarily responsible for survey programming, real-time data quality review, subcontractor management, and quantitative analysis. Prior to survey launch, responsible for programming and pre-testing of all survey tools in SurveyCTO and Tangerine including a complex in-field sampling tool to randomly select students within a classroom. Following survey launch, performed all data management and quality review tasks including reconciliation across surveys to confirm each school was complete before giving teams approval to proceed. Given the scale and very aggressive window for data collection, in‐depth DQR was conducted daily to diagnose issues in real‐time. Significant oversight and other quality control measures were taken including co-enumerations to generate inter-enumerator reliability scores and back check surveys on a random sample of schools. These checks were used to flag enumerators or teams with low rate of agreement or other issues for retraining as necessary. Following the successful completion of data collection, conducted all cleaning and analysis of EGRA survey data, constructed indicators of interest, performed statistical tests to determine magnitude and significance of changes across rounds, and produced tables and visualizations of key indicators used to debrief the client and other relevant stakeholders on preliminary findings.
Survey and Data Quality Manager, Endline Impact Evaluation of the U.S. Department of Labor (DoL), Bureau of International Affairs (ILAB) Assessing Progress in Reducing Child Labor in Cocoa Production in Cocoa Growing Areas of Côte d’Ivoire and Ghana Project (October 2018 – December 2020). Served as Survey and Data Manager for the at Endline evaluation of the unprecedented ILAB-funded child labor in cocoa assessment being implemented in Côte d’Ivoire and Ghana, the largest such child labor study of its kind which garnered significant media attention including a feature from the Washington Post. Primarily responsible for managing an extremely complex data quality monitoring system for all 6 evaluation surveys (N=10,000 youth across 5,000 households). Responsibilities included daily data quality review, data cleaning, reporting of feedback to the subcontractor, and production of internal and external progress reports. The primary challenge was to conduct real-time reconciliation across all surveys and compare with field reports to ensure all data was being collected and to take action to correct any missing, unusable, or otherwise low-quality data. Given the scale and sensitivity of the project, significant time was spent performing enumerator checks to diagnose bias or even fraud among enumerators. Multiple teams and enumerators were flagged as having quality issues in each country resulting in retraining of all enumerators on certain questions, targeted retraining of certain enumerators, and the dismissal of several enumerators suspected of fraud necessitating the replacement of their cases. Also performed all data cleaning and preparation for delivery including indicators construction in each country.
Trainer and Data Manager, Impact Evaluation of the USAID/Eastern and Southern Caribbean (USAID/ESC) Community, Family and Youth Resilience (CFYR) Program (July 2017 – January 2020). Served as Trainer and Data Manager for a USAID/ESC-funded impact evaluation of a family counseling program in Guyana, St. Lucia, and St. Kitts and Nevis. Primarily responsible for training and data management across each round to ensure the successful implementation of the Youth Service Eligibility Tool (YSET) and the Caregiver Survey. Led all baseline and midline all enumerator training activities including drafting of training materials, finalization of survey tools, and travelling to each of country to train enumerator teams on best-practices. Led cognitive testing activities at baseline hosting focus group discussions with local parents in each country to ensure language used in the Caregiver survey was context-appropriate. Also served as Data Manager, performing all data monitoring, DQA, and cleaning tasks. Moved to management role at endline, building capacity of additional NORC staff to conduct the remaining data tasks and enumerator trainings. Led more than 10 in-country trainings and focus groups in Guyana, St. Lucia, and St. Kitts and Nevis over the course of the evaluation.
Analyst and Data Collection Manager, Impact Evaluation of the IFC’s Global Agriculture and Food Security Program Private Sector Window (GAFSP PrSW) Investment in the Malawi Mangoes Outgrower Program (August 2016 – May 2019). Served as Analyst and Data Collection Manager for an IFC-funded Impact Evaluation in Malawi (N=1,500 mango farmer households). Responsible for questionnaire design, survey testing, drafting of training materials, field management, data quality review, analysis, and report writing across both rounds. Traveled to Salima, Malawi to train field supervisors and enumerators and to oversee the the pilot at endline. Provided oversight of the data management process by conducting daily data quality review including backcheck reconciliation to ensure the high quality data collection was carried out according to the sampling protocol and EDR. Performed all baseline and endline analysis including the construction of all indicators, imputation of data, output of results, and data visualization as well as contributed substantially to the writing of the final reports including all data descriptions for demographics, hunger and food security, poverty, agricultural production, and female empowerment.
Analyst and Survey Programmer, Performance Evaluation of USAID/Georgia Momavlis Taoba (“Future Generations”) Civic Education Program (September 2015 – January 2018). Served as Analyst and Survey Programmer for a national three-round panel survey of students throughout the Republic of Georgia (N=10,000 per round for a total of 30,000 surveys). Primarily responsible for programming the PAPI survey tools using Snap Survey and data management across all three rounds of data collection. Traveled to Tbilisi at baseline to provide data entry training to local partner CRRC and observed enumerator training. Performed extensive data cleaning and quality review, collaborated with CRRC to correct issues, produced summary statistics report for USAID, and supported the PI with the drafting of a final Evaluation Report.
Panelist, Comparative and International Education Society (CIES) Conference 2022, Attaining Literacy, Pedagogical, and Development Goals During COVID-19, Formal Paper Presentation of "Evidence from USAID's Pakistan Reading Project (PRP) in the Context of COVID-19"
Malawi, Guyana, St. Lucia, St. Kitts and Nevis, the Republic of Georgia