Health

TIME’s health research uses rigorous impact-evaluation methods to assess which health policies, programmes, and interventions improve outcomes, particularly in low- and middle-income countries. By working with researchers, practitioners, and policymakers, TIME generates evidence on what works, why it works, and how health investments can be made more effective and equitable.

E-Monitoring and Organizational Performance: Evidence from the National Community Health Program in Sierra Leone

Researchers:

Eric Deserranno, Andrea Guariso and Gianmarco Leon-Ciliotta

Partners:

Ministry of Health and Sanitation, CHAF

Location:

Sierra Leone

Sample:

About 9,000 households and 1,000 health workers located across 140 Primary Healthcare Units across two districts in Sierra Leone

Timeline: 2023–2025
Theme: Health, Technology
Description:

Digital technologies have advanced more rapidly than any other innovation in history. The gains from technology are however very heterogeneous across sectors and firms. This proposal aims to study:

(i) the ways governments can leverage new e-monitoring technologies to improve the supply of public services, and

(ii) whether gains from these technologies depend on the “verticality” of the organization (the ratio of supervisors to workers).

Technology might substitute in-person supervision, but might also complement supervisors’ activities, by allowing them to reallocate time towards more complex and productive activities, e.g., customized training and advising. This may in turn affect the optimal verticality of the organization and public service delivery. In collaboration with the Ministry of Health of Sierra Leone, we plan to run an experiment across four districts of the country, cross-randomizing the introduction of a new e-monitoring app to be installed on the frontline health workers’ phones, with variation in the local share of supervisors to workers.


More specifically, we will focus on the Community Health Worker (CHW) Program, a nationwide government program that aims at enhancing primary healthcare delivery. The program operates through Peripheral Health Units (PHUs) that operate with a team of local CHWs. CHWs deliver basic healthcare services to their communities, offering health education, non-severe illness treatment, and facilitating referrals for further care. CHWs typically have no prior experience in the health sector and are trained and monitored by supervisors, who split their time between monitoring and training. Existing evidence from Sierra Leone suggests that supervisors often provide inadequate support to CHWs, limiting their effectiveness. A standard solution to monitoring problems has been to increase the number of supervisors, which, however, is expensive and thus comes at the cost of reducing the number of frontline workers.  Digital solutions can provide a cheaper alternative. In our study we will introduce a cost-free GPS-enabled app on supervisors' and CHWs' phones. The app allows CHWs to record visits and services and tracks the CHWs' focus on remote, impoverished areas. Supervisors receive daily reports on visits and distance covered. This approach aims to improve monitoring, detect shirking, promote targeting of underserved populations, and enhance the quantity and quality of service delivery. We expect the benefit of this technology to vary with the “verticality” of the organization (the existing ratio of supervisors to workers) and with the level of substitutability or complementarity between technology and supervisors.

In order to fully understand the effects of the technology, we will therefore examine both workers’ and supervisors’ behavior as well as the quantity and quality of public service delivery. While previous research focused on the performance of frontline workers, to the best of our knowledge no causal evidence exists regarding the influence of technology on supervisors and the interplay between digital technologies and organizational structure. The only existing evidence is theoretical or correlational and focuses on the private sector. We aim to fill these gaps by leveraging random rollout of e-monitoring technologies and by experimentally manipulating the share of supervisors to workers across PHUs.


 

Impact of Telehealth in Rural India

Researchers:

Amanda Dahlstrand-Rudin, Erika Deserranno and Andrea Guariso

Partners:

Healing Fields Foundation, JPAL

Location: India
Sample:

7000 households and 2000 health providers located across 400 villages in rural Bihar in India

Timeline: 2002–2025
Theme: Health, Technology
Description:

Remote areas in low-income countries have poor access to quality healthcare. One challenge in developing state capacity in remote areas is the difficulty in attracting skilled workers (doctors and nurses), to which a common solution is to engage less skilled workers (community health workers). A new solution is to bring higher-skilled professionals to rural areas through digital technology. Telehealth, which connects patients to qualified healthcare professionals via phone, provides a new opportunity for governments to reach remote areas with high-quality healthcare services at relatively low costs. Although the popularity of telehealth has dramatically increased since the onset of the COVID-19 pandemic, there is to date no causal evidence of its impacts in low-income countries.

This project aims to provide the first experimental evidence on the impact of telehealth on healthcare utilization and health outcomes in low-income countries. The impact is ex-ante ambiguous: telehealth may expand access to healthcare in areas previously underserved by the health system, but it might also crowd out in-person care and lead to an overall drop in healthcare utilization by those most in need, who might be unable or unwilling to connect remotely with a health professional. The project will take place in 400 rural Indian villages that will be randomized into receiving telehealth or not, with or without a local facilitator, who will assist patients in connecting to the call and follow up with them after the visit. We will learn whether and under which conditions telehealth improves access and health outcomes for rural populations, and how it affects the divide in access by gender, income, and age.


 

Community Health Care and COVID-19 Pandemic: Experimental Evidence from Uganda

Researchers:

Andrea Guariso, Martina Björkman Nyqvist, Cristina Clerici, and Jakob Svensson

Partners: Living Goods, BRAC, IPA.
Location: Uganda
Sample: 4,000 households and 600 Community Health Workers
Timeline: May – December 2020
Theme: Health
Description: In this study (registered in the AEA RCT registry 5874) we plan to do three things. First, by collecting novel data using phone surveys we will document both the extent of (self-reported) incidence of COVID-19 and the extent to which respondents adjust their health seeking behavior in response to the pandemic. This will allow us to estimate a more comprehensive measure of the impact of COVID-19 pandemic in rural Africa that embraces morbidity and mortality from all conditions. Second, by exploiting the unique framework provided by an ongoing RCT, we will test whether an innovative Community Health Worker program is effective in reducing this shift away from effective preventive and curative treatments, and possible misconceptions about COVID-19, cushioning the overall impact of the current pandemic. Finally, we will implement a field experiment, focusing on households in the treatment group of the larger trial, where will test how different phone messages regarding COVID-19 and the importance of preventive and curative care more generally influence households health behavior and outcomes. The messages will have different behavioral framings and we will be able to look at both demand (households) and supply (health workers) constraints.

 

Researchers:

Selim Gulesci, Eliana La Ferrara (Bocconi), David Smerdon (University of Queensland), Munshi Sulaiman (BRAC)

Partners:

Save the Children

Location: Somalia
Sample:

4,230 households from 141 communities

Timeline: 2018-2020
Theme: Harmful gender norms
Description: Female genital cutting (FGC) is the practice of cutting or removing part of the external or internal female genitalia for non-medical reasons. There can be several explanations for why a harmful practice, such as FGC, may continue being practiced. In this project, we aim to test for two of these explanations. First, FGC is often viewed as the result of a coordination failure. In a setting where individual choices are interdependent, multiple equilibria may exist and one reason for the persistence of bad norms can be a failure to coordinate to the “better” equilibrium. Individuals may know that others do not like FGC but no single individual may want to move unilaterally due to fear of social sanctions. To the extent that individuals worry about social stigma, they may even be hesitant to reveal their private views on FGC to others. Second, individuals may privately dislike FGC but think that others do and therefore they continue doing it. Social psychologists describe as pluralistic ignorance a setting in which a majority of the group privately want to change their behaviour, but mistakenly think that the majority of the other group members prefer to keep the existing behavior. In this project, we aim to test to what extent these two potential reasons may explain why FGC persists in Somalia. In particular, our experiment entails two key components: one directed at providing information (hence correcting misperceptions) by enabling the truthful revelation of attitudes towards FGC; and one directed at providing a coordination device that will facilitate collective action among those who privately support the abandonment of FGM.

Learn more

Researchers:

Martina Björkman Nyqvist, Andrea Guariso, Jakob Svensson

Partners: Living Goods, BRAC Uganda, Innovations for Poverty Action, CIFF (funding agency)
Location: Uganda
Sample: 12,500 households from 500 villages
Timeline: 2015-2020
Theme: Health
Description: Between 2011 and 2014 we performed the first large-scale evaluation of a novel approach to health care delivery in Uganda. The evaluation was based on a randomized controlled trial, across 214 villages. In each treatment village, a female door-to-door sales agent was locally recruited and incentivized to sell subsidized medicines and other health products to households, making a small profit on each sale. Our results showed significant reductions in under-5, infant, and neonatal mortality. Following up on these remarkable results and taking advantage of a large expansion of the program, this new project will i) evaluate the impact of the program when it is brought to scale; ii) assess the level and type of activities of Community Health Promoters and how they relate and interact with other health workers operating in the study villages; iii) collect information on the price and quality of antimalarial drugs and antibiotics for pneumonia sold by drug stores operating in the study villages, to measure the extent of counterfeit and substandard drugs in the local markets. The evaluation is based on a large scale randomized controlled trial, covering 12,500 households located across 500 different villages. The trial has been registered with the Pan African Clinical Trials Registry: (PACTR201609001398349) and with the AEA RCT Registry (AEARCTR-0002392).

Researchers:

Ronan C Lyons (TCD) and Alan de Bromhead (UCD)

Location: Ireland
Sample:

Approximately 45,000 heavily subsidized cottages across 140 health districts in Ireland

Timeline: 1870–1919
Theme: Health
Description: This project investigates the impact of the introduction of heavily subsidized 'Labourers Act' cottages in rural Ireland in the period 1883-1915 on public health outcomes, in particular in the transmission of communicable disease. It does this by using a combination of datasets, in particular a rich dataset on the location and cost of cottages authorized and built from 1885, and data on death by cause at the district level at annual frequency from 1870. The hypothesis to be tested, found in the assessments at the time by health officials, is that the introduction of high-quality rural housing reduced deaths from communicable diseases, in particular airborne disease.

Learn more

Researchers: Patrick Lubega, Frances Nakakawa, Gaia Narciso and Carol Newman
Partners: Irish Aid and Higher Education Research and Institution. This project is part of NOURISH, Nutrition and Treatment Outcome: Development of a Ugandan-Irish HIV/Nutrition Research Cluster.
Location: Uganda
Sample:

Over 3,000 Women in 24 HIV clinics in rural areas

Timeline:

2012-2016

Theme: Health
Description:

This project tests the impact of two separate interventions that aim to inform women on the importance of nutrition and how to fulfil their nutritional needs in a sustainable way: 1) a standard nutritional information campaign involving the distribution of posters and flyers; and 2) cookery demonstrations on how to produce locally sourced home-made nutritious food. The project provides evidence that the provision of basic information improves the nutritional intake and health of women but has limited impact on other welfare outcomes. In contrast, participation in the cookery campaigns has significant effects on incomes and female empowerment, with knock-on effects for children’s school attendance. The results shed light on the extent to which the means through which information is communicated matters for impact. They also allow understanding better the underlying behavioral changes that lead to improved outcomes for women and their children.