Rose Weeks

Part 2: What Really Happens at a BoP Clinic?: A new study shows surprising results

How often do BoP health care providers follow established treatment protocols? How much training do these providers have? Do trained providers reliably provide better care than untrained ones?

Jishnu Das, Senior Economist in the Development Research Group at The World Bank, recently explored these questions in an illuminating study on primary care provider quality in India, published in Health Affairs.

In Part 2 of his interview with CHMI’s Rose Reis, Das talks about the limitations of existing data on BoP health care quality, the lessons of the study, how they apply to India and beyond. (You can read Part 1 of their interview here.)

Rose Reis: You wrote that in India, little information is available on the practices of private providers, the largest sector providing primary care in resource poor settings. Do other countries have better information about the quality of health care delivered by private providers?

Jishnu Das: I don’t think that this is a problem only in India. There have been some excellent studies in a number of countries that have focused on specific dimensions of private sector practice in smaller samples, and our current study builds on some of the insights from this wider literature.

Moving forward, I think that our understanding of the sector could be improved through better data on the overall number and distribution of private sector providers and by a general method of measuring quality.

For instance, wide variation in quality in the private sector implies that there are both very good and very bad private sector providers. How the sample is drawn can completely change the results, and without a wider informational base, it becomes difficult to say how the specific sampling affected the conclusion of the study.

Jishnu Das

Similarly, studies of prescriptions in the private sector will typically show that patients are frequently given unnecessary or even harmful medications. But without a comparative group from, say, the public sector, it is difficult to draw firm conclusions on the origins of poor prescription practices. Are results very different in the public sector? Is there a difference by the training of the provider? These are key questions that will allow us to eventually parse out the “deep determinants” of provider behavior in low-income countries.

Partly because of the difficulty of collecting these data, systematic gaps remain in our understanding of the private sector, and particularly among providers without formal training. In many low-income countries we do not have credible estimates of the number of health care providers in an average village–once you count the untrained providers in the private sector.

An excellent systematic review by Berendes and others in PLoS Medicine on quality of care found only two studies on informal sector providers–which could not be included because they did not meet the minimal criteria for inclusion. More comparative research on the private sector that allows us to assess the care that patients receive from different kinds of providers is key to diagnosing the underlying problems.

(Above: Jishnu Das)

RR: Why does the government lack information about the private sector? Where is this information collected and what are the issues in monitoring it?

JD: Given the large number of private sector providers, my guess is that it’s going to be hard to integrate all of them into some kind of administrative database of providers. What I would hope for is that we move forward by listing all kinds of providers in village-based samples in a number of countries.

We have completed this for Madhya Pradesh using the method described in our paper, and a parallel study from the World Bank has completed this for Cambodia (where they find similar results in terms of the proliferation of informal sector providers). I know that Results for Development has also been at the forefront of some innovative studies of private sector providers from a number of countries.

I think that at this stage it is important to describe the sector, and the quality that patients receive from the private sector on a sample basis. This could then lead to a more informed discussion on a feasible methodology that governments could use in the future to develop an evidence base on private sector practices.

RR: What should be done about the issues raised in your study?

JD: One major conclusion from this study is that widespread assumptions regarding the quality of care among untrained providers and among providers in the private and public sector may not be accurate.

Although our study is limited to two locations, in both urban Delhi (one of India’s richest states) and in rural Madhya Pradesh (one of India’s poorest states) we find no correlation between case-loads and quality or equipment and quality, and only small impacts of training. This has important implications for policy.

For instance, one natural question for policy makers is why people use informal sector providers. Answers typically range from familiarity with such providers in the target population to their links to the community. Our study suggests a simple alternative: people use informal sector providers because they may provide better care than alternative sources.

My hope is that the study results are sufficiently important that they lead us to rethink our assumptions on the links between qualifications and quality, and the ability of poor people to make accurate judgments regarding the quality of medical services they access.

Look, I don’t think that there is a magic wand that can improve quality of care for the poor. But equally, I do believe that as governments, as members of civil society, and as donors, researchers and practitioners, we should be trying our hardest to do so. And I know that there are many fantastic initiatives that are currently underway.

This study helps by providing a method to assess the impact of these initiatives on quality, and therefore creating a feedback loop leading to evidence-based policy. Particularly for donors and researchers, one major step forward could be the development of a consensus on the measurement of quality, and an acknowledgment that the absence of evidence should not become fertile ground for speculation.

At the end of the day, if this study can do a couple of things, I would wish for nothing more. The first is that, faced by blanket statements regarding the quality of care among one set of providers or another, we should step back and ask: is there clear evidence based on a representative sampling scheme and (something like) a standardized-patient methodology that allows us to make these statements? The second is to start a broader conversation on whether the method proposed here could be brought into mainstream quality measurement, and institutionalized in a number of countries.

I am confident that doing so would radically alter our understanding of how health markets function, and open up important policy alternatives in the future.

Below: A short video showing three doctor-patient interactions in New Delhi, India:

Maqari Project Participant Observations – Short from Maqari Project on Vimeo.

Education, Health Care
public health, research