- Research article
- Open Access
Leadership, governance and management for improving district capacity and performance: the case of USAID transform: primary health care
BMC Family Practice volume 21, Article number: 252 (2020)
Primary health care (PHC) in Ethiopia serves as the main entry point for preventive, promotive and curative health services. The district health office is responsible for the planning, implementation and evaluation of all district health activities. In addition, district health offices manage service delivery facilities working on provision of PHC – primary hospitals, health centers and health posts. As the leader of the health care system tier, district health management must ensure direction, alignment and commitment within teams and organizations and make sure that achievements are consistent with the vision, values and strategy of the organization. USAID Transform: Primary Health Care provides diverse support to improve district health manager competencies including in-service trainings followed by planning and implementation of performance improvement projects and on-the-job mentoring and support.
This study was conducted to compare district level capacity and performances between leadership, management and governance (LMG) and non-LMG districts. Project outcome monitoring data that shows the performance of districts was collected from 284 districts from January to December 2019. The study was carried out using a comparative-cross sectional study design, which assessed and compared district health office level indicators. Districts were classified into two categories: LMG and non-LMG districts. The study compared data from 94 LMG and 190 non-LMG districts. Propensity score matching was used to control the effect of differences between LMG and non-LMG districts.
Results of the independent samples t-test revealed that LMG districts scored better average performances of 61.8 ± 121.45 standard deviation (SD) compared to non-LMG districts 56.89 ± 110.39 SD, with t (282243) = − 3.407317 and p < 0.001, two-tailed. The difference of 4.9 percentage unit in the average performance indicated a statistically significant difference between the LMG and non-LMG districts.
District level leadership development program contributes to improving district capacity, structure and management practices, and quality of care.
The World Health Organization (WHO) and its member states have endorsed primary health care (PHC) in the Alma Ata declaration. In the declaration, PHC is stated as, ‘an essential health care based on practical, scientifically sound and socially acceptable methods and technology, universally accessible to individuals and families in the community through their full participation and at a cost that the community and country can afford to maintain at every stage of their development in the spirit of self-reliance and self-determination’ . The government of Ethiopia has long been implementing the principle of primary health care in the country. Primary health care in Ethiopia serves as the main entry point for preventive, promotive and curative health services. The district health office is responsible for the planning, implementation and evaluation of all district health activities. In addition, district health offices manage service delivery facilities under PHC – primary hospitals, health centers and health posts. In its strategic plan for the period between 2015 and 2020, the government of Ethiopia has outlined achieving excellence in leadership as a priority area . Availability and effective use of resources, appropriate planning and management of primary care is important for quality, cost-effective and equitable health service delivery. Moreover, trained and motivated health workforce including managers are vital to appropriate functionality of PHC .
As overseers, district health management are responsible for overall functioning of primary health care including planning, performance review and management, effective use of resource and monitoring and support for health service delivery. Furthermore, district management staff need to have skills in strategic problem solving, human resource management, financial management and operations management which enables and facilitates strong management at the facility level as well as create well-functioning facilities and improved health outcomes . A leader at the district health service has to ensure direction, alignment and commitment within teams and organizations and make sure that achievements are consistent with the vision, values and strategy of the organization . Effective leaders promote continuous development of knowledge, skills and abilities of staff in order to improve quality of service delivery and consistently encourage and motivate changes and deal with poor performance . According to the Federal Ministry of health (FMOH), management and governance within the health sector shows critical gaps that include ‘the capacity to implement health care; improve the utilization of health services; systematically follow-up on the implementation of policies, guidelines, standards and protocols; implement reforms in a timely manner and enhance the coordination of public-private partnerships’ .
There is evidence suggesting that empowering leaders and mangers with required principles and competencies leads to improved health system performance through enhanced work environment and strong management systems which will eventually create responsive health system with improved allocation of resources . Consequently, the FMOH has introduced an in-service training program on Leadership, Management and Governance (LMG) in 2017 .
The introduction of LMG in-service trainings in Ethiopia resulted in significant improvement in service delivery and utilization, work environment, provider motivation, teamwork and resource management. This study also revealed that implementation of LMG training followed by supervision and monitoring resulted in improved implementation of LMG related functions, improved capabilities and initiated a sense of positive competition among health facilities to achieve planned facility-level service delivery objectives . Like this finding - in other countries - in-service training has been shown to empower leaders and managers to appropriately implement district health activities in an organized way through sound management of primary health services, team building, and supervision. In addition, in-service training for managers is a significant investment in creating and maintaining critical competencies required for district level service settings .
USAID Transform: Primary Health Care supports the government’s strategic initiatives in 117 primary hospitals, 1856 health centers, and 9291 health posts in over 400 districts through the provision of phased and adaptive technical assistance. It also integrates leadership, management and governance practices as a key part of the Activity’s components to create a capacitated management at the primary health care level to face challenges and garner improvements in service delivery and performance. Leadership, management and governance (LMG) capacity building is mainly about addressing the gaps that exist in managers and health workforces at the primary health care level so that they can facilitate equity and quality health services. This study thus aimed to compare capacities and performances between LMG and non-LMG districts.
Ethiopia has ten administrative regions and two city administrations. Each of these ten regions is divided into zones and each zone is divided into districts. A district health office is available at the lower level of the administrative structure and is a key driver of primary health care performance. On average, one district is expected to support 20 health posts, four health centers and a primary hospital.
The Activity uses various approaches including provision of leadership, management and governance trainings at the district level with major contents of overview and context of the Health System in Ethiopia; Introduction to Leadership, Management and Governance; Improving Performance through enhanced Leadership, Management and Governance; Resources Management; and Health Service Delivery Management. The training approach is team-based and experiential learning which entails including two to three people from each district and allowing open discussion to share experiences among themselves. Until the end of the session, these participants are considered as a working team. It also trains managers from district health offices, primary hospitals and health centers and then they will support the leadership at the primary health care level to strive for change by implementing leadership projects. The projects are linked to maternal and child health related issues. One of the woredas, for example, aimed at improving EPI data quality from the current 23 to 95% by the end of April 30,2020. Moreover, following capacity building training, trainees must organize on the job orientation for their colleagues in order to create same level of understanding and thus work together towards the same goal. The trained people with their counterparts in their facility work together to scan their current situation, design performance improvement projects, identify their stakeholders and mobilize resources and jointly conduct monitoring & evaluation. Onsite coaching and technical support are also provided by LMG trainers, project staff, and Zonal Health Department staff using a standard coaching checklist and following OALFA (Observe, Ask, Listen, Feedback, and Agreed) technique. In addition, learning sessions are organized through performance review meetings (PRM) to share challenges, and success and lessons at different levels.
USAID Transform: Primary Health Care works towards improving public health service delivery and management. As part of this effort, one of the major interventions is supportive supervisions to its intervention district health offices with the objective of providing onsite technical support and producing program outcome monitoring data. A supportive supervision checklist is a set of questions related to reproductive, maternal and child health and health system interventions which was developed by the USAID Transform: Primary Health Care Activity to guide field level support. The checklist is organized to frame a two-way discussion between the supervisor and the health worker at each district health office. Each question has a definition, decision point and a response documentation section to inform improvement plans. This study employed the supportive supervision program outcome monitoring data collected from 284 district health offices during the January to December 2019 fiscal year.
Study design and instruments
The study was carried out using a comparative-cross sectional study design, which assessed and compared district health office level indicators. Districts were classified into two categories: LMG and non-LMG. The study compared data from 94 LMG and 190 non-LMG districts. In this study, LMG districts were districts with at least one LMG trained staff that were implementing the LMG health service management improvement projects. The supportive supervision checklist is comprised of 94 questions and more than 75% of the questions are binary i.e. seeking ‘true’ or ‘false’ responses. For assessment purposes, the checklist was categorized into five major domains focusing on the interventions of the Activity. A total of 44 questions were arranged into five categories: district capacity, service availability, resource mobilization and use, quality of services, and management practices and structure (Additional file 1). All the 44 questions categorized were binary (true or false) response types.
During district health office support, data collection and entry were conducted onsite using an online electronic system and tablets. The system allows the questionnaires to be programmed and follows skip patterns based on previous responses. The district health office support, data collection and entry were done by the project cluster offices staff. On a few occasions, the visit may be carried out by other experts from regional project offices who use paper and then transfer the data to the online system. Data were collected by interviewing the district managers and reviewing all relevant documents.
Data were managed using a web-based system, District Health Information System (DHIS2) , and exported to Statistical Package for Social Sciences (SPSS) version 25 for statistical analysis. Propensity Score Matching (PSM) analysis was conducted using R-plugin for propensity score matching for SPSS.
Propensity score matching was used to explain possible differences in the baseline variables between LMG and non-LMG districts. Propensity score matching is a tool to adjust a treatment effect for measured confounders in non-randomized studies . The logic behind propensity score methods is that balance on observed covariates is achieved through careful matching on a single score – the estimated propensity of selecting the treatment, or simply the propensity score. The propensity score is defined as the probability of receiving treatment based on measured covariates . In this study, the covariates used for the calculation of the propensity score were district catchment population, number of HCs, number of HPs, number of ambulances the district has, and number supportive supervision visit frequency. A binary treatment indicator (0 for non-LMG\control and 1 for LMG\treatment), nearest neighbor matching, caliper of 0.2, logistics regression estimation, and matching ratio of 1 to 2 were used to perform the PSM.
We checked the balance of covariates using the relative multivariate imbalance L1 test and standardized mean differences (SMD). The L1 metric is theoretically between 0 and 1. The smaller the L1 metric, the better the matching result . Differences in the distribution of observed district characteristics between the LMG and non-LMG groups in the unmatched and matched samples were compared using SMD. We considered SMD greater than 0.1 as indicative of statistically significant difference, and vice-versa. We did not use Chi-square or the Student’s t-tests to compare differences in baseline characteristic because the associated p-values are sample size dependent. Accordingly, these tests are not recommended for checking covariate balance .
Finally, the matched data after PSM were used to analyze and evaluate the intervention effect with the reduction of confounding bias due to PSM. Accordingly, the mean and standard deviations were calculated for all five categories and the differences in mean scores of district capacity, service availability, resource mobilization and use, quality of services, and management practices and structure between LMG and non-LMG districts were examined using independent samples t-test and Levene’s test, with the level of significance being determined at a p-value < 0.05.
This report used project data that has been collected as part of the follow-up monitoring visit to district health offices. Before the data collection, verbal consent was taken from each participant. The results of the study did not distinguish the name of the district and other specific site identifiers. Therefore, JSI research and Training Institute, Inc’s Institutional Review Board (IRB) has determined that this activity is Exempt from human subjects’ oversight (IRB #20-15E).
PSM and characteristics of the study districts
A total of 284 districts, 94 LMG and 190 non-LMG, were included in the study. The propensity matching process yielded groups that were well matched based on the characteristics of the districts (Table 1). In the propensity score model, we were able to match 88 LMG districts to similar controls group of 157 non-LMG districts. The relative multivariate imbalance L1 was 0.910 before matching and 0.909 after matching. There were no covariates exhibited large imbalance of |d| > 0.25.
Before PSM, nearly all the characteristics of the districts varied considerably between the LMG and non-LMG groups with SMD exceeding the 0.1 limit. The LMG and non-LMG groups were only similar with respect to number of HCs (SMD = 0.092) since the SMD was less than 0.1. However, after matching districts in the non-LMG group to those in the LMG group on similar propensity scores, all the characteristics became similar between districts in the LMG and non-LMG groups (all SMD was less than 0.1).
Comparison of LMG and non-LMG districts after PSM
The comparison statistics considered the matched data after PSM. Levene’s test for equality of variances assessment revealed that there was homogeneity of variance among the five categories and average performance (Table 2). Therefore, an independent t-test was run on the data with a 95% confidence interval (CI) for the mean difference. Results of the independent samples t-test revealed that LMG districts showed better average performances 61.8 ± 11.5 standard deviation (SD) compared to non-LMG districts 56.9 ± 10.9 SD, with t (243) = − 3.317 and p < 0.001, two-tailed. The difference of 4.9 percentage point in the average performance indicated a statistically significant difference between the LMG and non-LMG districts.
There were statistically significant differences between LMG and non-LMG districts in three items on the five categories with p-value < 0.05 (Table 3). These were noted in categories that addressed management practices and structure, quality of services, and district capacity.
There were no significant differences in the resource mobilization and use and service availability categories between the two groups data.
The finding of the study suggests that implementing LMG activities significantly improves management practices and structure, quality of services, and district capacity. The study indicates that district health managers’ performance is highly related to performance of other primary health care entities. This finding is consistent with other similar research in other settings where improving performance of district management improved the performance of primary health care functions [16, 17]. The analysis of district management administrative capacity shows differences between LMG and non-LMG districts. The study reveals differences between LMG and non-LMG districts in capacitating health workers, strengthening teams and availing inputs. Using selected administrative performance indicators, the study found overall differences in the capacity created between non-LMG districts (52.2%) and LMG districts (58.7%). The improvements may be related to the practice of effective management which has direct implications in influencing availability of input and redesigning of processes . This result is consistent with a study done in Ethiopia that shows improving competencies at the district level can improve service availability and quality by improving capacity of management at the facility level, coordination, resource availability and accountability .
The study also shows clear difference in the capacity of districts to establish multi-sectoral coordination, availability of trained health workforce to improve service quality as well as functional equipment between LMG and non-LMG districts. It found a clear difference between the two districts (non-LMG districts - 56.7% and LMG districts - 63.8%). The results of this study are similar with previous findings where capacitating management improved management practices which is attributable to improved commitment . Capacity building is also thought to improve team motivation and performance of planning skills and enhances management practices . Other studies also show that capacitating managers improves workplace environments, including handling human resource management, and the day-to-day activities and teamwork .
From a resource mobilization and use perspective, the study showed no difference between the two types of districts (non-LMG districts - 56.2% and LMG - 60.9%) in allocating budgets for key activities, implementing an effective Community Based Health Insurance (CBHI) scheme and availing and using vital resource like ambulances. This finding may be due to higher administrative level’s involvement (E.g Health insurance agency and regional health bureau) in resource mobilization and management and use of common criteria in allocating resources.
Findings from this study also illustrate that there was no significant difference between the two groups in terms of service availability at facility level (non-LMG districts (65.0%) and LMG districts (65.7%)). This may be due to other interventions, such as, performance management through key indicators which encourage every district to ensure availability of services. Unlike this study, a study conducted in Kenya reported the significant effect of the LMG on service availability . Another study conducted at facility level confirms that LMG training improved service availability by improving coordination, motivation, teamwork, commitment and relationship between parties .
This study proved the importance of performance management capacity building in improving service quality at the facility level. Data collected from LMG and non-LMG districts showed a significant relationship between management capacity and service quality. The service quality of non-LMG districts scored 54.2% and LMG districts scored 59.9%. This shows that capacity of managers at the district level highly determines the quality of service at the facility level. Program evaluations conducted in Zambia indicate that on-the-job mentoring to improve competencies of district management can result in improvements in quality of service by improving different aspects of leadership and management functions including planning and problem-solving skills . A health care quality bulletin by the Federal Ministry of Health indicates the importance of problem identification and working towards improving quality of care .
Reading through the results from the study, it is good to note some of the limitations. The supervisions were made by project staff who may influence the observations. In addition, the analysis was only able to control the effect of background information which are available with the authors. A lack of baseline information about the study facilities was also a limitation of the study. In addition, the intervention was not “blinded” to the data collectors and this could have introduced bias into the results.
District health offices are a critical structure to ensure the proper delivery of primary health care at the lower levels of the health system in Ethiopia. There are clear performance differences among various districts in the country despite there being no major differences among their characteristics. One of the reasons for this is the difference in the leadership skills among district health offices. As this study suggests, imparting the critical skills of leadership, management and governance functions coupled with problem solving skills through development of performance improvement projects and ongoing coaching contributes in improved district capacity, district structure and management practices, and quality of care.
Availability of data and materials
The datasets used and/or analyzed during the current study are available from the corresponding author on reasonable request.
Community-based health insurance
District Health Information System
Expanded Program of Immunization
Federal Ministry of Health
Institutional Review Board
Leadership, Management and Governance
Observe, Ask, Listen, Feedback, and Agreed
Primary Health Care
Performance Review Meeting
Propensity Score Matching
- SDG :
Sustainable Development Goal
Standardized Mean Difference
Statistical Package for Social Sciences
United States Agency for International Development
World Health Organization
World Health Organization (WHO). Declaration of Alma-Ata International Conference on Primary Health Care, Alma-Ata, USSR, 6–12 September 1978.
Federal Ministry of Health. Health sector transformation plan 2015/2016–2019/2020 Addis Ababa: Federal Democratic Republic of Ethiopia, Ministry of Health; 2015.
World Health Organization. Health workforce governance and leadership capacity in the African region review of human resources for health units in the ministries of health; 2012.
Fetene N, Canavan ME, Megentta A, Linnander E, Tan AX, Nadew K, et al. District-level health management and health system performance. Rutebemberwa E, editor. PLoS One. 2019;14(2):e0210624.
Drath WH, McCauley CD, Palus CJ, Van Velsor E, O’Connor PMG, McGuire JB. Direction, alignment, commitment: toward a more integrative ontology of leadership. Leadersh Q. 2008;19(6):635–53.
Edwards LJ, Moisés A, Nzaramba M, Cassimo A, Silva L, Mauricio J, et al. Implementation of a health management mentoring program: year-1 evaluation of its impact on health system strengthening in Zambézia Province, Mozambique. Int J Health Policy Manag. 2015;4(6):353–61.
USAID. In-service leadership, managements and governance syllabus for training health professionals to master practices and competencies those who lead manage and govern; 2016.
Federal Ministry of Health. Leadership, management and governance - in-service training manual for health managers at hospitals & health centers. Participant guide; 2017.
Bayou B, Hailu T, Jenberie A, Minalu Y, Tesfamichael T. Transforming primary health care unit service delivery through leadership, management and governance (LMG) training: a field action report from Ethiopia. Ethiop J Health Dev. 2020;34(2).
Belrhiti Z, Booth A, Marchal B, Verstraeten R. To what extent do site-based training, mentoring, and operational research improve district health system management and leadership in low- and middle-income countries: a systematic review protocol. Syst Rev. 2016;5(1) [cited 2020 Apr 22]. Available from: http://systematicreviewsjournal.biomedcentral.com/articles/10.1186/s13643-016-0239-z.
About DHIS2 | DHIS2 [Internet]. [cited 2020 Jan 8]. Available from: https://www.dhis2.org/about.
Stuart EA. Matching methods for causal inference: a review and a look forward. Stat Sci. 2010;25(1):1–21.
Rosenbaum PR, Rubin DB. The central role of the propensity score in observational studies for causal effects. 1. Accessed 13 Oct 2020.
Wells AR, Hamar B, Bradley C, Gandy WM, Harrison PL, Sidney JA, et al. Exploring robust methods for evaluating treatment and comparison groups in chronic care management programs. Popul Health Manag. 2013;16(1):35–45.
Staffa SJ, Zurakowski D. Five steps to successfully implement and evaluate propensity score matching in clinical research studies. Anesth Analg. 2018;127(4):1066–73.
Tabrizi JS, Gholipour K, Iezadi S, Farahbakhsh M, Ghiasi A. A framework to assess management performance in district health systems: a qualitative and quantitative case study in Iran. Cad Saude Publica. 2018;34(4) [cited 2020 Apr 22]. Available from: http://www.scielo.br/scielo.php?script=sci_arttext&pid=S0102-311X2018000405010&lng=en&tlng=en.
Gilson L, Agyepong IA. Strengthening health system leadership for better governance: what does it take? Health Policy Plan. 2018;33(suppl_2):1–4.
Prashanth NS, Marchal B, Kegels G, Criel B. Evaluation of capacity-building program of district health managers in India: a contextualized theoretical framework. Front Public Health. 2014;2 [cited 2020 Apr 22]. Available from: http://journal.frontiersin.org/article/10.3389/fpubh.2014.00089/abstract.
Heerdegen ACS, Aikins M, Amon S, Agyemang SA, Wyss K. Managerial capacity among district health managers and its association with district performance: a comparative descriptive study of six districts in the eastern region of Ghana. Gholipour K, editor. PLoS One. 2020;15(1):e0227974.
Conn CP, Jenkins P, Touray SO. Strengthening health management: experience of district teams in the Gambia. Health Policy Plan. 1996;11(1):64–71.
Mutale W, Vardoy-Mutale A-T, Kachemba A, Mukendi R, Clarke K, Mulenga D. Leadership and management training as a catalyst to health system strengthening in low-income settings: evidence from implementation of the Zambia management and leadership course for district health managers in Zambia. Kumar S, editor. PLoS One. 2017;12(7):e0174536.
Seims LRK, Alegre JC, Murei L, Bragar J, Thatte N, Kibunga P, et al. Strengthening management and leadership practices to increase health-service delivery in Kenya: an evidence-based approach. Hum Resour Health. 2012;10(1) [cited 2020 Apr 23]. Available from: https://human-resources-health.biomedcentral.com/articles/10.1186/1478-4491-10-25.
Federal Ministry of health. Continuous health care quality improvement through knowledge management Ethiopian health care quality bulletin; 2019. p. 1.
This report is made possible by the generous support of the American people through USAID. The authors’ views expressed in this study report do not necessarily reflect the views of USAID or the United States Government. The authors thank Hearn Demissie for English language editing.
Transform Primary Health Care project is a United States Agency for International Development (USAID) funded health program under cooperative agreement number of AID-663-A-17-00002. The program is implemented by a consortium of organizations which includes Pathfinder International, JSI Research and Training Institute, Inc., EnCompass, Malaria Consortium, Abt Associate Inc., and Ethiopian Midwifes Association in collaboration with local Government and non-government partners. The funder did not have any role in the design of this study, data collection, analysis and writing of the manuscript.
Ethics approval and consent to participate
JSI research and Training Institute, Inc’s Institutional Review Board (IRB) has determined that this activity is exempt from human subjects’ oversight (IRB #20-15E). During data collection verbal consent was taken from each participant. The study had no known risk and no payment was made to participants.
Consent for publication
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
About this article
Cite this article
Desta, B.F., Abitew, A., Beshir, I.A. et al. Leadership, governance and management for improving district capacity and performance: the case of USAID transform: primary health care. BMC Fam Pract 21, 252 (2020). https://doi.org/10.1186/s12875-020-01337-0
- Management and governance
- District health management
- Health system performance
- Primary health care