New & Noteworthy
The BHSA Transition Guide Part 7: Understanding DHCS’s Theories of Change for Statewide Behavioral Health Goals
This July, the Department of Health Care Services (DHCS) released Behavioral Health Transformation: Theories of Change for Statewide Behavioral Health Goals—a framework for how county behavioral health (BH) and Medi-Cal managed care plans (MCPs) can advance each of the statewide BH goals under the Behavioral Health Services Act (BHSA). While much of the attention on BHSA…
Evaluation Methods Quarterly: Synthesizing an Evaluative Judgment
Classically, there are five steps in the logic of evaluation: we define the evaluand (e.g., program, personnel, product), set criteria and standards, gather performance data, compare that performance to our standards, and then synthesize an overall judgment of merit, worth, or significance. In a previous post I argued that setting standards is the hardest problem in evaluation.…
Evaluation Methods Quarterly: Asking Good Evaluation Questions
Evaluation questions are an excellent focal point around which to design an evaluation, but asking these questions the right way is harder than it seems. A sophisticated analysis cannot rescue a poorly formed evaluation question. Yet evaluators, program managers, and funders routinely find themselves deep into an evaluation before realizing that the questions guiding their…
Evaluation Methods Quarterly: Moving from Disparities to Standards
Often, when a disparity is found in a program evaluation, this is reported as prima facie evidence of a problem with the program. For example, if a county mental health program recruits a larger proportion of older people than younger people, this may be presented as a disparity, and thus, a problem for the evaluand.…
Sharing Program Impact Stories Using Data
Storytelling is a powerful way to for community-based programs to build stakeholder engagement, attract funding, and build trust with clients and communities. Data-driven storytelling is even more powerful. Data-driven stories enhance credibility, increase transparency, and demonstrate accountability. In other words, data helps to ground a story in evidence. But what is the most effective way…
Evaluation Methods Quarterly: Setting Standards is the Hardest Problem in Evaluation
There are several truly difficult aspects of evaluation that demand years of patient study to approach with any confidence: valid measurement, causal attribution, and the use of information are among these. I am currently persuaded, however, that the hardest problem in evaluation is setting standards. To explain why this is the case, I’ll begin by explaining…
Evaluation Methods Quarterly: Randomization is Underused in Program Evaluation
Welcome to Evaluation Methods Quarterly, a blog series by Dr. Anthony Clairmont, EVALCORP’s Lead Methodologist. Each quarter, Dr. Clairmont explores key methodological concepts, challenges, and innovations in evaluation, offering insights to strengthen practice and advance the field. One of my observations over my years of working with many nonprofits and government agencies is that randomization…
Creating Sustainable Social Impact with Strategic Planning
Organizations across sectors are prioritizing sustainability and long-term impact more and more each day. Achieving meaningful and lasting change requires more than just good intentions—it demands strategic planning that aligns with mission-driven objectives, stakeholder engagement, and data-informed decision-making. Without a well-structured strategy, social impact initiatives risk inefficiency, short-term gains, or missed opportunities for systemic change.…
Maximizing Community Impact Through Effective Program Evaluation
Community-based initiatives are more than just good intentions—they’re powerful vehicles for positive social change. In this post we’ll explain both how program evaluation can maximize community impact and how to work effectively with an evaluation consultant. At its core, program evaluation is about maximizing a program’s potential—ensuring that every effort is purposeful, effective, and continually…