Living Guide to Social Innovation Labs
ENG
ENG
  • Introduction
  • Seeing
    • Understanding Complex Problems
      • Challenge Statements
      • Systems Thinking
      • Systems Mapping
      • Leverage Points
      • Wicked Questions
    • Design Research
      • Design Thinking
      • Ethnography
      • Interviews
      • Journey Mapping
      • Service Blueprint
      • Sensemaking
      • Dashboards
    • Systemic Design
    • Identifying and Engaging Key People
      • Stakeholders
      • Stakeholder Mapping
  • Doing
    • Co-Creation
      • Convening
        • Is Convening the Right Tool?
        • Types of Convening
      • Facilitation
      • Collective Impact
      • Ideation
    • Prototyping
      • Prototyping in a Lab Context
      • Testing
      • Types and Modalities
      • Prototyping Approaches
    • Scaling
      • Growth Thresholds
      • Scaling Up, Out, Deep
      • Tactics for Scaling
      • Scaling Strategy
    • Monitoring, Measuring and Communicating Impact
      • Types of Evaluation
      • Logic Models
      • Measures and Metrics
      • Standards of Evidence
      • Evaluating Complexity
      • Communicating Impact
  • Being
    • Innovation Labs and Process
      • Agile Project Management
      • Value Proposition
      • Theory for Change
      • Business Models
    • Resourcing and Team
      • Lab Partners
      • Team Expertise and Skills
      • Wellbeing of Remote Teams
      • Funding
    • Inclusion and Equity Practice
      • Power Structures
      • Innovation for Real Transformation
      • Truth and Reconciliation
      • Recommendations for Inclusive Practice
  • Share my content
Powered by GitBook
On this page

Was this helpful?

  1. Doing

Monitoring, Measuring and Communicating Impact

Social innovation labs help address and tackle complex problems. However, evaluating the change we bring about for complex problems is extremely challenging. This is because:

  • A complex problem changes as you try to solve it;

  • The causes and drivers are interdependent;

  • It is filled with uncertainties and unknowns; and

  • It requires multiple new solutions which is impossible to know which will work best.

This makes attribution and causality very difficult. That is, if you’re measuring change of something in a changing environment (among other characteristics of a complex problem), it is difficult to attribute any cause and effect to your actions. It also involves many stakeholders with different values and priorities – which makes it difficult to agree on what change to bring about (and the scope of that change), as well as how to measure it.

This requires adaptive management, where you change and adapt your methodology as you go, rather than use a traditional cause-effect methodology. While the field of evaluation of social innovation labs is still very nascent, we clearly need to move beyond traditional methodology to find new frameworks to evaluate the efforts of labs in this emergent, unpredictable environment. As Michael Quinn Patton explains:

Not all forms of evaluation are helpful. Indeed, many forms of evaluation are the enemy of social innovation. This distinction is especially important at a time when funders are demanding accountability and shouting the virtues of “evidence-based” or “science-based” practice.

– Michael Quinn Patton (2016)

We suggest focusing on what you can learn from each prototyping cycle, and reintegrating that feedback into your prototyping design process (where each feedback loop gives you critical information about the prototype). In this way, you can both learn about what is working and not working, but reintegrate this back into the prototyping process.

For this reason, it’s important to think of your intervention or solution as a source of data, so that you can collect it for feedback. This means when you’re designing an intervention, you can already start to think about how you will encourage end users to help collect data. In doing so, you need to think about how the data might be useful to them as well as for your team.

PreviousScaling StrategyNextTypes of Evaluation

Last updated 5 years ago

Was this helpful?