A tool to help you use evidence to make decisions about a new or existing practice or program based on AERO’s standards of evidence.
Introduction
The Evidence decision-making tool assists you to:
- assess how confident you are that a certain practice or program is likely to be effective in your context
- decide on next steps, including how to implement the practice given your level of confidence and how to collect more evidence to increase your confidence in its effectiveness.
The tool can be used by an individual or a group, for example, in a staff workshop or community of practice. It’s designed to be flexible, so you can use it to consider any type and size of change, from a small adjustment to an existing teaching practice to the introduction of a new school-wide wellbeing program. The tool provides a structured way to help you consider the rigour and relevance of the evidence supporting a practice or program objectively but it’s not a set of rigid rules to follow. Sometimes it will be difficult to decide which category your evidence fits in and you’ll need to use your professional judgement to make a decision. Throughout the Evidence decision-making tool you will find links to other AERO resources that provide more information to help you find and evaluate the evidence you need.
How do I use the Evidence decision-making tool?
How much confidence is enough?
Although high or very high confidence is preferable, sometimes there isn't enough evidence available to achieve these standards.
When evidence is lacking, use your professional judgement to weigh the potential benefits, costs and risks of implementing the approach. For example, it may be acceptable to implement an approach in which you have only low or medium confidence when not changing a current practice may do harm or when the consequences of implementing an ineffective approach are small or have been appropriately mitigated. In these instances it is particularly important to carefully monitor and evaluate the effects of the approach. The Evidence decision-making tool provides guidance for cautiously implementing an approach and collecting more evidence when you have only low or medium confidence.
Remember, knowledge is constantly evolving and contexts change so the process of considering the evidence is never finished. It’s a good idea to revisit the evidence and reassess your confidence level as often as is reasonable given the importance of the decision you’re making.
Evidence decision-making tool for practitioners
How confident can I be about the effectiveness of a particular practice in my context?
Identify the statement(s) that best describes the evidence you currently have to support this practice. Your current level of confidence is the highest level for which you have evidence. For example, if you have both level 1 and level 3 evidence, your current level of confidence is level 3.
Remember to keep monitoring the research evidence to stay up to date with evolving knowledge about effective practices, programs and policies in education.