Queensland Stay On Your Feet® Toolkit

• Queensland Stay On Your Feet® Home
• Toolkit
  • Model diagram
  • Model's explanation
• Background
• Phase 1 - Investigate
  • What is the problem?
  • What are the impacts of the problem?
  • Why does the problem occur?
  • Where does the problem occur?
  • When does the problem occur?
  • What is the current context?
  • What is already happening?
• Phase 1 - Materials
  • Collecting information
  • Fear of falling
  • Risk factors
  • Key documents
  • Community stocktake
• Phase 2 - Plan
  • What can be done?
  • What do we know about the target group?
  • Who can be involved?
  • How do we keep the work going?
  • How will we measure progress?
• Phase 2 - Materials
  • Key stakeholders
  • Roles and responsibilities
  • Good working relationships
  • What works?
  • Decision making
  • Goals, objectives, strategies
  • Community planning meetings
  • Reach and marketing
  • Social marketing plan
  • Key messages
  • Community engagement
  • Partnerships
• Phase 3 - Implement
  • Are we testing before we act?
  • What can we achieve now and later?
  • Are there opportunities to explore?
  • How are we monitoring progress?
  • Are we talking with others about our work?
  • Are we measuring our efforts?
• Phase 3 - Materials
  • Communicating
  • Awareness raising
  • Communication plan
  • Community progress meetings
  • Ambassadors
  • Physical activity
  • Sports tours
  • Come and try days
  • Case studies
• Phase 4 - Review
  • Process evaluation
  • Impact evaulation
  • Outcome evaluation
  • Share and celebrate
  • What happens next?
• Phase 4 - Materials
  • Process evaluation tools
  • Impact evaluation tools
  • Outcome evaluation tools
• Acknowledgements

What did people do as a result of our work? (Impact evaluation)

B. What did people do as a result of our work? (Impact evaluation)

Impact evaluation measures the effectiveness of the project/program and the progress towards achieving the objectives [17, 89, 90].  It is considered an intermediate measure to determine the positive and negative changes that have resulted [89, 90].

Goals, objectives and strategies (link to file Phase 2 materials goals, objective and strategies)

When assessing change, what was expected to happen should not be the only aspect analysed. All changes should be looked at, as there may have been some unexpected positive and negative results [22, 89,90]. It is important that your project/program “is being implemented without causing adverse consequences (eg. injuries during physical activity)” [90].

Collecting a baseline measure at a community, organisational and individual level before your project/program activity commences is vital to provide a comparison with information collected after implementation. The Queensland Stay on Your Feet Wide Bay/Burnett trial project used a pre and post computer assisted telephone interview (CATI) survey.

Queensland Stay on Your Feet Computer Assisted Telephone Interview (CATI) pre-survey
Queensland Stay on Your Feet Computer Assisted Telephone Interview (CATI) post-survey
Baseline

For example, an objective of the Queensland Stay on Your Feet Wide Bay/Burnett trial project was to increase falls prevention activities among the target group and key stakeholders. The community stocktake showed an increase in local councils providing physical activity programs by the end of the project.

You should also consider when you expect the effect of the program will occur and evaluate at this point in time [17]. If evaluation is done too early or too late, you may miss capturing the effect of the project/program [17]. Refer to what other projects/programs have done in the literature or conduct research with smaller groups of people at several points in time eg. one month, three months and/or six months [17]. When measuring change as a result of your project/program, remember that there may be other potential influences that could positively or negatively affect your results [26].

Impact evaluation measures the intermediate effectiveness of projects/programs [16] and may include the following:

• target groups’ awareness, knowledge, skills and actions eg. in the Queensland Stay on Your Feet Wide Bay/Burnett trial project, older people increased their regular moderate physical activity and wore safer shoes.
• public attitudes, norms and community participation eg. at the end of the Queensland Stay on Your Feet Wide Bay/Burnett trial project, more people disagreed with the statement  “older people fall and nothing can be done about it”.
• public policies, organisational policy and practices, legislation, standards and regulations eg. the Queensland Stay on Your Feet Wide Bay/Burnett trial project encouraged the development and inclusion of falls prevention strategies into five local council plans. 
• environmental aspects eg. the Queensland Stay on Your Feet Wide Bay/Burnett trial project encouraged the building of local footpaths and walkways to support physical activity.
• social support structures eg. the Queensland Stay on Your Feet Wide Bay/Burnett trial project encouraged Nordic Pole walking on the beach and friendships between ambassadors.
• provision of community services eg. the Queensland Stay on Your Feet Wide Bay/Burnett trial project encouraged more organisations to provide physical activity programs. 

The evaluation planning worksheet and the list of evaluation tools will be useful for keeping track of all the evaluation questions. This may need to be modified to meet your project/program evaluation goals. 

evaluation planning worksheet
evaluation tools

For suggested methods of collecting impact information, visit: Impact evaluation tools

top of page