Program Evaluation

Preparation

Before you start your Group AR program, you should prepare and develop a simple program evaluation method. Asking participants to share their perspective on what worked well and what did not work so well during the Group AR program can provide you with invaluable information.

You can incorporate this feedback into your next Group AR program and constantly work towards improving your skills. 

Simple Feedback Form

After a series of sessions, or at the conclusion of an entire program, you can provide people with a simple questionnaire containing three questions.

1) What did you like and enjoy during the sessions?

2) How could the sessions be improved?  

3) What actions have you taken as a result of participating in the Group AR program?

After collecting the questionnaires, you should read over the answers and start grouping them into categories. As you review the feedback, you should try to think of ways that you can change your program so that participants get the most out of it in the future. 

On the other hand, remember that it is not possible to please everyone all of the time. All one can do is strive to ensure that the program makes a positive impact on as many participants as possible. 

Louise Hickson describes three simple and effective ways to evaluate the success of your Group AR program.

International Outcome Inventory

You can apply the International Outcome Inventory (IOI) for Alternative Interventions to measure the success of your Group AR program. The IOI is usually used to evaluate hearing aid usage.  William Noble, from the University of New England, Australia, developed a modified version of the IOI for alternative interventions like Group AR programs. 

The IOI for Alternative Interventions consists of seven questions that can appraise the effectiveness of group rehabilitation. 

If you are in a practice where you are fitting hearing aids and conducting a Group AR, you can use the IOI for Hearing Aids and the IOI for Alternative Interventions to compare the effectiveness of the treatment regimens. 

Goal Setting Measure

As an alternative evaluation method, you can adapt the Client Oriented Scale of Improvement (COSI) to determine whether your Group AR program successfully met participant goals.

At the first session of your program, have participants write down five goals that they would like achieve and learn during the course of the Group AR program. You can collect their feedback and use this information to shape your program further.

At the last session of the program, hand the questionnaires back to each participant. Ask them to rank each goal on a scale from 1 (Goal Completely Not Met) to 5 (Goal Completely Achieved). 

Must Reads

Hickson, L., Worrall, L., and Scarinci, N. Active Communication Education: A Program for Older People with Hearing Impairment, Speechmark Publishing: 2007.

Dillon H, James A and Ginis J (1997). The Client Oriented Scale of Improvement (COSI) and its relationship to several other measures of benefit and satisfaction provided by hearing aids. Journal of the American Academy of Audiology, 8:27-43.