Friday, April 19, 2013

Program Evaluation and Improvement

Program Evaluation and Improvement (Yuanjie and Kanita)




prgram evaluation video




Program evaluation and improvement

Program evaluation is an essential organizational practice in social programs. However, it is not practice consistently across program areas, nor is it sufficiently well-integrated into the day-to-day management of most programs.

Effective program evaluation is a systematic way to improve and account for public health and social service actions by involving procedures that are useful, feasible, ethical, and accurate.

The author provides a framework, which is composed of six steps that must be taken into account for any evaluation.

Step 1: Engage stakeholders

Step 2: Describe that program

Step 3: Focus the evaluation design

Step 4: Gather credible evidence

Step 5: Justify conclusion

Step 6: Ensure use and share lessons learned

Stakeholders must be engaged in the inquiry to ensure that their perspectives are understood. When stakeholders are not engaged, an evaluation might not address important elements of a program’s objectives, operations, and outcomes.

Program descriptions convey the mission and objectives of the program being evaluated. Descriptions should be sufficiently detailed to ensure understanding of program goals and strategies.

The evaluation must be focused to assess the issues of greatest concern to stakeholders while using time and resources as efficiently as possible

An evaluation should strive to collect information that will convey a well-rounded picture of the program so that the information is seen as credible by the evaluation’ primary users.

The evaluation conclusions are justified when they are linked to the evidence gathered and judged against agreed-upon values or standards set by the stakeholders.

Deliberate effort is needed to ensure that the evaluation processes and findings are used and disseminated appropriately.

 

One of the most significant benefits that a program evaluation communicates is the need to make improvements.

Examples of the types of improvements that an evaluation may reveal could include:

·         The elimination of program services and activities that do not achieve program outcomes

·         The addition of other services and activities that are better designed to achieve outcomes

·         Acquiring more adequate resources to support program services and activities

·         Target a different group of participants to receive program services because there are an inadequate number of specified participants available to receive services

These and/or other types of program improvements that are revealed by the evaluation findings should be viewed and communicated as an opportunity to make the program better.


How have you used the CDC framework in your line of work to evaluate something?

What other frameworks to find to be more effective then this particular framework?

What are some possible ways in which you can engage stakeholders?

What important factors can you take away from the youtube video link posted?




Reference:

Posavac EJ, Carey RG. Program evaluation: methods and case studies. Englewood Cliffs. NJ: Prentice-Hall, 1980.

Eddy DM. Performance measurement: problems and solutions. Health Aff 1998;17(4):7-25.

Thursday, April 4, 2013

Why Should We Beta Test?

http://www.digitalwhip.com/wp-content/uploads/2012/08/shutterstock_48434191-617x416.jpg
By: Katie Horst

What is beta testing?
Beta testing is when a product is tested by real customers in their real environments before it is ever out. During a beta test, the company and the customers form a partnership in order to make the product reach its full potential.

More about beta testing:


Why should we beta test?
The overall purpose of conducting a beta test is to create the best possible product. By doing a beta test, the company is receiving feedback, and they’re gaining more knowledge about their product before it is ever released. This way, improvements can be made before the product is available to the public. Beta tests can help to develop a product that has improve customer satisfaction, better reviews, increased sales, fewer problems/less support costs, a more positive brand image, etc. It’s essential to do a beta test in order to make sure that you are getting a product that consumers actually want.  Beta tests also provide an opportunity for customers to get involved, and help improve a product that they’re interested in.

I found it interesting that companies such as Play Station, have programs that are offered to the public to participate in their beta testing. Here are the terms and conditions a person must follow: http://us.playstation.com/support/useragreements/ps_public_beta_test_program.html. Play Station allows for people to be given early access to certain things like games. Those people are then required to provide feedback about things such as the chat rooms, connectivity, and usability of the product.

Doing a beta test:
Click here for a great article if you want to know more about implementing a beta test. The article looks at why a beta test should be done. It also provides general guidelines, the planning process, evaluation process, and other helpful tip about doing a beta test.

Questions:
1)      Have you ever participated in a beta test, or have you ever implemented one? 
2)     How did you go about conducting a beta test for your project?
3)     By doing a beta test, do you think this will better your product?
4)     From your personal experiences, why do you think we should beta test?