Week 3: Evaluating, Implementing and Managing Instructional Programs and Projects

Chapter 10 discusses evaluation in instructional design and provides you with two evaluation models, the CIPP and Kirkpatrick models for evaluation. Search for at least two other models used for evaluation and summarize these models. Describe how you would use them to evaluate your instruction.

Another model of design and evaluation I have encountered before is the ADDIE model.  The acronym that comprises the name of this model comes from its five phases: Analysis, Design, Development, Implementation and Evaluation. Evaluation is not the entire design model, but is incorporated within its framework at every step. This is important to note, because it forces the designer to really take stock of whether their instruction is going to be effective when completely implemented. This model is very generic and serves as the basis for many other design models. It can be customized to fit many ages and stages of learning and instruction.

I would use the ADDIE model exactly as it is designed. The purpose of the model is to step back an evaluate our instructional planning at each step of the process. This is essentially what all good educators should be doing anyway. This insures that each student will benefit as much as possible from our instructional designs.

The ADDIE Model:

A second model of instructional design that I focused on was the Bates' ACTIONS model. ACTIONS is an acronym that stands for Access, Costs, Teaching (& Learning,) Interactivity, Organizational Issues, Novelty, and Speed. This model specifically deals with how to choose effective technology for classroom use. By using this model, teachers can evaluate new or proposed technologies to determine whether they will serve all students in a classroom setting. Access looks at whether the technology is easy to use and appropriate for a particular group of students. Costs is used to determine technology cost per student and whether there are more economic alternatives. The Teaching and Learning aspect of this model aims to pinpoint the exact learning or objectives that are to be fulfilled by the technology. Interactivity looks at what features a particular piece of technology can offer in a classroom environment. Organizational Issues deals with any possible barriers to being able to use the technology effectively in a particular district or classroom. Novelty assesses whether the technology offers new capabilities and to what extent students will find it engaging and new. Finally, Speed evaluates how fast products can be changed or distributed using the technology.

I think this model would be an excellent means of deciding what tools to use in a classroom. It seem that more questions are addressed with this model. It would be important, however, to still keep sight of the overall learning objective when evaluating any new technology for the classroom.

The ACTIONS Model: 

Reflect on what other questions that instructional design evaluation should address besides whether the instructional design leads to comparable amounts of learning and learner satisfaction as traditional methods. What else would be useful to know?

I believe that one of the most important questions to consider when dealing with the real world application of models and theories is cost-effectiveness. In a perfect world, teachers could try out one kind of technology and evaluate its effectiveness mid-implementation. We live in the real world, however, and should therefore make an effort to evaluate new technology and instructional design ideas objectively before we spend the money to implement them in our schools. It has been my experience that school administrators and districts will invest funds in new technologies and programs without consulting teachers beforehand. This, of course, leads to the realization later that the chosen products were not the best choices for the school.

Additionally, when evaluating cost effectiveness, it is important to not lose sight of whether new tech or programs are actually needed at all. Many districts now implement BYOD (bring your own device) initiatives to solve the problem of cost. This can be a great alternative to investing precious funds into unknown technologies.

Another thing to consider when evaluating design and technology is whether the product or plan provides students with an underlying real-world skill that can help them be more prepared for the job market later in life. Using Instagram to compile a visual report is cool, but will an employer someday need an employee who can use Instagram well? Most likely not. I think it is always a good idea to teach kids technology work skills while also teaching them the content objectives. Kill two educational birds with one stone!

Chapter's 12 & 13 focus on project management and how to manage projects when resources are scarce. You have been assigned to develop a series of professional development sessions focusing on technology use in the classroom for teachers during a time of economic decline. How will you use Situational Leadership to facilitate this project and manage scarce resources?

One of the points I gleaned from this section is the kind of “save for a rainy day” philosophy. Like I mentioned above, I have seen instances where school administrators will invest in new technology and resources without ample input from the teachers who will be expected to make the tech useful and worth the investment. This, I think, would be an example of how not to embody situational leadership. It would be better instead to very carefully analyze what teachers say they want and what they say they would actually use. Even in times of economic plenty, a district or school should tread very very carefully and deliberately when implementing new technology. The text emphasizes choosing resources wisely. A very careful approach to selecting technology for the classroom should begin with the people who will use it the most outside of students, namely teachers.

Also, to achieve a “bias toward scarcity” as the text advises, we should focus on existing resources or new ways to implement old technology. Many districts are achieving this with the use of BYOD (bring your own device) initiatives where students may use their own tech tools in the classroom. You could get around the problem of accessibility (not every student can afford a smartphone) by grouping students. You could also research companies who will donate older model hardware for educational use. In general, I think dealing with scarcity requires a great deal of creativity and positive thinking. We must create new ways to use old technology and think in a positive manner about the resources we do have.