Multilitteratus Incognitus
Pondering what to learn next 🤔
Assessing the process or the product?
12-01-2016, 04:00 assessment, INSDSG601, INSDSG690, instructionalDesign, open teaching, teaching
The other day I came across a post on ProfHacker written by Maha B. where she talked a bit about her own teaching experiences and whether one assesses the process of learning or the product of learning. I was thinking about this question in light of my own experiences as a learner, as a designer, and as an instructor who now has had experiences in introductory courses, capstone courses, and intermediate courses.
Obviously there isn't a hard and fast rule about this. In some courses, or parts of courses the final product matters enough so that it outweighs the grading component of the process. My gut tells (and the educator) me that the process is really more important than the final product. However, my own acculturation into the field of instructional design snaps me back to SMART outcomes (you know, specific, measurable, accurate, realistic, and time-bound) wherein these goals are really about the product and not the process. I suppose if you have the freedom to tweak the learning objectives of the course so that you can value the process more than the outcome then that is fine. However, if you can't tweak the objectives you have a bit of an issue.
Another thing I was considering is the specific outcome of the class. For example, in an introductory course I taught last summer I often leaned more toward process than overall quality of deliverable. This made sense since the learners were new to instructional design and, like artists, they needed to have several tries, attempts, and feedback attempts in order to become better at design. The final product that they produced was pretty good, but it could be better given knowledge from subsequent classes. So, the final product was good for the amount of information and experience they had on hand.
On the other hand, this past fall I supervised the capstone project for my instructional design MEd program, along with friend and colleague Jeffrey K. Even though this was a 3-credit course there wasn't really anything being taught. It was more of an independent study where each learner worked on their own capstone project, and received feedback on each iteration submitted. While there is a deliberate process behind this capstone project, the final product is meant to be a showcase of their capabilities as instructional designers, given that they have completed at least 10 courses before they enter they sign-up for the capstone. In cases like these, while process is important (feedback and improvement cycles), the final product is, in my mind, really what's being assessed.
That said, the case of the capstone is quite specific, and perhaps an outlier in this discussion. In classes that I design I prefer to give more weight to the process and less weight on the perfection of the final product. It's one of the reasons I have largely moved to pass/not pass grading in new courses I design. Instead of having students feel like they've gotten a ton of points off for one thing or another (despite the passing grade), I think it's better for them to know that they passed the assignment and really look at the feedback that I gave them. If in subsequent assignments they don't put that feedback to use, they may not pass subsequent assignments (and they can rework and resubmit), but what is important is that feedback-revision cycle. I think that it really mirrors how instructional design works anyway :-)
What do you think?
Obviously there isn't a hard and fast rule about this. In some courses, or parts of courses the final product matters enough so that it outweighs the grading component of the process. My gut tells (and the educator) me that the process is really more important than the final product. However, my own acculturation into the field of instructional design snaps me back to SMART outcomes (you know, specific, measurable, accurate, realistic, and time-bound) wherein these goals are really about the product and not the process. I suppose if you have the freedom to tweak the learning objectives of the course so that you can value the process more than the outcome then that is fine. However, if you can't tweak the objectives you have a bit of an issue.
Another thing I was considering is the specific outcome of the class. For example, in an introductory course I taught last summer I often leaned more toward process than overall quality of deliverable. This made sense since the learners were new to instructional design and, like artists, they needed to have several tries, attempts, and feedback attempts in order to become better at design. The final product that they produced was pretty good, but it could be better given knowledge from subsequent classes. So, the final product was good for the amount of information and experience they had on hand.
On the other hand, this past fall I supervised the capstone project for my instructional design MEd program, along with friend and colleague Jeffrey K. Even though this was a 3-credit course there wasn't really anything being taught. It was more of an independent study where each learner worked on their own capstone project, and received feedback on each iteration submitted. While there is a deliberate process behind this capstone project, the final product is meant to be a showcase of their capabilities as instructional designers, given that they have completed at least 10 courses before they enter they sign-up for the capstone. In cases like these, while process is important (feedback and improvement cycles), the final product is, in my mind, really what's being assessed.
That said, the case of the capstone is quite specific, and perhaps an outlier in this discussion. In classes that I design I prefer to give more weight to the process and less weight on the perfection of the final product. It's one of the reasons I have largely moved to pass/not pass grading in new courses I design. Instead of having students feel like they've gotten a ton of points off for one thing or another (despite the passing grade), I think it's better for them to know that they passed the assignment and really look at the feedback that I gave them. If in subsequent assignments they don't put that feedback to use, they may not pass subsequent assignments (and they can rework and resubmit), but what is important is that feedback-revision cycle. I think that it really mirrors how instructional design works anyway :-)
What do you think?
Comments

Archive
Mar 2025 (1)
Feb 2025 (1)
Jan 2025 (1)
Dec 2024 (2)
Oct 2024 (2)
Sep 2024 (1)
Aug 2024 (5)
Nov 2023 (1)
Aug 2023 (1)
Jul 2023 (1)
May 2023 (1)
Apr 2023 (4)
Mar 2023 (5)
Feb 2023 (2)
Dec 2022 (6)
Nov 2022 (1)
Sep 2022 (1)
Aug 2022 (2)
Jul 2022 (3)
Jun 2022 (1)
May 2022 (1)
Apr 2022 (2)
Feb 2022 (2)
Nov 2021 (2)
Sep 2021 (1)
Aug 2021 (1)
Jul 2021 (2)
Jun 2021 (1)
May 2021 (1)
Oct 2020 (1)
Sep 2020 (1)
Aug 2020 (1)
May 2020 (2)
Apr 2020 (2)
Feb 2020 (1)
Dec 2019 (3)
Oct 2019 (2)
Aug 2019 (1)
Jul 2019 (1)
May 2019 (1)
Apr 2019 (1)
Mar 2019 (1)
Dec 2018 (5)
Nov 2018 (1)
Oct 2018 (2)
Sep 2018 (2)
Jun 2018 (1)
Apr 2018 (1)
Mar 2018 (2)
Feb 2018 (2)
Jan 2018 (1)
Dec 2017 (1)
Nov 2017 (2)
Oct 2017 (1)
Sep 2017 (2)
Aug 2017 (2)
Jul 2017 (2)
Jun 2017 (4)
May 2017 (7)
Apr 2017 (3)
Feb 2017 (4)
Jan 2017 (5)
Dec 2016 (5)
Nov 2016 (9)
Oct 2016 (1)
Sep 2016 (6)
Aug 2016 (4)
Jul 2016 (7)
Jun 2016 (8)
May 2016 (9)
Apr 2016 (10)
Mar 2016 (12)
Feb 2016 (13)
Jan 2016 (7)
Dec 2015 (11)
Nov 2015 (10)
Oct 2015 (7)
Sep 2015 (5)
Aug 2015 (8)
Jul 2015 (9)
Jun 2015 (7)
May 2015 (7)
Apr 2015 (15)
Mar 2015 (2)
Feb 2015 (10)
Jan 2015 (4)
Dec 2014 (7)
Nov 2014 (5)
Oct 2014 (13)
Sep 2014 (10)
Aug 2014 (8)
Jul 2014 (8)
Jun 2014 (5)
May 2014 (5)
Apr 2014 (3)
Mar 2014 (4)
Feb 2014 (8)
Jan 2014 (10)
Dec 2013 (10)
Nov 2013 (4)
Oct 2013 (8)
Sep 2013 (6)
Aug 2013 (10)
Jul 2013 (6)
Jun 2013 (4)
May 2013 (3)
Apr 2013 (2)
Mar 2013 (8)
Feb 2013 (4)
Jan 2013 (10)
Dec 2012 (11)
Nov 2012 (3)
Oct 2012 (8)
Sep 2012 (17)
Aug 2012 (15)
Jul 2012 (16)
Jun 2012 (19)
May 2012 (12)
Apr 2012 (12)
Mar 2012 (12)
Feb 2012 (12)
Jan 2012 (13)
Dec 2011 (14)
Nov 2011 (19)
Oct 2011 (21)
Sep 2011 (31)
Aug 2011 (12)
Jul 2011 (8)
Jun 2011 (7)
May 2011 (3)
Apr 2011 (2)
Mar 2011 (8)
Feb 2011 (5)
Jan 2011 (6)
Dec 2010 (6)
Nov 2010 (3)
Oct 2010 (2)
Sep 2010 (2)
Aug 2010 (4)
Jul 2010 (9)
Jun 2010 (8)
May 2010 (5)
Apr 2010 (4)
Mar 2010 (2)
Feb 2010 (3)
Jan 2010 (7)
Dec 2009 (9)
Nov 2009 (5)
Oct 2009 (9)
Sep 2009 (13)
Aug 2009 (13)
Jul 2009 (13)
Jun 2009 (13)
May 2009 (15)
Apr 2009 (15)
Mar 2009 (14)
Feb 2009 (13)
Jan 2009 (10)
Dec 2008 (12)
Nov 2008 (6)
Oct 2008 (8)
Sep 2008 (2)
Jun 2008 (1)
May 2008 (6)
Apr 2008 (1)
Feb 2025 (1)
Jan 2025 (1)
Dec 2024 (2)
Oct 2024 (2)
Sep 2024 (1)
Aug 2024 (5)
Nov 2023 (1)
Aug 2023 (1)
Jul 2023 (1)
May 2023 (1)
Apr 2023 (4)
Mar 2023 (5)
Feb 2023 (2)
Dec 2022 (6)
Nov 2022 (1)
Sep 2022 (1)
Aug 2022 (2)
Jul 2022 (3)
Jun 2022 (1)
May 2022 (1)
Apr 2022 (2)
Feb 2022 (2)
Nov 2021 (2)
Sep 2021 (1)
Aug 2021 (1)
Jul 2021 (2)
Jun 2021 (1)
May 2021 (1)
Oct 2020 (1)
Sep 2020 (1)
Aug 2020 (1)
May 2020 (2)
Apr 2020 (2)
Feb 2020 (1)
Dec 2019 (3)
Oct 2019 (2)
Aug 2019 (1)
Jul 2019 (1)
May 2019 (1)
Apr 2019 (1)
Mar 2019 (1)
Dec 2018 (5)
Nov 2018 (1)
Oct 2018 (2)
Sep 2018 (2)
Jun 2018 (1)
Apr 2018 (1)
Mar 2018 (2)
Feb 2018 (2)
Jan 2018 (1)
Dec 2017 (1)
Nov 2017 (2)
Oct 2017 (1)
Sep 2017 (2)
Aug 2017 (2)
Jul 2017 (2)
Jun 2017 (4)
May 2017 (7)
Apr 2017 (3)
Feb 2017 (4)
Jan 2017 (5)
Dec 2016 (5)
Nov 2016 (9)
Oct 2016 (1)
Sep 2016 (6)
Aug 2016 (4)
Jul 2016 (7)
Jun 2016 (8)
May 2016 (9)
Apr 2016 (10)
Mar 2016 (12)
Feb 2016 (13)
Jan 2016 (7)
Dec 2015 (11)
Nov 2015 (10)
Oct 2015 (7)
Sep 2015 (5)
Aug 2015 (8)
Jul 2015 (9)
Jun 2015 (7)
May 2015 (7)
Apr 2015 (15)
Mar 2015 (2)
Feb 2015 (10)
Jan 2015 (4)
Dec 2014 (7)
Nov 2014 (5)
Oct 2014 (13)
Sep 2014 (10)
Aug 2014 (8)
Jul 2014 (8)
Jun 2014 (5)
May 2014 (5)
Apr 2014 (3)
Mar 2014 (4)
Feb 2014 (8)
Jan 2014 (10)
Dec 2013 (10)
Nov 2013 (4)
Oct 2013 (8)
Sep 2013 (6)
Aug 2013 (10)
Jul 2013 (6)
Jun 2013 (4)
May 2013 (3)
Apr 2013 (2)
Mar 2013 (8)
Feb 2013 (4)
Jan 2013 (10)
Dec 2012 (11)
Nov 2012 (3)
Oct 2012 (8)
Sep 2012 (17)
Aug 2012 (15)
Jul 2012 (16)
Jun 2012 (19)
May 2012 (12)
Apr 2012 (12)
Mar 2012 (12)
Feb 2012 (12)
Jan 2012 (13)
Dec 2011 (14)
Nov 2011 (19)
Oct 2011 (21)
Sep 2011 (31)
Aug 2011 (12)
Jul 2011 (8)
Jun 2011 (7)
May 2011 (3)
Apr 2011 (2)
Mar 2011 (8)
Feb 2011 (5)
Jan 2011 (6)
Dec 2010 (6)
Nov 2010 (3)
Oct 2010 (2)
Sep 2010 (2)
Aug 2010 (4)
Jul 2010 (9)
Jun 2010 (8)
May 2010 (5)
Apr 2010 (4)
Mar 2010 (2)
Feb 2010 (3)
Jan 2010 (7)
Dec 2009 (9)
Nov 2009 (5)
Oct 2009 (9)
Sep 2009 (13)
Aug 2009 (13)
Jul 2009 (13)
Jun 2009 (13)
May 2009 (15)
Apr 2009 (15)
Mar 2009 (14)
Feb 2009 (13)
Jan 2009 (10)
Dec 2008 (12)
Nov 2008 (6)
Oct 2008 (8)
Sep 2008 (2)
Jun 2008 (1)
May 2008 (6)
Apr 2008 (1)
