Assessing Online Collaboration: What You Need To Know

Assessing Online Collaboration: What You Need To Know
Summary: In this article I will share some key information about assessments and their characteristics, as well some easy ways to assess online collaboration in collaborative learning activities.

What You Need To Know About Assessing Online Collaboration   

The goal of collaborative learning activities is to provide students with learning opportunities where learners are able to interact while sharing and processing new information. Assessing individual learning and achieving full online participation can be difficult without the appropriate assessment tool. Assessing online collaboration can be challenging and require the instructor to create assessment tools that evaluate individual student learning and group participation. Additionally, communicating evaluation results with online learners can be just as challenging as creating the assessment tool.

Formative And Summative Assessments

Assessing is the process of identifying specific and measurable goals, collecting evidence of student learning, and implementing changes to future instruction for the purposes of improving student achievement. Assessing student learning in the online environment can be in the form of formative or summative assessments. Formative assessments are ongoing and can occur at several points throughout a course. The objective of formative assessments is to monitor student learning, which will provide the instructor ongoing feedback that can be used to improve teaching and instruction. More specifically, formative assessments help learners identify personal strengths and weaknesses and help to create future learning goals. Additionally, formative assessments are generally low stakes assessments, having low or no point values. Some formative examples include: Student self-reflections, self-assessments, discussion rubrics, collaborative assessments, peer-to-peer feedback, and student working portfolios.

The objective of summative assessments is to assess student learning at the end of a course by comparing it against a previously set standard or benchmark. Information from summative assessments can be used to focus and realign overall course objectives and assignments for future course offerings. Summative assessments are often high stakes, having a high point value. Examples of summative assessments might include: Midterm exams, final projects, extended writings, or a final portfolio. However, using only summative assessment types ignores many of the basic guiding principles of collaborative online student assessments.

6 Key Assessment Characteristics

Assessing collaborative group activities require the instructor to understand basic principles of online student assessment. Morgan and O’Reilly discuss six key qualities of collaborative assessments, which include: Explicitly stated performance expectations, authentic tasks, a facilitative structured assessment, timely assessments, and an awareness of the learning context. The multitude of variables linked with assessing collaborative activities is a challenge for online instructors as they develop collaborative activities. The first step in determining the assessment tool is to identify the goals and objectives of the collaborative activity. The difficulty is found in matching the activity to the appropriate assessment tool. The following assessment tips provide a guide for online instructors as they develop collaborative group activities and assessments:

  1. Identify the learning outcomes.
    Assessments should be products of the activity and student learning.
  2. State explicitly the activity expectations.
    Learners must know the activity objectives and performance expectations before beginning.
  3. Use rubrics.
    Explicit evaluation criteria with assigned values based on levels of participation and content should always accompany an online collaborative activity.
  4. Provide timely assessment feedback.
    Value learner work and effort from the very beginning.
  5. Use a reflective process.
    Learning occurs at a deeper level when students are able to reflect on their own learning knowledge and experiences.
  6. Allow learners to develop portfolios.
    Serves as evidence of individual and group work.

Ways To Assess Online Collaboration 

  • Self-Assessments. 
    Assessing student learning can happen in a number of ways to include learner self-assessments. Self-assessments can be considered formative or summative depending on how learner results are used to guide future instruction and learning. Collaborative activities are best assessed collaboratively  and with the appropriate rubrics learners can assess their own learning and the learning of others easily. According to Palloff and Pratt learners often know more about the level of participation each group member contributed than the instructor. Learners who actively engage in collaborative activities retain new information and increase their ability to self-reflect. Finally, instructors can quickly assess student learning by asking questions such as:

    • How well do you feel you met the learning objectives?
    • What grade do you feel you deserve and why?
    • Based on the collaborative assignment expectations what grade do you feel each participant should receive and why? 
  • Reflective Assessments.
    Meaningful self-reflections are important assessment tools for determining the level of online learning interactions, community building, and overall understanding of learning objectives. Critical self-reflection is a significant part of transformative learning. Self-reflective assessments allow learners to connect with content at a much deeper level and provide the instructor with evidence of individual learning. Learner self-reflections can be completed via instructor made surveys or through journal writing. Requiring learners to provide significantly relevant peer-to-peer feedback increases their own self-reflective skills. Furthermore, the process of self-reflection forces learners to compare their standard for learning to the learning standards of other group members. It is recommended instructors provide learners with clear peer-to-peer feedback expectations, which include providing others with quality, timely, and professional feedback.
  • Collaborative Projects.
    Collaborative projects, or performance-based activities, are essential to the learning process of online class environments. This is especially important in a constructivist account of learning, where the instructor is replaced by knowledge and experiences of other learners. Collaborative projects, such as group –portfolios, are designed to exploit the benefits of collaborative peer learning through the use of technology. Peer interactions provide opportunities for learners to develop critical thinking skills and allow the instructor to assess mastery of overall course goals and objectives. However, participants of collaborative group projects can best assess collaborative projects. Additionally, instructors may ask learners to assess and justify their view, compare it with that of other collaborative group members, or revise existing beliefs. The use of rubrics, with appropriate examples and project expectations, be provided to learners to help guide them in the project completion.
  • Rubrics. 
    Ultimately every assessment practice results in the use of a rubric, regardless of the learning environment or learning activity. Rubrics are tools that help define the performance expectations of a given task or assignment. Rubrics provide learners with assignment expectations and provide learners with a way to evaluate their own learning, as well as the learning of other participants within collaborative activities.  Rubrics can be used to evaluate individual student learning, participation, or overall group performance. Collaborative activities should be assessed for the product and process. Additionally, the use of rubrics to assess learner discussions is also especially useful when evaluating a learner’s ability to synthesis, analyze, and justify important and complex information. Online asynchronous discussion also allows learners the opportunity to reflect on the contributions of other collaborative group members. Furthermore, rubrics create self-awareness and provide learners the opportunity to compare their own performance against that of other participants and the instructor’s performance standards.

References:

  • Bandura, A. (1977). Social Learning Theory.
  • Brindley, J. E., Walti, C., & Blaschke, L. M. (2009). Creating effective collaborative learning groups in an online environment. International Review Of Research In Open & Distance Learning, 10(3), pp. 1-18.
  • Conrad, R. & Donaldson, J. A. (2012). Continuing to engage the online learner. San Francisco, CA: Jossey-Bass.
  • Hadjerrouit, S. (2013). A Framework for Assessing the Pedagogical Effectiveness of Wiki-Based Collaborative Writing: Results and Implications. Interdisciplinary Journal Of E-Learning & Learning Objects, pp. 929-49.
  • Haythornthwaite, C. (2006). Facilitating collaboration in online learning. Journal of Asynchronous Networks, 10(1,) pp. 7-24. Retrieved from http://sc-d7.sloan-c-support.org/sites/default/files/articles/downloads/v10n1_2haythornthwaite_0.pdf
  • Hwee Ling Koh, J. (2013). A rubric for assessing teachers' lesson activities with respect to TPACK for meaningful learning with ICT. Australasian Journal Of Educational Technology, 29(6), 887-900.
  • Lai, K. (2012). Assessing participation skills: Online discussions with peers. Assessment & Evaluation in Higher Education, 37(8), pp. 933-947, DOI: 10.1080/02602938.2011.590878
  • Mallon, M. N. (2013, January). Extending the learning process: Using the theory of connectivism to inspire student collaboration. Kansas Library Association College and University Libraries Section proceedings, 3(1), pp. 1-27.
  • Mansson, D. H. (2013). Assessing student learning in intercultural communication: Implementation of three classroom assessment techniques. College Student Journal, 47(2), pp. 343-351.
  • Palloff, R.M. & Pratt, K. (2005). Collaborating online: Learning together in community. San Francisco, CA: Jossey-Bass.
  • Palloff, R.M. & Pratt, K. (2007). Building online learning communities. San Francisco, CA: Jossey-Bass.
  • Paily, M. (2013). Creating constructivist learning environment: Role of "Web 2.0" technology. International Forum Of Teaching & Studies, 9(1), pp. 39-50.
  • Shiriram, R. & Carlise, S. (2010). Connectivism and the Impact of Web 2.0 Technologies on Education. Asian Journal of Distance Education, 8(2), pp. 4-17.
  • Siemens, G. (2005). Connectivism: Learning theory for the digital age. International Journal of Instructional Technology and Distance Learning, 2(1).
  • Simonson, M., Smaldino, S., Albright, M., & Zvacek, S. (2012). Teaching and learning at a distance: Foundations of distance education. [5th edition]. Boston, Mass: Pearson Education Inc.
  • Tinoca, L. F., Oliveira, I., & Pereira, A. (n.d.). Group work peer-assessment in an online environment. [collaborative paper]. Retrieved from https://786df6a2-a-62cb3a1a-s-sites.googlegroups.com/site/luistinoca/home/papers-1/eadtu07.pdf
  • Zygouris-Coe, V. (2012). Collaborative learning in an online teacher education course: Lessons learned. ICICTE 2012 Proceedings, pp. 332-342.