By the end of the course you will be able to:
- demonstrate an analytical grasp of assessment purposes and practices relevant to both online and more conventional forms of assessment
- critically evaluate the potential pedagogical benefits of, and limitations to, the use of online assessment in educational settings
- be familiar with a range of conceptually and empirically grounded frameworks for reviewing and enhancing developments in digital assessments
- identify and review prospects for online assessment that reflect your subject area and academic and professional interests in relation to the higher and post-compulsory education sectors
Week 1: Assessment purposes and perspectives
The course opens with an opportunity to review your experiences of being assessed and share with others your initial thoughts on what makes for a good assessment. We then turn to the fundamental question of what purposes can underlie assessment, how different 'stakeholders' tend to vary in which purposes they value most, and what tensions may arise from these differences.
Weeks 2-3: Frameworks and principles
A recurring theme in the assessment literature is the problematic interrelationship between assessment-for-grading ('summative assessment') and assessment- for-learning ('formative assessment'), allied to concerns that the former has all too often flourished at the expense of the latter. Here we invite you to take a critical look at a number of frameworks and manifestos that each seek to put assessment-for- learning to the forefront and articulate evidence-informed guiding principles.
Week 4: Digital contexts and multimodal assessments
Novel, online forms of assessment provoke new questions about what the informal ground-rules (and even the implications for more formal assessment regulations) might be. This theme explores the implications for assessment in digital environments. We will examine a variety of actual online assessments and consider how they open up opportunities for students to communicate what they know, understand and can do and how they ask us, as educators, to consider the interpretative role of the assessor and to re-think conventional wisdom about assessment and feedback.
Week 5: Assignment preparation
We pause teaching activities this week to work on our first assignment (the individual ‘think piece’) and allow time for students to share drafts and comment on each other’s work.
Week 6: Feedback, feedforward and dialogue
Here we focus on the opportunities digital environments afford to enhance assessment-for-learning by facilitating and boosting guidance and feedback to students on their progress and performance. We will consider applications that range from comments on coursework assignments, through initiatives that enable students to self-test periodically, to electronic voting systems that provide a systematic check on how well what has been taught has been understood.
Week 7: Assessment literacy
Traditionally, assessment has been a relatively arcane and mysterious practice - understood only by those few judged sufficiently expert to be assessors in a given field and taking place in private, behind closed doors. But the mysteries of assessment have been falling away, and there has been growing recognition that it’s hard for students to perform consistently well if they don’t have a good grasp of what high-quality work looks like, and of how to go about achieving it. This ‘insider’ view of assessment practices is precisely what ‘assessment literacy’ aims to develop in students. Here we explore emerging perspectives on assessment literacy and the activities designed to promote it, such as peer review and the use of exemplars.
Week 8: Collaborative learning and assessment
Digital technologies have opened up exciting new opportunities for students to work collaboratively, whether through new forms of communication and interaction as they pursue shared or pooled tasks, or through co-authoring tools that allow writing and revising of joint publications, presentations or other output. But assessing such collaborative activities also poses tricky issues for educational systems that have traditionally evaluated and rewarded individual rather than group endeavour and where the borderlines between cooperation and collusion may be fuzzy rather than clear-cut. During this theme we will tease out some of our own ways of working collaboratively in preparation for our own group-based assessment.
Weeks 9-12: Emerging themes and the ‘big questions’ assignment
In these weeks, we will explore some of the emerging challenges that new technologies might bring to traditional understandings of the relationship between teacher, student and assessment. We will also be engaging in our group-based assessment for the course, our ‘Big Questions’ assignment (see the section on ‘assessment’ below for more information on the assignment).
There are three elements to the assessment.
Individual ‘think piece’ (25%): This assignment is an individual critical exploration of the challenges of multimodal, digital assessments for and of learning. to think about the ways that assessment practice is affected by new and emerging opportunities to construct and convey meaning in richly digital ways. To do this we want you to engage with the literature that sheds light on the sometimes complex relationship between multimodality and assessment. By taking a scenario-based approach in this assignment we wish to emphasise how the approaches we take in the design and delivery of assessment exercises can be informed by the application of research and critical discourse to practice.
Group-based assignment (50%): As an integral part of your work in this unit, you will have the opportunity to experience a collaborative, online assessment first hand. This will give you the opportunity to explore in depth a topic of some interest to you, but also to surface and reflect on the challenges of collaborative, online assessments. Your reflections might provide a stimulus for your final assignment. In this assignment, you will work with others to tackle one of our “Big Questions” - key questions or statements for digital assessment - that require a co-authored, critical and synthesised response from your group and a supportive, interdependent approach for the whole class. To acknowledge and underpin the collaborative nature of the assignment, each group response to a Big Question will be graded as a whole will be awarded one mark that all members of the course group will share.
Individual position paper (25%): The intention with this assignment is twofold: firstly, to let you explore in some depth another emerging theme; secondly, to both motivate and allow you to capitalise on your role as a critical friend during the Emerging Themes weeks. This is an opportunity for you to reflect on the current state of affairs for your critical friend topic and to do some ‘blue skies’ thinking about where that area might develop. You are encouraged to draw on the assignment developed by your peers in weeks 9-12, the resources recommended for that topic and the wider literature covered throughout this course and your other courses. However, this is not a literature review. Instead, the literature should help you position your own perspective – your argued for take on the topic in hand. We want you to ask “Where is the field at, where could it go or does it need to go? Where next for [your topic]?”
The course is delivered entirely online through a combination of environments. The core environment for course communication is Moodle which is where you will find discussion space, course readings and resources. We also use collaborative authoring spaces (e.g. PB wiki, Google Docs) and synchronous spaces (e.g. like Skype, Adobe Connect) for our occasional synchronous sessions.
The course is somewhat flexible in terms of how you structure your workload, though there will be one-hour synchronous sessions offered in some weeks which you are encouraged to attend. The course also has a channel in our programme Discord server. In the final theme, you must engage with group work and will be responsible for co-organising your group, co-authoring your work and offering constructive critiques for your peers.
As with the rest of the Digital Education programme, the ethos of this course is one of active, collegial and constructive participation.
Indicative reading for the course is:
Boud, D. (1995). Assessment and learning: contradictory or complementary. In Assessment for Learning in Higher Education. P. Knight (Ed) (London: Kogan Page/SEDA): pp. 35-48
Carless, D. (2007). Learning-oriented assessment: conceptual bases and practical implications. Innovations in Education and Teaching International 44(1): pp. 57–66.
Henderson, M. et al. (2018). Feedback for Learning: Closing the Assessment Loop. Framework for Effective Feedback.[incl. Infographic]. Australian Government Dept. of Education and Training/Monash, Deaking & Melbourne Universities. http://newmediaresearch.educ.monash.edu.au/feedback/framework-of-effective-feedback/
Lamb, James. "To Boldly Go: Feedback as Digital, Multimodal Dialogue." Multimodal Technologies and Interaction 2, no. 3 (2018): 49. http://www.mdpi.com/2414-4088/2/3/49
Mahoney, P., Macfarlane, S., & Ajjawi, R. (2018). A qualitative synthesis of video feedback in higher education. Teaching in Higher Education, 1-23.
Nicol, D. 2014. Guiding principles for peer review: unlocking learners’ evaluative skills. In eds. C. Kreber, C. Anderson, N. Entwistle and J. McArthur Advances and innovations in university assessment and feedback. Edinburgh: Edinburgh University Press.
O’Shea, C. and Fawns, T. (2014). Disruptions and dialogues: Supporting collaborative connoisseurship in digital environments. In Kreber, C., Anderson, C., Entwistle, N., & J. McArthur (Eds.). Advances and innovations in university assessment and feedback, pp. 259-273. Edinburgh: Edinburgh University Press.
Sadler (2010): Beyond feedback: developing student capability in complex appraisal. Assessment & Evaluation in Higher Education, 35:5, 535-550.
As with all courses, you will be required to have regular access to a computer with a good broadband connection, and will be responsible for providing your own computing equipment and consumables. All core and some additional readings will be provided online.
For synchronous sessions you will need headphones and a microphone.