Category Archives: education

A reflection on existentialism

Detail from stained glass window by Marc Chagall in Fraumunster Zurich from http://www.fraumuenster.ch

I was in Zürich last weekend.  We visited the Fraumünster with its magnificent stained glass windows by Marc Chagall [see my post entitled ‘I and the village‘ on August 14th, 2013] and by Augusto Giacometti (1877-1947).  The Kunsthaus Zürich has a large collection of sculptures by another Giacometti, Alberto (1901-1966), a Swiss sculptor, who is famous for his slender statues of people which portray individuals alone in the world.  He was part of the existentialist movement in modern art that examined ideas about self-consciousness and our relationship to other people.  For me, this echoed a lecture that I contributed last week to a module on Scientific Impact and Reputation as part of our CPD programme [see my post entitled ‘WOW projects, TED talks and indirect reciprocity‘ on August 31st, 2016.  In the lecture, I talked about our relationship with other professional people and the development of our technical reputation in their eyes as a result of altruistic sharing of knowledge. This involves communicating with others, building relationships and understanding our place in the community.  The post-course assignment is to write a reflective essay on leadership and technical quality; and we know, from past experience, that our delegates will find it difficult to reflect on their experiences and the impact of those experiences on their life and behaviour.  Maybe we should help them by including a viewing of existential art in one of the Liverpool art galleries as part of our CPD programme on Science and Technology Leadership?

Re-engineering engineering

More than a decade ago, when I was a Department Head for Mechanical Engineering, people used to ask me ‘What is Mechanical Engineering?’.  My answer was that mechanical engineering is about utilising the material and energy resources available in nature to deliver goods and services demanded by society – that’s a broad definition.  And, mechanical engineering is perhaps the broadest engineering discipline, which has enable mechanical engineers to find employment in a wide spectrum areas from aerospace, through agricultural, automotive and biomedical to nuclear and solar energy engineering.  Many of these areas of engineering have become very specialised with their proponents believing that they have a unique set of constraints which demand the development of special techniques and accompanying language or terminology.  In some ways, these specialisms are like the historic guilds in Europe that jealously guarded their knowledge and skills; indeed there are more than 30 licensed engineering institutions in the UK.

In an age where information is readily available [see my post entitled ‘Wanted: user experience designers‘ on July 5th, 2017], the role of engineers is changing and they ‘are integrators who pull ideas together from multiple streams of knowledge’ [to quote Jim Plummer, former Dean of Engineering at Stanford University in ‘Think like an engineer‘ by Guru Madhaven].  This implies that engineers need to be able work with a wide spectrum of knowledge rather than being embedded in a single specialism; and, since many of the challenges facing our global society involve complex systems combining engineering, environmental and societal components, engineering education needs to include gaining an understanding of ecosystems and the subtleties of human behaviour as well as the fundamentals of engineering.  If we can shift our engineering degrees away from specialisms towards this type of systems thinking then engineering is likely to enormously boost its contribution to our society and at the same time the increased relevance of the degree programmes might attract a more diverse student population which will promote a better fit of engineering solutions to the needs of our whole of global society [see also ‘Where science meets society‘ on September 2nd 2015).

For information on the licensed engineering institutions in the UK see: https://www.engc.org.uk/about-us/our-partners/professional-engineering-institutions/

Wanted: user experience designers

A few weeks ago, I listened to a brilliant talk by Professor Rick Miller, President of Olin College.  He was talking at a conference on ‘New Approaches to Higher Education’.  He tolds us that the most common job description for recent Olin graduates was ‘user experience designer’ rather than a particular branch of engineering.  Aren’t all engineers, user experience designers?  We design, manufacture and maintain structures, machines, goods and services for society.  Whatever an engineer’s role in supplying society with the engineered environment around us, the ultimate deliverable is a user experience in the modern vernacular.

Rick Miller’s point was that society is changing faster than our education system.  He highlighted that the relevance of the knowledge economy had been destroyed by internet search engines.  There is no longer much advantage to be gained by having an enormous store of knowledge in your head, because much more is available on-demand via search engines, whose recall is faster than mine.  What matters is not what you know but what you can do with the knowledge.  And in the future, it will be all about what you can conceive or create with knowledge.  So, knowledge-intensive education should become a thing of the past and instead we need to focus on creative thinking and produce problem-solvers capable of dealing with complexity and uncertainty.

Feedback on feedback

Feedback on students’ assignments is a challenge for many in higher education.  Students appear to be increasingly dissatisfied with it and academics are frustrated by its apparent ineffectiveness, especially when set against the effort required for its provision.  In the UK, the National Student Survey results show that satisfaction with assessment and feedback is increasing but it remains the lowest ranked category in the survey [1].  My own recent experience has been of the students’ insatiable hunger for feedback on a continuing professional development (CPD) programme, despite receiving detailed written feedback and one-to-one oral discussion of their assignments.

So, what is going wrong?  I am aware that many of my academic colleagues in engineering do not invest much time in reading the education research literature; perhaps because, like the engineering research literature, much of it is written in a language that is readily appreciated only by those immersed in the subject.  So, here is an accessible digest of research on effective feedback that meets students’ expectations and realises the potential improvement in their performance.

It is widely accepted that feedback is an essential component [2] in the learning cycle and there is evidence that feedback is the single most powerful influence on student achievement [3, 4].  However, we often fail to realise this potential because our feedback is too generic or vague, not sufficiently timely [5], and transmission-focussed rather than student-centered or participatory [6].  In addition, our students tend not to be ‘assessment literate’, meaning they are unfamiliar with assessment and feedback approaches and they do not interpret assessment expectations in the same way as their tutors [5, 7].  Student reaction to feedback is strongly related to their emotional maturity, self-efficacy and motivation [1]; so that for a student with low self-esteem, negative feedback can be annihilating [8].  Emotional immaturity and assessment illiteracy, such as is typically found amongst first year students, is a toxic mix that in the absence of a supportive tutorial system leads to student dissatisfaction with the feedback process [1].

So, how should we provide feedback?  I provide copious detailed comments on students’ written work following the example of my own university tutor, who I suspect was following example of his tutor, and so on.  I found these comments helpful but at times overwhelming.  I also remember a college tutor who made, what seemed to me, devastatingly negative comments about my writing skills, which destroyed my confidence in my writing ability for decades.  It was only restored by a Professor of English who recently complimented me on my writing; although I still harbour a suspicion that she was just being kind to me.  So, neither of my tutors got it right; although one was clearly worse than the other.  Students tend to find negative feedback unfair and unhelpful, even when it is carefully and politely worded [8].

Students like clear, unambiguous, instructional and direction feedback [8].  Feedback should provide a statement of student performance and suggestions for improvement [9], i.e. identify the gap between actual and expected performance and provide instructive advice on closing the gap.  This implies that specific assessment criteria are required that explicitly define the expectation [2].  The table below lists some of the positive and negative attributes of feedback based on the literature [1,2].  However, deploying the appropriate attributes does not guarantee that students will engage with feedback; sometimes students fail to recognise that feedback is being provided, for example in informal discussion and dialogic teaching; and hence, it is important to identify the nature and purpose of feedback every time it is provided.  We should reduce our over-emphasis on written feedback and make more use of oral feedback and one-to-one, or small group, discussion.  We need to take care that the receipt of grades or marks does not obscure the feedback, perhaps by delaying the release of marks.  You could ask students about the mark they would expect in the light of the feedback; and, you could require students to show in future work how they have used the feedback – both of these actions are likely to improve the effectiveness of feedback [5].

In summary, feedback that is content rather than process-driven is unlikely to engage students [10].  We need to strike a better balance between positive and negative comments, which includes a focus on appropriate guidance and motivation rather than justifying marks and diagnosing short-comings [2].  For most of us, this means learning a new way of providing feedback, which is difficult and potentially arduous; however, the likely rewards are more engaged, higher achieving students who might appreciate their tutors more.

References

[1] Pitt E & Norton L, ‘Now that’s the feedback that I want!’ Students reactions to feedback on graded work and what they do with it. Assessment & Evaluation in HE, 42(4):499-516, 2017.

[2] Weaver MR, Do students value feedback? Student perceptions of tutors’ written responses.  Assessment & Evaluation in HE, 31(3):379-394, 2006.

[3] Hattie JA, Identifying the salient facets of a model of student learning: a synthesis of meta-analyses.  IJ Educational Research, 11(2):187-212, 1987.

[4] Black P & Wiliam D, Assessment and classroom learning. Assessment in Education: Principles, Policy & Practice, 5(1):7-74, 1998.

[5] O’Donovan B, Rust C & Price M, A scholarly approach to solving the feedback dilemma in practice. Assessment & Evaluation in HE, 41(6):938-949, 2016.

[6] Nicol D & MacFarlane-Dick D, Formative assessment and self-regulatory learning: a model and seven principles of good feedback practice. Studies in HE, 31(2):199-218, 2006.

[7] Price M, Rust C, O’Donovan B, Handley K & Bryant R, Assessment literacy: the foundation for improving student learning. Oxford: Oxford Centre for Staff and Learning Development, 2012.

[8] Sellbjer S, “Have you read my comment? It is not noticeable. Change!” An analysis of feedback given to students who have failed examinations.  Assessment & Evaluation in HE, DOI: 10.1080/02602938.2017.1310801, 2017.

[9] Saddler R, Beyond feedback: developing student capability in complex appraisal. Assessment & Evaluation in HE, 35(5):535-550, 2010.

[10] Hounsell D, Essay writing and the quality of feedback. In J Richardson, M. Eysenck & D. Piper (eds) Student learning: research in education and cognitive psychology. Milton Keynes: Open University Press, 1987.