Tag Archives: exams

Inducing chatbots to write nonsense

Leave a reply

titanium dental implant face profile technical pictureThe chatbot, ChatGPT developed by OpenAI, has been in the news recently and is the subject of much discussion in universities primarily because of its potential use by students to complete their coursework assignments but also the positive uses to which it might be applied. After last week’s invitations to edit two special issues in different journals on cosmetic dentistry and wire arc additive manufacturing (WAAM) [‘Wire arc additive manufacturing and cosmetic dentistry?‘ on February 8th, 2023], I did a little research in the scientific literature to find out if anyone had published research on using WAAM to make parts for cosmetic dentistry but found nothing.  I was not surprised – the level of precision achievable with WAAM is about 1 millimetre which would be insufficient for most applications in cosmetic dentistry.  Then, I signed up for a free trial with ChatGPT and conducted an experiment by asking it to write about wire arc additive manufacturing and cosmetic dentistry.  The chatbot produced 128 words about how WAAM is becoming increasing popular in cosmetic dentistry because of its accuracy and precision also because a wide range of materials can be used allowing a match to the colour and texture of teeth.  I repeated the experiment and the chatbot produced 142 different words, again stating that dental prostheses can be produced using WAAM with high precision and accuracy to match a patient’s existing teeth in colour so that restorations appear natural and undetectable.  In each case the six or seven sentences were well-written and included some facts that were used to construct a set of false statements, which superficially appeared reasonable; however, only a modicum of knowledge would be required to identify the fallacious rationale.  Some of my colleagues are already exploring incorporating the chatbot into students’ coursework by asking students to use it to generate a description of a technical topic and then asking them to critique its output in order to assess their understanding of the topic.  I expect chatbots will improve rapidly but for the moment it is relatively easy to induce them to write nonsense.

Bibliography

Li Y, Su C, Zhu J. Comprehensive review of wire arc additive manufacturing: Hardware system, physical process, monitoring, property characterization, application and future prospects. Results in Engineering,100330, 2021.

Image: www.authoritydental.org CC BY 2.0 downloaded from https://www.flickr.com/photos/dental-photos/50730990757

Limited bandwidth

1 Reply

Photograph of hills with walking boots in foregroundMany people take a week’s holiday at this time in the UK because Monday was the Spring Bank Holiday. We went walking in the Clwydian hills which we can see from our house to the south-west across the rivers Mersey and Dee. However, despite the walking on the wild side [see ‘Take a walk on the wild side‘ on August 26th, 2015], I did not feel particularly creative when I sat down to write this week’s blog post. Together with most of my academic colleagues, I am in the midst of reviewing student dissertations and marking end of year assessments. I have written in the past about the process of marking examinations and the tens of thousands of decisions involved in marking a large pile of scripts [see ‘Depressed by exams‘ on January 31st, 2018]. However, the constraints imposed by the pandemic have changed this process for students and examiners because the whole exercise is conducted on-line. I have set an open-book examination in thermodynamics which the students completed online in a specified time period and submitted electronically. Their scripts were checked automatically for plagiarism during the submission process and now I have to mark about 250 scripts online. At the moment, marking online is a slower process than for hardcopy scripts but perhaps that’s a lack of skill and experience on my part. However, it seems to have same impact on my creativity by using up my mental bandwidth and impeding my ability to write an interesting blog post [see ‘Depressed by exams‘ on January 31st, 2018]!