AI-Wolf in Sheep’s Clothing Distinguishing between Swedish humans and AI wannabes

Visa enkel post
dc.contributor.authorLandberg, Adam
dc.contributor.departmentChalmers tekniska högskola / Institutionen för data och informationstekniksv
dc.contributor.departmentChalmers University of Technology / Department of Computer Science and Engineeringen
dc.contributor.examinerAxelson-Frisk, Marina
dc.contributor.supervisorWozniak, Pawel
dc.date.accessioned2024-07-02T09:44:09Z
dc.date.available2024-07-02T09:44:09Z
dc.date.issued2024
dc.date.submitted
dc.description.abstractThis report is investigating whether it is possible for Artificial Intelligence (AI) chatbots and AI detectors to detect texts created by AI in Swedish and in English. Mainly focusing on texts created by the AI chatbot ChatGPT 4, the performances of the AI detectors Smodin and Copyleaks are investigated. The research is motivated by a scarce previous research about AI in Swedish and an articulated need from Swedish schools to understand if it is possible to detect AI created content in homework and essays. By prompting the AI detectors with 400 articles written by humans in Swedish, 400 articles written by humans in English, 400 texts created by AI in Swedish, and 400 texts created by AI in English the AI detectors were thorogly examined. What could be proven was that Smodin showed an accuracy between 73.61% - 73.89% on a 99% confidence level on Swedish content, and an accuracy between 94.68% - 94.82% on a 99% confidence level on English content. On the other hand, Copyleaks showed an accuracy between 94.80% - 94.95% on a 99% confidence level on Swedish content, and an accuracy between 100% on a 99% confidence level on English content. This indicates that, whilst always sucessfully detecting texts written by humans, it is possible to detect Swedish text created by AI nine out of ten times.
dc.identifier.urihttp://hdl.handle.net/20.500.12380/308198
dc.setspec.uppsokTechnology
dc.subjectArtificial Intelligence
dc.subjectAI
dc.subjectAI chatbots
dc.subjectAI detectors
dc.titleAI-Wolf in Sheep’s Clothing Distinguishing between Swedish humans and AI wannabes
dc.type.degreeExamensarbete för masterexamensv
dc.type.degreeMaster's Thesisen
dc.type.uppsokH
local.programmeData science and AI (MPDSC), MSc
Ladda ner
Original bundle
Visar 1 - 1 av 1
Bild (thumbnail)
Namn:
CSE 24-58 AL.pdf
Storlek:
5.13 MB
Format:
Adobe Portable Document Format
Beskrivning:
Ladda ner
License bundle
Visar 1 - 1 av 1
Bild (thumbnail)
Namn:
license.txt
Storlek:
2.35 KB
Format:
Item-specific license agreed upon to submission
Beskrivning:
Ladda ner
Samling
Examensarbeten för masterexamen