Using Robots to Collect Data for Machine Vision Tasks

Visa enkel post
dc.contributor.authorEl-Nahass, Karim
dc.contributor.authorUrbanos, Gonzalo
dc.contributor.departmentChalmers tekniska högskola / Institutionen för industri- och materialvetenskapsv
dc.contributor.departmentChalmers University of Technology / Department of Industrial and Materials Scienceen
dc.contributor.examinerJohansson, Björn
dc.contributor.supervisorWang, Hao
dc.date.accessioned2024-10-09T11:32:38Z
dc.date.available2024-10-09T11:32:38Z
dc.date.issued
dc.date.submitted
dc.description.abstractThe current final assembly process of automotive wire harnesses into vehicles predominantly relies on manual labor and skill. This reliance leads to safety and ergonomic issues when lifting heavy wire harnesses and applying high-pressure manipulations to components for 8 hours a day. This thesis combines collaborative robotics and artificial intelligence to collect connector data for machine vision tasks in the automotive industry, addressing the problem of insufficient data. The research investigates an approach using a robotic setup for automated data collection. The framework includes data acquisition utilizing a UR5 robot and an Intel RealSense D435 camera; robot-camera communication using a Raspberry Pi 4b as a bridge; and an automatic labeling tool. The collected dataset comprises 8 different connectors commonly used in automotive wire harnesses. The resultant datasets (first the manually annotated dataset and second the automatic annotated dataset) are evaluated using YOLOv8, a deep-learning based object detection model. The evaluation results present a higher accuracy (mAP50 = 93.5%) for the manually annotated dataset compared to the automatic labeling approach (mAP50 = 74.4%) which suggests that there is still room for improvement on the automatic labeling tool used. This accuracy difference is concluded to be due to the inability to control lighting conditions in the workspace in the lab.
dc.identifier.coursecodeIMSX30
dc.identifier.urihttp://hdl.handle.net/20.500.12380/308890
dc.language.isoeng
dc.setspec.uppsokTechnology
dc.subjectaccuracy
dc.subjectautomatic annotation
dc.subjectconnector
dc.subjectdataset
dc.subjectergonomics
dc.subjectobject detection
dc.subjectrobotic system
dc.subjectwire harness
dc.titleUsing Robots to Collect Data for Machine Vision Tasks
dc.type.degreeExamensarbete för masterexamensv
dc.type.degreeMaster's Thesisen
dc.type.uppsokH
local.programmeSystems, control and mechatronics (MPSYS), MSc
local.programmeComplex adaptive systems (MPCAS), MSc
Ladda ner
Original bundle
Visar 1 - 1 av 1
Bild (thumbnail)
Namn:
Using Robots to Collect Data for Machine Vision Tasks.pdf.pdf
Storlek:
34.79 MB
Format:
Adobe Portable Document Format
Beskrivning:
Ladda ner
License bundle
Visar 1 - 1 av 1
Bild (thumbnail)
Namn:
license.txt
Storlek:
2.35 KB
Format:
Item-specific license agreed upon to submission
Beskrivning:
Ladda ner
Samling
Examensarbeten för masterexamen