Robotická paže ovládaná lidskou rukou pomocí zpracování obrazu

dc.contributor.advisorHolada Miroslav, Ing. Ph.D. :54740cs
dc.contributor.authorRode, Anoop Mohancs
dc.contributor.refereeCvejn Jan, doc. Ing. Ph.D. :65498cs
dc.date.accessioned2024-12-16T06:11:31Z
dc.date.available2024-12-16T06:11:31Z
dc.date.committed14.5.2024cs
dc.date.defense11.6.2024cs
dc.date.issued2024-06-11
dc.date.submitted20.10.2023cs
dc.description.abstractThis research presents an interdisciplinary methodology for the design, implementation and development of the robotic gesture control system integrating with computer vision, mechanical principles, and electronics circuitry. The interdisciplinary approach of the project involves the collaboration of mechanical, computer and electrical electronics domains. The circuit design architecture has generic components such as ESP32 WROOM32 Module and MG996R Servo Motor. This system architecture has been developed to obtain the precise angular control of servo motors with the help of PWM signals generated by the ESP32 module. The interfacing and configuration step of the ESP32 WROOM Module involves firmware development using Arduino IDE and leading communication with peripheral devices via UART protocol. Serial communication has been established between C++ running on ESP32 and Python script on Laptop. Computer Vision Algorithm allows us to detect and track the objects desired objects in footage. The Libraries used for gesture recognition by using MediaPipe & OpenCV Libraries. Over the pre-processed footage with the help of libraries, I have implemented a custom post-processing landmark detection technique for angular calculation via vector approach. The mechanical structure design and fabrication involves Modelling and 3D printing of the parts. After 3D printing involves the assembly of parts and calibrating with servo angular motion for operating precisely. The demonstrated methodology connects engineering principles with robotic control strategy to obtain a robust control algorithm using computer vision to operate finger movement precisely. This project can be the promising for the applications such as prosthetics Hands and HMI applications on unmanned fields.cs
dc.description.abstractThis research presents an interdisciplinary methodology for the design, implementation and development of the robotic gesture control system integrating with computer vision, mechanical principles, and electronics circuitry. The interdisciplinary approach of the project involves the collaboration of mechanical, computer and electrical electronics domains. The circuit design architecture has generic components such as ESP32 WROOM32 Module and MG996R Servo Motor. This system architecture has been developed to obtain the precise angular control of servo motors with the help of PWM signals generated by the ESP32 module. The interfacing and configuration step of the ESP32 WROOM Module involves firmware development using Arduino IDE and leading communication with peripheral devices via UART protocol. Serial communication has been established between C++ running on ESP32 and Python script on Laptop. Computer Vision Algorithm allows us to detect and track the objects desired objects in footage. The Libraries used for gesture recognition by using MediaPipe & OpenCV Libraries. Over the pre-processed footage with the help of libraries, I have implemented a custom post-processing landmark detection technique for angular calculation via vector approach. The mechanical structure design and fabrication involves Modelling and 3D printing of the parts. After 3D printing involves the assembly of parts and calibrating with servo angular motion for operating precisely. The demonstrated methodology connects engineering principles with robotic control strategy to obtain a robust control algorithm using computer vision to operate finger movement precisely. This project can be the promising for the applications such as prosthetics Hands and HMI applications on unmanned fields.en
dc.format58 pages. (56,570 characters)cs
dc.identifier.urihttps://dspace.tul.cz/handle/15240/175853
dc.language.isoANcs
dc.subjectComputer Visioncs
dc.subjectESP32 Wroomcs
dc.subject3D Printingcs
dc.subjectHand Gesture Recognitioncs
dc.subjectBionic Hand Motion and Motion Controlcs
dc.subjectHMIcs
dc.titleRobotická paže ovládaná lidskou rukou pomocí zpracování obrazucs
dc.titleHuman Hand-Gesture Controlled Robotic Arm by Image Processingen
dc.typediplomová prácecs
local.degree.abbreviationNavazujícícs
local.identifier.authorM22000215cs
local.identifier.stag46544cs
Files
Original bundle
Now showing 1 - 4 of 4
Loading...
Thumbnail Image
Name:
Thesis GCRH_Final.pdf
Size:
4.04 MB
Format:
Adobe Portable Document Format
Description:
VŠKP ( 14.5.2024 19:44 )
Loading...
Thumbnail Image
Name:
DP_Rode Anoop_oponent.pdf
Size:
914.71 KB
Format:
Adobe Portable Document Format
Description:
Posudek oponenta VŠKP ( 31.5.2024 9:33 )
Loading...
Thumbnail Image
Name:
DP_Anoop Rode_vedoucí.pdf
Size:
763.51 KB
Format:
Adobe Portable Document Format
Description:
Posudek vedoucího VŠKP ( 4.6.2024 9:03 )
Loading...
Thumbnail Image
Name:
ProtokolSPrubehemObhajobySTAG.pdf
Size:
39.92 KB
Format:
Adobe Portable Document Format
Description:
Průběh obhajoby VŠKP ( 12.6.2024 8:11 )