Robotická paže ovládaná lidskou rukou pomocí zpracování obrazu
| dc.contributor.advisor | Holada Miroslav, Ing. Ph.D. :54740 | cs |
| dc.contributor.author | Rode, Anoop Mohan | cs |
| dc.contributor.referee | Cvejn Jan, doc. Ing. Ph.D. :65498 | cs |
| dc.date.accessioned | 2024-12-16T06:11:31Z | |
| dc.date.available | 2024-12-16T06:11:31Z | |
| dc.date.committed | 14.5.2024 | cs |
| dc.date.defense | 11.6.2024 | cs |
| dc.date.issued | 2024-06-11 | |
| dc.date.submitted | 20.10.2023 | cs |
| dc.description.abstract | This research presents an interdisciplinary methodology for the design, implementation and development of the robotic gesture control system integrating with computer vision, mechanical principles, and electronics circuitry. The interdisciplinary approach of the project involves the collaboration of mechanical, computer and electrical electronics domains. The circuit design architecture has generic components such as ESP32 WROOM32 Module and MG996R Servo Motor. This system architecture has been developed to obtain the precise angular control of servo motors with the help of PWM signals generated by the ESP32 module. The interfacing and configuration step of the ESP32 WROOM Module involves firmware development using Arduino IDE and leading communication with peripheral devices via UART protocol. Serial communication has been established between C++ running on ESP32 and Python script on Laptop. Computer Vision Algorithm allows us to detect and track the objects desired objects in footage. The Libraries used for gesture recognition by using MediaPipe & OpenCV Libraries. Over the pre-processed footage with the help of libraries, I have implemented a custom post-processing landmark detection technique for angular calculation via vector approach. The mechanical structure design and fabrication involves Modelling and 3D printing of the parts. After 3D printing involves the assembly of parts and calibrating with servo angular motion for operating precisely. The demonstrated methodology connects engineering principles with robotic control strategy to obtain a robust control algorithm using computer vision to operate finger movement precisely. This project can be the promising for the applications such as prosthetics Hands and HMI applications on unmanned fields. | cs |
| dc.description.abstract | This research presents an interdisciplinary methodology for the design, implementation and development of the robotic gesture control system integrating with computer vision, mechanical principles, and electronics circuitry. The interdisciplinary approach of the project involves the collaboration of mechanical, computer and electrical electronics domains. The circuit design architecture has generic components such as ESP32 WROOM32 Module and MG996R Servo Motor. This system architecture has been developed to obtain the precise angular control of servo motors with the help of PWM signals generated by the ESP32 module. The interfacing and configuration step of the ESP32 WROOM Module involves firmware development using Arduino IDE and leading communication with peripheral devices via UART protocol. Serial communication has been established between C++ running on ESP32 and Python script on Laptop. Computer Vision Algorithm allows us to detect and track the objects desired objects in footage. The Libraries used for gesture recognition by using MediaPipe & OpenCV Libraries. Over the pre-processed footage with the help of libraries, I have implemented a custom post-processing landmark detection technique for angular calculation via vector approach. The mechanical structure design and fabrication involves Modelling and 3D printing of the parts. After 3D printing involves the assembly of parts and calibrating with servo angular motion for operating precisely. The demonstrated methodology connects engineering principles with robotic control strategy to obtain a robust control algorithm using computer vision to operate finger movement precisely. This project can be the promising for the applications such as prosthetics Hands and HMI applications on unmanned fields. | en |
| dc.format | 58 pages. (56,570 characters) | cs |
| dc.identifier.uri | https://dspace.tul.cz/handle/15240/175853 | |
| dc.language.iso | AN | cs |
| dc.subject | Computer Vision | cs |
| dc.subject | ESP32 Wroom | cs |
| dc.subject | 3D Printing | cs |
| dc.subject | Hand Gesture Recognition | cs |
| dc.subject | Bionic Hand Motion and Motion Control | cs |
| dc.subject | HMI | cs |
| dc.title | Robotická paže ovládaná lidskou rukou pomocí zpracování obrazu | cs |
| dc.title | Human Hand-Gesture Controlled Robotic Arm by Image Processing | en |
| dc.type | diplomová práce | cs |
| local.degree.abbreviation | Navazující | cs |
| local.identifier.author | M22000215 | cs |
| local.identifier.stag | 46544 | cs |
Files
Original bundle
1 - 4 of 4
Loading...
- Name:
- Thesis GCRH_Final.pdf
- Size:
- 4.04 MB
- Format:
- Adobe Portable Document Format
- Description:
- VŠKP ( 14.5.2024 19:44 )
Loading...
- Name:
- DP_Rode Anoop_oponent.pdf
- Size:
- 914.71 KB
- Format:
- Adobe Portable Document Format
- Description:
- Posudek oponenta VŠKP ( 31.5.2024 9:33 )
Loading...
- Name:
- DP_Anoop Rode_vedoucí.pdf
- Size:
- 763.51 KB
- Format:
- Adobe Portable Document Format
- Description:
- Posudek vedoucího VŠKP ( 4.6.2024 9:03 )
Loading...
- Name:
- ProtokolSPrubehemObhajobySTAG.pdf
- Size:
- 39.92 KB
- Format:
- Adobe Portable Document Format
- Description:
- Průběh obhajoby VŠKP ( 12.6.2024 8:11 )