跳转到主要内容

灵巧机械手

概览

描述

该款机械手控制系统专为实现精确且灵巧的操作而设计,采用六组气动气缸控制五根手指,并配备多组辅助执行器以提高灵活性和铰接性。 系统配有直观的用户友好型图形界面(GUI),可提供实时反馈,即使是初学者也能轻松上手。 该系统配备多路通信接口并支持无缝传感器集成,在假肢矫形、工业自动化和机器人研究领域的应用非常广泛。 固件与 Micro-ROS 兼容,可在基于 ROS 2 的机器人生态系统中实现高效通信。

AI 视觉增强型灵巧机械手在基础系统上进一步集成瑞萨视觉 AI MPU,可实现基于手势的智能控制。 该扩展系统在 Ubuntu 24.04 和 ROS 2 Jazzy 上运行,利用摄像头输入识别手势并相应控制机械手。 在 DRP-AI 加速器的支持下,AI 模型能检测并发布关键点(如特征点和边界框),并以 Foxglove 图像标注格式输出,以实现直观的可视化。 该系统支持 20 多种手势指令,包括抓、捏、竖大拇指、召唤、比“耶”和“OK”等,为人机交互提供了自然直观的界面。

系统优势:

  • 支持包括 CAN FD 在内的多种通信协议,确保可靠、高速的数据传输。
  • 集成 micro-ROS,将 ROS 2 的先进功能提升到 MCU 级别。
  • 6 缸控制机制可确保每个手指都能精确、独立地移动,使机械手在各种场景中都能完成灵巧的手部动作。
  • 采用模块化设计,具有出色的传感器集成能力,可轻松扩展以支持自适应抓握、触觉传感和环境交互等高级功能。
  • 在 DRP-AI 加速器的支持下,系统可实现实时目标检测、图像分割和姿态估计。
  • 支持 YOLOX Pascal VOC、YOLOX Hand 等多种目标检测模型,并以标准 ROS 2 消息格式发布边界框模型。
  • 与 MediaPipe、HRNetV2 和 RTMPose 等姿态估计模型兼容。

产品对比

应用

方框图

选择相应模块,寻找适合您设计的产品

远程测试该板卡

该板卡已上线云上实验室(Lab on the Cloud),使用我们的 PC 图形界面,无需实体板卡,便可在虚拟实验室中立即开始配置和测试设计。

灵巧机械手系统

4:3 ratioSheet.1Sheet.2Sheet.3Sheet.4WS077-1WS077-1WS077-1Sheet.6ParallelogramParallelogram.14Parallelogram.15Parallelogram.16Trapezoid.18TrapezoidTrapezoid.20Trapezoid.21Trapezoid.22Trapezoid.23Trapezoid.24RectangleRectangle.26Semi CircleSheet.21Semi Circle.29Sheet.23Semi Circle.31Sheet.25Semi Circle.33Sheet.27Semi Circle.35Sheet.29Sheet.30ParallelogramParallelogram.41Parallelogram.42Sheet.34ParallelogramParallelogram.41Parallelogram.42Sheet.38ParallelogramParallelogram.40Parallelogram.42Sheet.42ParallelogramParallelogram.41Parallelogram.42Sheet.46ParallelogramParallelogram.41Parallelogram.42Sheet.50ParallelogramParallelogram.41Parallelogram.42RectangleSheet.98Status LEDs.50Status LEDs.75Status LEDs.76Status LEDs.77Status LEDs.83Status LEDs.84Status LEDs.85Status LEDs.86Sheet.107Status LEDs.50Status LEDs.75Status LEDs.76Status LEDs.77Status LEDs.83Status LEDs.84Status LEDs.85Status LEDs.86Connector dotted line.1133Connector dotted line.120Connector dotted line.121Connector dotted line.122Connector dotted line.123Connector dotted line.124Bi-directional.125Bi-directional.126Bi-directionalBi-directional.128Bi-directional.129Bi-directional.131Connector Arrow.135Connector Arrow3.3V Output3.3V Output3.3V OutputConnector Arrow.147Connector Arrow.148TxTxTxRxRxRxLaptopRS-485RS-485RS-485Bi-directional.170Vertical Wire Bundle.171222Sheet.173Pressure SensorPressure SensorPressure SensorBi-directional.175Vertical Wire Bundle.176222Sheet.178Extend DI/DOExtend DI/DOExtend DI/DOBi-directional.186Graphical User InterfaceGraphical User InterfaceGraphical User InterfaceCommunication InterfaceCommunication InterfaceCommunication InterfaceLDOLDOLDOConnector dotted double arrowDC Supply 12VLabel Text 10pt.262Sheet.194Sheet.195Sheet.196Sheet.197Sheet.198Sheet.199Sheet.200Sheet.201Sheet.202Sheet.203AC/DC AdapterAC/DC AdapterAC/DC AdapterConnected signals arrow12V/24V12V/24V12V/24VUSB PlugSheet.211Sheet.212Sheet.213Sheet.214Sheet.215Bi-directional.216Connector dotted double arrow.219Sheet.220MCUMCUMCUUARTUARTUARTVDDVDDVDDUARTUARTUARTI2CI2CI2CUSBUSBUSBCAN FDCAN FDCAN FD
Exiting Interactive Block Diagram

配备 AI 视觉功能的灵巧机械手系统

WebConnector Arrow.192Connector Arrow.179Connector Arrow.181Connector Arrow.176Connector Arrow.175VDD 1.1VVDD 1.1VVDD 1.1VConnector Arrow.171Sheet.1Sheet.2Sheet.3Sheet.412V/24V12V/24V12V/24V3.5V3.5V3.5VConnected signals arrowConnector Arrow.220.8V0.8V0.8VBi-directionalSD CardSheet.29Sheet.30Sheet.31Sheet.32Sheet.33Sheet.34Sheet.35Sheet.36Sheet.37Sheet.38Bi-directional.39Connector Arrow.42Bi-directional.45Ethernet PHY x 2Ethernet PHY x2Ethernet PHY x2USB 2.0 x 2USB 2.0 x2USB 2.0 x2RS-485RS-485RS-485Bi-directional.57USB 3.2USB 3.2USB 3.2Camera (Up to 4)Camera (Up to 4)Camera(Up to 4)Bi-directional.65CameraSheet.68Sheet.69Connector Arrow.71MIPI CSI is optionalMIPI CSI is optionalMIPI CSI is optionalAcquiring Image DataAcquiring Image DataAcquiringImage DataWS077-2WS077-2WS077-2Vertical Wire Bundle.80222Sheet.82Vertical Wire Bundle.83222Sheet.85Vertical Wire Bundle.86222Sheet.88Sheet.113ParallelogramParallelogram.14Parallelogram.15Parallelogram.16Trapezoid.18TrapezoidTrapezoid.20Trapezoid.21Trapezoid.22Trapezoid.23Trapezoid.24RectangleRectangle.26Semi CircleSheet.128Semi Circle.29Sheet.130Semi Circle.31Sheet.132Semi Circle.33Sheet.134Semi Circle.35Sheet.136Bi-directional.138Dexterous HandDexterous HandDexterous HandClock GeneratorClock GeneratorClock GeneratorPCIe 2-lanePCIe 2-lanePCIe2-laneBuck RegulatorBuck RegulatorBuck RegulatorDDRDDRDDRConnector ArrowConnector Arrow.156DC Supply 12VLabel Text 10pt.262Sheet.159Sheet.160Sheet.161Sheet.162Sheet.163Sheet.164Sheet.165Sheet.166Sheet.167Sheet.168AC/DC AdapterAC/DC AdapterAC/DCAdapterConnector Arrow.172Connected signals line3.3V3.3V3.3VD1.8VD1.8VD1.8VVDDQ 1.2VVDDQ 1.2VVDDQ 1.2V D1.8VD1.8VD1.8VBi-directional.183Bi-directional.184Bi-directional.185Connector dotted arrowLCD MonitorSheet.190Sheet.191Connector dotted double arrowBuck RegulatorBuck RegulatorBuck RegulatorSheet.196MPUMPUMPULPDDR4LPDDR4LPDDR4SDIOSDIOSDIOClockClockClockPCIe Gen 3PCIe Gen 3PCIe Gen 3Ethernet Control x 2Ethernet Control x2Ethernet Control x2USB 2.0 Gen 2 x 2USB 2.0 Gen 2 x2USB 2.0Gen 2 x2UARTUARTUARTUSB 3.2 Gen 2 x 2USB 3.2 Gen 2 x2USB 3.2Gen 2 x2MIPI CSI-2 x 4MIPI CSI-2 x4MIPICSI-2 x4VDDVDDVDDVDD/CVDDVDD/CVDDVDD/CVDDDDR_VDDQDDR_VDDQDDR_VDDQPVDD/USBPVDD/USBPVDD/USBVDD1G_0p8VDD1G_0p8VDD1G_0p8MIPI DSIMIPI DSIMIPI DSICAN FDCAN FDCAN FDSheet.197PMICPMICPMICLDO2LDO2LDO2BUCK1BUCK1BUCK1BUCK3BUCK3BUCK3BUCK2BUCK2BUCK2BUCK4BUCK4BUCK4BUCK5BUCK5BUCK5
Exiting Interactive Block Diagram

视频和培训

支持

支持社区

支持社区

在线询问瑞萨电子工程社群的技术人员,快速获得技术支持。
浏览文章

知识库

浏览我们的知识库,获取文章、常见问题解答及其他实用资源。
提交工单

提交工单

需要咨询技术性问题或提供非公开信息吗?