MiVRy 3D Gesture Recognition

MARUI-PlugIn - 代码插件 - 2021/09/05

3D Gesture Recognition, can identify hand and head motions

  • 支持的平台
  • 支持的引擎版本
    4.26 - 4.27, 5.0 - 5.3
  • 下载类型
    引擎插件
    此产品包含一款代码插件,含有预编译的二进制文件以及与虚幻引擎集成的所有源代码,能够安装到您选择的引擎版本中,并根据每个项目的需求启动。

MiVRy is an advanced artificial intelligence that can be trained to identify hand gestures in VR and other apps.

Record your own gestures or let your player invent new gestures at run-time. The AI learns to distinguish the gestures fast and reliably and will notify you of the identified gesture and wherein the level it was performed (including location, direction, and scale).

Possible use cases: https://www.youtube.com/watch?v=N-84gPjY0Eo

Homepage: https://www.marui-plugin.com/mivry/

技术细节

Features:

  • Allows you to invent your own gestures - just provide a few samples to the AI to learn
  • Real 3-D gestures (eg. 3-D hand motions)
  • Unlimited number of custom gestures
  • Supports one-handed gestures, two-handed gesture combinations, and combinations of gestures from multiple input devices (eg. head or Vive tracker) 
  • Can learn new gestures at run-time based on player input
  • High recognition reliability (usually >99%)
  • 100% Blueprint support, no coding needed (but possible if preferred)

Code Modules:

  •  MiVRy (Runtime and Editor)

Number of Blueprints: 0

Number of C++ Classes: 7

Network Replicated: No

Supported Development Platforms: Windows, Linux, Android, MacOS, UWP (Hololens)

Supported Target Build Platforms: Windows (32bit & 64bit), Android (incl. Oculus Quest), Hololens, Linux, MacOS

Documentation: https://www.marui-plugin.com/documentation-mivry-unreal/

Example Project: https://www.marui-plugin.com/download/mivry/MiVRy_UE4.27_Sample.zip