InteractML : Interactive Machine Learning System

InteractML brings machine learning visual scripting to Unreal, empowering creators to develop novel gameplay mechanics, visual experiences, and control schemes without writing code.

  • 지원 플랫폼
  • 지원 엔진 버전
    4.25 - 4.27, 5.0 - 5.3
  • 다운로드 유형
    엔진 플러그인
    이 제품은 코드 플러그인과 함께 미리 빌드한 바이너리와 언리얼 엔진에 통합되는 모든 소스 코드를 포함하고 있으며 원하시는 엔진 버전에 설치하여 프로젝트에 따라 활성화할 수 있습니다.

Create machine learning systems using Blueprints. Choose from three machine learning algorithms; Classification, Regression, and Dynamic Timewarp. Build a training set by recording your input parameters, train the model with the accumulated examples, and then use the outputs of the running model to drive any in-engine systems or effects you like.

Teach the machine to recognize your movements and controls, and use it to drive your interactive experiences. InteractML was funded by an Epic Megagrant and is entirely open source.

Potential applications include:

  • Custom control schemes
  • Gesture recognition
  • Fuzzy control
  • Accessibility tools


Features:

  • Use machine learning techniques to drive your interactive experiences.
  • Choose from three algorithms: Classification, Regression, and Dynamic timewarp.
  • Build machine learning systems using Unreal Blueprints.
  • Use supervised learning to train the algorithms based on your chosen inputs.
  • Run the trained models to drive the visuals and systems in your world.
  • Manage model and training data with custom Asset types and UI.
  • Models can be trained and run asynchronously for the smooth operation of your application.
  • Model output can be a simple value or a set of configurable structured values.
  • Comprehensive demo project available showing off all algorithms and configurations.
  • Detailed documentation is available online.
  • Helper utility nodes, functions, and blueprints (via demo project).


Demo video of it in action

https://youtu.be/0akTC4pHuh8


We have a discord here: https://discord.gg/Hwyvw2z3qF


기술적 세부사항

Details:

  • Custom Blueprint machine learning nodes
  • Machine learning systems built around the RapidLib library
  • Editor or runtime based training and operation
  • Operations can run in the background.
  • Backing data is stored as JSON and can be external to the project.
  • The open-source project, all code and project files available on Github.
  • Technical implementation details are available.


Code Modules:

  • InteractML (Runtime) - runtime ML engine.
  • InteractMLScripting (UncookedOnly) - custom blueprint node types.
  • InteractMLEditor (Editor) - editing tools and asset UI.


Number of Blueprints: 0 (code only), 4 main custom node types, several support nodes, and functions.

Number of C++ Classes (public): 16 (Runtime), 8 (Scripting), 5 (Editor)

Network Replicated: N/A

Supported Development Platforms: Win64

Supported Target Build Platforms: Win64

Documentation: InteractML Wiki

Example Project: InteractML on Github