EasySynth

Ydrive - Code Plugins - Jan 24, 2022
4
5 out of 5 stars(4 ratings)
  • 100%
  • 0%
  • 0%
  • 0%
  • 0%
See 4 written reviews
4 reviews written
9 of 9 questions answered

Easy to use plugin that enables generation of ground truth depth, normal, optical flow and semantic images.

Sign in to Download
  • Supported Platforms
  • Supported Engine Versions
    4.27, 5.0 - 5.3
  • Download Type
    Engine Plugin
    This product contains a code plugin, complete with pre-built binaries and all its source code that integrates with Unreal Engine, which can be installed to an engine version of your choice then enabled on a per-project basis.

EasySynth is an Unreal Engine plugin for the easy creation of image datasets from a moving multi-camera rig, requiring no C++ or Blueprint knowledge. It leverages native Unreal Engine components to create compelling machine learning datasets, without relying on 3rd party tools.


The plugin provides a simple interface for semantic labeling of actors present in the scene and works by automatically starting the rendering of a user-defined level sequence, with different camera post-process settings. Outputs that can be created are the following:

  • CSV file with camera poses, including position, rotation, and calibration parameters
  • JSON file with camera rig description
  • Color images rendered by default
  • Depth grayscale images
  • Pixel normal images
  • Optical flow images between frames
  • Images with actor' semantic labels


Check out this workflow timelapse for a detailed usage walk-though. Also, check out the latest code on the GitHub repo as well as the installation and the in-depth usage description.

Technical Details

Features:

  • Enables definition of semantic classes through the UI widget, and their permanent saving
  • Enables semantic labeling of each actor in the scene, and labels' permanent saving
  • Enables toggling between original and semantic scene color
  • Enables rendering and exporting of the image types described above, by utilizing level sequences and the Movie render queue plugin
  • Enables exporting camera poses and calibration as a CSV file
  • Enables recording from multiple cameras bundled inside a camera rig

Code Modules:

  •  Editor-only EasySynth module containing all needed content

Number of Blueprints: 6

Number of C++ Classes: 18

Network Replicated: No

Supported Development Platforms: Linux, Windows

Supported Target Build Platforms: Intended for editor-only usage

Documentation: Consult the GitHub repo

Example Project: EasySynthDemo

Tags

REALISTICMODULARBLUEPRINTS

Related Content