Multiple subjects exercising

  • TRAIN set: 8 subjects (all trainees)
  • TEST set: 3 subjects (1 trainer, 2 trainees)

In each recording, the subject is motion tracked with a marker-based motion capture system (Vicon).

Multiple cameras

  • 4 different views
  • 900x900 resolution
  • 50 fps
  • Camera parameters:
    • extrinsics
    • intrinsics for 2 different camera models (one assuming image distortion, one ignoring it)
  • The TEST set consists of only one random camera viewpoint per sequence, to avoid simplifying the 3D Reconstruction challenge through multi-view triangulation/optimization.

47 Exercises

  • Warmups
  • Barbell Exercises
  • Dumbbell Exercises
  • Equipment-Free Exercises

GHUM and SMPLX meshes

  • Ground-truth, well-alligned mesh - obtained by fitting the GHUM model to accurate 3d markers, multi-view image evidence and body scans
  • We retarget the GHUM meshes to the SMPLX topology and provide pose and shape parameters for both
  • 50 fps

3D skeletons

  • Ground-truth 3d skeletons with 25 joints (including the 17 Human3.6m joints)
  • 50 fps

Repetition Segmentations

Each of the 611 recordings contain:

  • the time intervals of each of the >5 repetitions
  • name of the exercise type

Due to the 4 viewpoints, this amounts to 2444 pairs of videos and repetition segmentations.