documentation

Licences and modes

Every motion source, its licence, and which mode it is allowed in.

Why there are modes

The motion she plays at home is cut from datasets released for research and non-commercial use, and from footage that may not be redistributed. None of it is displayed on this site, distributed, or reachable, and models trained on it never leave the machine she runs on. That is what "private forever" means: not a setting, a property of where the data can be. Her body from those models plays live and is never published or distributed, at home (private) and for friends on a call (public); the stream runs only on licence-clean motion, so nothing broadcast is derived from a source that forbids it.

Non-commercial data may play live, off the stream. It is never training input for anything public. A gate can refuse a clip; nothing can un-train a weight, so the line is drawn at the training set, not at the output.

The ledger

All 35 sources in the registry, about 5220.6 hours listed, fewer unique: several overlap (HumanML3D is drawn from AMASS, BEAT v1 and BEAT2 are the same recordings, GENEA 2023 is built from Talking With Hands), with each licence as the source states it and the mode it is allowed in. "(by choice)" marks sources whose licence would allow more; they stay private because everything trained alongside them is.

SourceLicenceFormatSizeModeWhy it is here
Talking With Hands 16.2M (Meta)CC BY-NC 4.0bvh+audio20 hhome and calls, never streamtwo-person conversation with fingers
ZeroEGGS (Ubisoft)CC BY-NC-ND 4.0bvh+audio2 hhome and calls, never stream19 styles, one actor; already partly in the corpus
BEAT2 / EMAGE (MPI)CC BY-NC 4.0smplx+audio60 hhome and calls, never streamthe big one, 20 GB on HF; partly in the corpus already
BEAT v1 (BVH)CC BY-NC 4.0bvh+audio76 hhome and calls, never streamsame recordings as BEAT2 in BVH with facial blendshapes
TalkSHOW / SHOWMPI non-commercial researchsmplx+audio27 hhome and calls, never streamtalk-show hosts fitted from video: real conversational gesture at a desk
Trinity Speech-Gesturecustom non-commercial researchbvh+audio4 hhome and calls, never streamGENEA 2020/2022 base data
GENEA Challenge 2023 data (TWH-based, dyadic)CC BY-NC 4.0bvh+audio+tsv18 hhome and calls, never streamcleaned TWH with transcripts and the interlocutor
PATS (CMU, 2D poses of 25 speakers)CC BY-NC 2.02d-keypoints+audio251 hhome and calls, never streamhuge but 2D; needs lifting before it is any use
TED Expressive (HA2G)not stated (code GPL-3.0)3d-keypoints+audio27 hhome and calls, never streamlifted TED talks; upper body only
Seamless Interaction (Meta)CC BY-NC 4.0video+smplx codes4000 hhome and calls, never stream27 TB of tar shards; seamless_stream.py keeps everything but the video
DnD Group Gesture (Aalto)not statedbvh+audio6 hhome and calls, never streamfive-person tabletop conversation
Motion-X (IDEA)IDEA non-commercial researchsmplx144 hhome and calls, never stream81k sequences incl. in-the-wild video
AMASS (MPI)MPI non-commercial researchsmplx/smplh npz40 hhome and calls, never streamthe mocap library; HumanML3D is its labelled subset
HumanML3DAMASS terms (code MIT)amass subset + text29 hhome and calls, never streamtext labels for AMASS motions (needs AMASS)
LAFAN1 (Ubisoft)CC BY-NC-ND 4.0bvh4.6 hhome and calls, never streamlocomotion, clean, five subjects
Bandai Namco Research MotiondatasetCC BY-NC-ND 4.0bvh3 hhome and calls, never streamstyled everyday motion incl. gestures
100STYLECC BY 4.0bvh4 hhome and calls, never stream (by choice)100 walking styles; idle/character (CC BY 4.0)
CMU Motion Capture (BVH conversion)freebvh9 hhome and calls, never stream (by choice)2,500 clips, the classic (Hahne BVH port)
SFU Motion Captureresearch only, no redistributionbvh2 hhome and calls, never streamclean everyday motion; per-clip .bvh links under nusmocap/
KIT Motion-Languagenot statedbvh/mmm + text11 hhome and calls, never streamtext-described motions
Motorica Dancecustom non-commercialbvh+audio6 hhome and calls, never streamdance; rhythm and weight for the reflex layer
AIST++CC BY 4.0 (annotations)smpl+audio5 hhome and calls, never streamdance; SMPL motions 306 MB + 3D keypoints (terms of use accepted by pax for private use)
Learning2Listen (Ng et al. 2022)not statedDECA face+head coeffs + mel audio72 hhome and calls, never streamLISTENER head and expression aligned to the speaker: her nods while pax talks
ViCo listening-headresearch only, restricted3DMM coeffs + video2 hhome and calls, never streamspeaker and listener 3DMM in conversation
IEMOCAP (USC)USC licence on requestface+head mocap markers + audio + emotion12 hhome and calls, never streamdyadic face and head markers with emotion labels
VOCASET (MPI)MPI non-commercial research4D face scans + audio1 hhome and calls, never streamaudio-driven mouth and jaw, the lipsync reference
MEAD emotional talking facenot statedvideo, 60 actors, 8 emotions40 hhome and calls, never streamexpression under emotion at three intensities
HDTF talking headsCC BY 4.0 (list; videos are YouTube)YouTube video list + script16 hhome and calls, never streamhigh-res talking heads; video via yt-dlp, not automated
CelebV-HQnon-commercial researchYouTube video list + script68 hhome and calls, never stream35k face clips with expression/action labels; video via yt-dlp, not automated
Gaze360 (MIT)non-commercial researchimages + 3D gazen/a (poses)home and calls, never streamonly if we ever train a gaze estimator; not animation data
InterHuman (InterGen)CC BY-NC-SA 4.0smpl7 hhome and calls, never streamtwo-person interaction
Inter-Xnon-commercial researchsmplx13 hhome and calls, never streamtwo-person with hands
InterAct (2025)not statedsmplx241 hhome and calls, never streamdaily two-person activities, large
Goliath-SC self-contact poses (ICCV 2025)not stated (Goliath is CC BY-NC 4.0)smplx posesn/a (poses)home and calls, never stream383K self-contact poses: exactly the fence's problem
TUCH / MTP self-contact (MPI)MPI non-commercial researchsmplx posesn/a (poses)home and calls, never streammimic-the-pose self-contact data
Generated from the dataset registry at build time. A source that is not in this table is not in her.