Zihui-Gavin

This component turns hand movement into touchable boundaries: handrails, low rails, posts, grips, and light nodes.

Wrist path 15/16 → main handrail curve

Wrist height → corrected handrail height raw wrist height is remapped to about 850-950mm

Elbow-to-wrist direction 13/14 → rail offset + turning points

Pinky 17/18 → outer boundary line

Hand spread → rail thickness

Thumb 21/22 → grip points / connector nodes

Wrist pauses → posts

Strong pauses → light nodes on top of posts

Simplification Rule

Raw hand tracking is not used directly.

Small jitter is removed.

Only pauses, turns, spread points, and key inflection points are kept.

This component creates one main wall first. All other parts grow from that wall surface.

Shoulder width → passage width + wall scale

Shoulder rotation → wall bending / turning

Shoulder height difference → sloped wall top

Elbow offset 13/14 → surface relief blocks

Strong body turns → vertical ribs / creases

Shoulder tilt + elbow fold → top folded plates

Music Break → cracks, gaps, displaced wall pieces

How The Wall Details Appear

Large protruding blocks → elbow bends push the wall surface outward

Thin vertical strips → strongest shoulder-turn moments

Top horizontal plates → wall top folds where shoulder tilt and elbow motion meet

Cracks / splits → low-energy music breaks

Ankle – The core data source. The vertical height (Y-value) of the ankle joint is used to detect the moment of foot landing, the horizontal position (XZ) determines the step’s location in space, the movement speed determines the step width, and the movement direction determines the step’s orientation.

Knee – Determines the force of the foot landing. A large knee bend indicates a forceful step, with hard edges used for transitions between steps; a straighter knee indicates a lighter movement, with gentle slopes used for connections between steps.

Hip – Assists in calculating knee flexion. The distance from the hip to the ankle joint is used as the baseline leg length, normalizing the knee flexion ratio.

This component turns looking, pointing, and hand opening into entrances, windows, frames, and view corridors.

Nose 0 + eyes → main viewing direction

Eye center 2/5 → window / frame center

Eye inner + outer points 1 /3 / 4/ 6 → opening proportion

Head turning speed → opening density

fast head turn = smaller, fragmented openingsslow head turn = stable, larger openings

Gaze dwell time → opening sizelonger gaze = larger frame

Distance between wrists 15/16 → doorway width

Index fingers 19/20 → sightline guides / narrow view slots

Opening Rules

Stable gaze → large clear opening

Fast scanning → multiple fragmented apertures

Wide hands → wider entrance

Pointing gesture → directional slit or view corridor

Elements of Architecture

Authors: Rem Koolhaas, AMO, Harvard Graduate School of Design

We used MediaPipe to record 33 joints in each frame of every 2-second video.

We downloaded 544 relevant Gabber videos from TikTok and YouTube.

keyword: Gabber, Rotterdam hardcore, Rotterdam Gabber, Hakken, Rotterdam Hakken,

We extract 2 seconds of video from each video and record their actions to form our dataset library.

Each video is described using gemini embedding.