Skip to content

How to retarget only arms and hands (upper-body only)? #102

@TannerGilbert

Description

@TannerGilbert

Context

I'm using HOLOSOMA to retarget sign-language motions from monocular video (DGS dataset → SMPLest-X → SMPL-X body+hand joints → HOLOSOMA) onto a Unitree G1 humanoid with BrainCo dexterous hands. The signers are seated; lower body is not visible and irrelevant to the task. Hand pose is driven separately by dex-retargeting (MANO → BrainCo fingers), and those 22 finger qpos indices are frozen via q_a_freeze_indices so HOLOSOMA only optimises the arms/wrists while the fingers carry externally retargeted values.

What I'm trying to achieve

Arms + wrists + fingers should track the source; legs + waist + base should stay at a fixed upright rest pose (they contribute nothing to signing). Ideally no cost terms should apply to the lower body at all — I want the Interaction Mesh Laplacian to drive the arms cleanly without the solver juggling leg-related constraints or Laplacian residuals from frozen lower body vertices.

Questions

Is there a recommended way to run HOLOSOMA in "upper-body only" mode so that the lower body is frozen at a canonical rest pose, and the cost on lower-body vertices doesn't influence the arms?

Thanks for any guidance!

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions