Recent Publications
Our research publications in embodied artificial general intelligence and human-robot interaction.
ContactField: Implicit Field Representation for Multi-Person Interaction Geometry
We introduce a novel implicit field representation tailored for multi-person interaction geometry in 3D spaces, capable of simultaneously reconstructing occupancy, instance identification (ID) tags, and contact fields. Our approach utilizes an implicit representation for interaction geometry contextualized by a multi-view local-global feature module, enabling precise modeling of close physical interactions through dense point retrieval in small areas.
Bidirectional Temporal Diffusion Model for Temporally Consistent Human Animation
We introduce a method to generate temporally coherent human animation from a single image, a video, or a random noise. This problem has been formulated as modeling of an auto-regressive generation, i.e., to regress past frames to decode future frames. However, such unidirectional generation is highly prone to motion drifting over time, generating unrealistic human animation with significant artifacts such as appearance distortion. We claim that bidirectional temporal modeling enforces temporal coherence on a generative network by largely suppressing the motion ambiguity of human appearance.