Skip to Main content Skip to Navigation
Preprints, Working Papers, ...

Spatio-Temporal Human Shape Completion With Implicit Function Networks

Boyao Zhou 1, 2 Jean-Sébastien Franco 2 Federica Bogo 1 Edmond Boyer 2, 1
2 MORPHEO - Capture and Analysis of Shapes in Motion
Inria Grenoble - Rhône-Alpes, LJK - Laboratoire Jean Kuntzmann, Grenoble INP - Institut polytechnique de Grenoble - Grenoble Institute of Technology
Abstract : We address the problem of inferring a human shape from partial observations, such as depth images, in temporal sequences. Deep Neural Networks (DNN) have been shown successful to estimate detailed shapes on a frame-by-frame basis but consider yet little or no temporal information over frame sequences for detailed shape estimation. Recently, networks that implicitly encode shape occupancy using MLP layers have shown very promising results for such single-frame shape inference, with the advantage of reducing the dimensionality of the problem and providing continuously encoded results. In this work we propose to generalize implicit encoding to spatio-temporal shape inference with spatio-temporal implicit function networks or STIF-Nets, where temporal redundancy and continuity is expected to improve the shape and motion quality. To validate these added benefits, we collect and train with motion data from CAPE for dressed humans, and DFAUST for body shapes with no clothing. We show our model's ability to estimate shapes for a set of input frames, and interpolate between them. Our results show that our method outperforms existing state of the art methods, in particular the single-frame methods for detailed shape estimation.
Document type :
Preprints, Working Papers, ...
Complete list of metadata

https://hal.inria.fr/hal-03381387
Contributor : Boyao Zhou Connect in order to contact the contributor
Submitted on : Saturday, October 16, 2021 - 3:52:19 PM
Last modification on : Thursday, December 2, 2021 - 3:34:19 PM

File

STIF_hal.pdf
Files produced by the author(s)

Identifiers

  • HAL Id : hal-03381387, version 1

Collections

Citation

Boyao Zhou, Jean-Sébastien Franco, Federica Bogo, Edmond Boyer. Spatio-Temporal Human Shape Completion With Implicit Function Networks. 2021. ⟨hal-03381387⟩

Share

Metrics

Record views

65

Files downloads

627