A Visual Approach to Measure Cloth-Body and Cloth-Cloth Friction

Abdullah-Haroon Rasheed (1, 2) , Victor Romero (2, 3) , Florence Bertails-Descoubes (2) , Stefanie Wuhrer (1) , Jean-Sébastien Franco (1) , Arnaud Lazarus (3)

1 MORPHEO - Capture and Analysis of Shapes in Motion
2 ELAN - ModELisation de l'apparence des phénomènes Non-linéaires
3 SU - Sorbonne Université

Measuring contact friction in soft-bodies usually requires a specialised physics bench and a tedious acquisition protocol. This makes the prospect of a purely non-invasive, video-based measurement technique particularly attractive. Previous works have shown that such a video-based estimation is feasible for material parameters using deep learning, but this has never been applied to the friction estimation problem which results in even more subtle visual variations. Because acquiring a large dataset for this problem is impractical, generating it from simulation is the obvious alternative. However, this requires the use of a frictional contact simulator whose results are not only visually plausible, but physically-correct enough to match observations made at the macroscopic scale. In this paper, which is an extended version of our former work [31], we propose to our knowledge the first non-invasive measurement network and adjoining synthetic training dataset for estimating cloth friction at contact, for both cloth-hard body and cloth-cloth contacts. To this end we build a protocol for validating and calibrating a state-of-the-art frictional contact simulator, in order to produce a reliable dataset. We furthermore show that without our careful calibration procedure, the training fails to provide accurate estimation results on real data. We present extensive results on a large acquired test set of several hundred real video sequences of cloth in friction, which validates the proposed protocol and its accuracy.

Mots clés: Friction Estimation; Cloth Simulation; Deep Learning; Material Estimation; Inverse Problem

Domaines: Vision par ordinateur et reconnaissance de formes [cs.CV]; Intelligence artificielle [cs.AI]; Matériaux et structures en mécanique [physics.class-ph]

Abdullah-Haroon Rasheed, Victor Romero, Florence Bertails-Descoubes, Stefanie Wuhrer, Jean-Sébastien Franco, et al.. A Visual Approach to Measure Cloth-Body and Cloth-Cloth Friction. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2022, 44 (10), pp.6683-6694. ⟨10.1109/TPAMI.2021.3097547⟩. ⟨hal-03285624⟩