Design and evaluation of a biomechanically consistent method for markerless kinematic analysis of sports motion

français

Speciality : Informatique

10/03/2023 - 12:00 M. David Pagnon (Université Grenoble Alpes) IMAG Auditorium 

Motion capture is traditionally performed with marker-based systems. However, these solutions are hardly compatible with on-field sports analysis, and markerless alternatives are being explored. One of the most promising prospects lies at the intersection of machine learning for 2D pose estimation, computer vision for 3D reconstruction from multiple video sources, and biomechanics for constraining 3D coordinates to an anatomically consistent model. We released Pose2Sim, an open-source package striving to answer these needs in a user-friendly way. OpenPose 2D keypoint coordinates are robustly triangulated, and serve as input for a full-body OpenSim inverse kinematics procedure. Pose2Sim robustness has been evaluated for people entering and exiting the field of view, degraded image quality, calibration errors, and decreased number of cameras. Its accuracy has also been assessed and deemed sufficient for walking, running, and ergometer cycling analysis. In the context of a competition, using lightweight and wireless action cameras is convenient. We tested such hardware on boxing sequences and proposed postcalibration and post-synchronization procedures. Finally, capturing both the athlete and their equipment can be valuable. We studied the kinematics of both a pilot and his bike in a BMX race by training a DeepLabCut bike model, triangulated and mapped on a custom-articulated OpenSim model. This work brings out interesting new perspectives for the analysis of sports movement.

President:

Dr. Pr. Valérie Perrier (Grenoble INP)

Directors:

  • Dr. Mathieu Domalain (Université de Poitiers )
  • Dr. Lionel Reveret (Inria Rhône-Alpes )

Raporteurs:

  • Dr. Pr. Steffi Colyer (University of Bath, Angleterre )
  • Dr. Pr. Richard Kulpa (Université Rennes 2 )

Examinators:

  • Dr. Mickaël Begon (Université de Montréal, Canada. )
  • Dr. Bruno Watier (Université Toulouse III - Paul Sabatier )
  • Dr. François Brémond (INRIA Méditerranée )