BIOLogo
Here you can search for tool, journal and user
Add new
Add new
Sign in Sign up
cover img
contact us
cover img
LiftPose3D
Deep learning-based approach for transforming two-dimensional to three-dimensional poses in laboratory animals.
ID:63039UploaderBioTreasury
2022.06.02
12
Collect
Collect
Like
Like
Share
Share
DetailComments (0)
Abstract
Markerless three-dimensional (3D) pose estimation has become an indispensable tool for kinematic studies of laboratory animals. Most current methods recover 3D poses by multi-view triangulation of deep network-based two-dimensional (2D) pose estimates. However, triangulation requires multiple synchronized cameras and elaborate calibration protocols that hinder its widespread adoption in laboratory studies. Here we describe LiftPose3D, a deep network-based method that overcomes these barriers by reconstructing 3D poses from a single 2D camera view. We illustrate LiftPose3D's versatility by applying it to multiple experimental systems using flies, mice, rats and macaques, and in circumstances where 3D triangulation is impractical or impossible. Our framework achieves accurate lifting for stereotypical and nonstereotypical behaviors from different camera angles. Thus, LiftPose3D permits high-quality 3D pose estimation in the absence of complex camera arrays and tedious calibration procedures and despite occluded body parts in freely behaving animals.
Screenshot
Publication
LiftPose3D, a deep learning-based approach for transforming two-dimensional to three-dimensional poses in laboratory animals
Adam Gosztolai,Semih Günel,Victor Lobato-Ríos,Marco Pietro Abrate,Daniel Morales,Helge Rhodin,Pascal Fua,Pavan RamdyaNature Methods2021
Cited by 79 articles
NeuroMechFly, a neuromechanical model of adult Drosophila melanogaster
Victor Lobato-Rios, Shravan Tata Ramalingasetty, Pembe Gizem Özdil, Jonathan Arreguit, Auke Jan Ijspeert, Pavan Ramdya Nature Methods2022
PMID:35545713
Impact Factor:28.3
ONIX: a unified open-source platform for multimodal neural recording and perturbation during naturalistic behavior
Jonathan P. Newman, Jie Zhang, Aarón Cuevas-López, Nicholas J. Miller, Takato Honda, Marie-Sophie H. van der Goes, Alexandra H. Leighton, Filipe Carvalho, Gonçalo Lopes, Anna Lakunina, Joshua H. Siegle, Mark T. Harnett, Matthew A. Wilson, Jakob Voigts Nature Methods2024
PMID:39528678
PMCID:PMC11725498
Impact Factor:28.3
The neuromechanics of animal locomotion: From biology to robotics and back
Pavan Ramdya, Auke Jan Ijspeert Science Robotics2023
PMID:37256966
Impact Factor:25.5
Quantifying behavior to understand the brain
Talmo D. Pereira, Joshua W. Shaevitz, Mala Murthy Nature Neuroscience2020
PMID:33169033
PMCID:PMC7780298
Impact Factor:20.3
Emerging technologies for behavioral research in changing environments
Iain D Couzin, Conor Heins Trends in Ecology & Evolution2022
PMID:36509561
Impact Factor:17.9
User Privacy Notice
Aggregate score
Citations
Altmetric
Ratings
No ratings
Check update
Tag
Machine learning
Operating system
The tool doesn't have any operating system information yet.
Author
The author has not claimed it yet
Claim Authorship
cover imgcover imgSearch