Publicação
6D Pose Tracking of Objects with Very Partial View
| Resumo: | This dissertation addresses the problem of estimating the 6D pose of knee arthroscopic surgical instruments using only RGB video. Arthroscopy is a minimally invasive procedure where the instruments appear with strong symmetries, specular reflections, and frequent occlusions, making pose estimation highly challenging. The work integrates a markerless pipeline that combines a object detector, a dense correspondence method, and a geometric pose solver, with distortion-aware processing throughout the pipeline to handle the radial distortion of arthroscopic cameras. The pipeline was trained and tested on datasets of three instruments, with evaluation based on standard pose metrics and clinically relevant measures such as tip position and axis orientation errors. The results show reliable detection performance in most test sets, and competitive pose accuracy across instruments. Mean tip error remains within millimetric precision, and mean axis orientation error is generally below 5°. Despite these promising results, runtime analysis indicates that the current throughput of about 7.5 FPS is below the requirements for real-time surgical navigation. Overall, the study demonstrates that deep learning methods are paving the way to provide accurate and robust pose estimation, competing with physical markers approaches under occlusion and symmetry conditions, supporting their potential for integration into next-generation navigation systems in knee arthroscopy. Future improvements in dataset quality, processing speed, and method selection are expected to further enhance the practical deployment of this approach. |
|---|---|
| Autores principais: | Silva, João Filipe Cardoso |
| Assunto: | 6D pose estimation arthroscopy surgical navigation computer vision deep learning estimação de pose 6D artroscopia navegação cirúrgica visão por computador aprendizagem progunda |
| Ano: | 2025 |
| País: | Portugal |
| Tipo de documento: | dissertação de mestrado |
| Tipo de acesso: | acesso embargado |
| Instituição associada: | Universidade de Coimbra |
| Idioma: | inglês |
| Origem: | Estudo Geral - Universidade de Coimbra |
Registos relacionados
school Multi-object multi-instance 6D pose estimation in industrial environments
por: Abreu, Manuel Nunes
Publicado em: (2025)
por: Abreu, Manuel Nunes
Publicado em: (2025)
school 6D Object Detection for Mobile Robotics targeting industrial applications: a case study
por: Arsénio, Gonçalo Tomaz
Publicado em: (2023)
por: Arsénio, Gonçalo Tomaz
Publicado em: (2023)
school 6DoF Object Pose Estimation from RGB-D Images Using Machine Learning Approaches
por: Lourenço, Francisco Rodrigues
Publicado em: (2021)
por: Lourenço, Francisco Rodrigues
Publicado em: (2021)
school Multi-Instance and Multi-Modal object's 6D pose estimation with applications on AMRs
por: Lourenço, José Henrique Sequeira
Publicado em: (2024)
por: Lourenço, José Henrique Sequeira
Publicado em: (2024)
school Deep Learning for Markerless Surgical Navigation in Orthopedics
por: Félix, Inês Dinis
Publicado em: (2020)
por: Félix, Inês Dinis
Publicado em: (2020)
school Single Image Depth Estimation (SIDE) In Arthroscopy
por: Cruz, Miguel Baptista Tenreiro da
Publicado em: (2025)
por: Cruz, Miguel Baptista Tenreiro da
Publicado em: (2025)
school Development of vision algorithms for supply tasks by mobile manipulators
por: Araújo, João Pedro de Sousa
Publicado em: (2025)
por: Araújo, João Pedro de Sousa
Publicado em: (2025)
school Sistema de visão para aterragem automática de UAV
por: Santos, Nuno Alexandre Antunes Martins Pessanha
Publicado em: (2014)
por: Santos, Nuno Alexandre Antunes Martins Pessanha
Publicado em: (2014)
school Melhorando a estimação de pose com o RANSAC preemptivo generalizado e múltiplos geradores de hipóteses
por: Gomes Neto, Severino Paulo
Publicado em: (2014)
por: Gomes Neto, Severino Paulo
Publicado em: (2014)
school Integrating 3D Objects and Pose Estimation for Multimodal Video Annotations
por: Diogo, João Paulo Cabete Gonçalves
Publicado em: (2022)
por: Diogo, João Paulo Cabete Gonçalves
Publicado em: (2022)
school Desenvolvimento de um modelo de estimativa de pose usando Deep Learning
por: Araújo, André Filipe Oliveira
Publicado em: (2023)
por: Araújo, André Filipe Oliveira
Publicado em: (2023)
school 3D Pose and Shape Estimation from a Camera System
por: Figueiredo, Lino Manuel Baptista
Publicado em: (2023)
por: Figueiredo, Lino Manuel Baptista
Publicado em: (2023)
school MobiForm: Mobile-Based Human Pose Estimation with Deep Learning for Movement Monitoring
por: Martins, Rafael João Freire
Publicado em: (2025)
por: Martins, Rafael João Freire
Publicado em: (2025)
school Baptizo: a sensor fusion based model for tracking the identity of human poses
por: Bazo, Rodrigo
Publicado em: (2020)
por: Bazo, Rodrigo
Publicado em: (2020)
science Feasibility of 3D body tracking from monocular 2D video feeds in musculoskeletal telerehabilitation
por: Clemente, Carolina
Publicado em: (2023)
por: Clemente, Carolina
Publicado em: (2023)
school Sistema de reconhecimento biométrico baseado em marcha utilizando poses 2D
por: Jangua, Daniel Ricardo dos Santos
Publicado em: (2022)
por: Jangua, Daniel Ricardo dos Santos
Publicado em: (2022)
school Anomaly detection on pose estimation
por: Regado, Daniel Assunção
Publicado em: (2024)
por: Regado, Daniel Assunção
Publicado em: (2024)
category A robust real-time face tracking using head pose estimation for a markerless AR system
por: Macedo, Márcio Cerqueira de Farias
Publicado em: (2016)
por: Macedo, Márcio Cerqueira de Farias
Publicado em: (2016)
article Real-time human pose estimation on a smart walker using convolutional neural networks
por: Palermo, Manuel Castro
Publicado em: (2021)
por: Palermo, Manuel Castro
Publicado em: (2021)
school Automatic Diagnosis System for Human Gait Pathologies Using Computer Vision
por: Tavares, Jose Brandao
Publicado em: (2015)
por: Tavares, Jose Brandao
Publicado em: (2015)
groups Low-cost natural interface based on head movements
por: Martins, Joao M. S.
Publicado em: (2015)
por: Martins, Joao M. S.
Publicado em: (2015)
article Low-cost and non-intrusive human digital twin component for task and navigation tracking through pose estimation
por: Costa, Diogo
Publicado em: (2025)
por: Costa, Diogo
Publicado em: (2025)
article From Queer as Folk to Pose, 20 years later: Representations in dispute, from homophobia to transphobia
por: Rodrigues, André Iribure
Publicado em: (2021)
por: Rodrigues, André Iribure
Publicado em: (2021)
school Estimação da pose de objectos em imagens RGB-D utilizando aprendizagem automática
por: Marques, Alexandre Azevedo
Publicado em: (2018)
por: Marques, Alexandre Azevedo
Publicado em: (2018)
school Service robot remote control system (VR Headset + Pose Estimation)
por: Fernandes, Eduardo Alexandre Carvalho
Publicado em: (2023)
por: Fernandes, Eduardo Alexandre Carvalho
Publicado em: (2023)
article Top-down human pose estimation with depth images and domain adaptation
por: Rodrigues, Nelson
Publicado em: (2019)
por: Rodrigues, Nelson
Publicado em: (2019)
school Deteção de pose 3D de utilizadores humanos e posterior interação
por: Lages, Ana Carolina Lima
Publicado em: (2023)
por: Lages, Ana Carolina Lima
Publicado em: (2023)
article Comparative analysis of Rgb and depth data for enhanced functional fitness assessments and accurate human pose estimation
por: Bukhantsev, Artem
Publicado em: (2026)
por: Bukhantsev, Artem
Publicado em: (2026)
school Practical Applications for Medical Image Segmentation in orthopedics
por: Figueiredo, Adriana Maria Matos
Publicado em: (2023)
por: Figueiredo, Adriana Maria Matos
Publicado em: (2023)
article Real-time human body pose estimation for in-car depth images
por: Torres, Helena Daniela Ribeiro
Publicado em: (2019)
por: Torres, Helena Daniela Ribeiro
Publicado em: (2019)
article Low-Cost Method for the Estimation of the Shape of Quadric Mirrors and Calibration of Catadioptric Cameras
por: Gonçalves, Nuno
Publicado em: (2007)
por: Gonçalves, Nuno
Publicado em: (2007)
school Detecção de faces e rastreamento da pose da cabeça
por: Schramm, Rodrigo
Publicado em: (2015)
por: Schramm, Rodrigo
Publicado em: (2015)
article Computer vision intelligent approaches to extract human pose and its activity from image sequences
por: Gonçalves, Paulo
Publicado em: (2020)
por: Gonçalves, Paulo
Publicado em: (2020)
article Pose estimation of a humanoid robot using images from a mobile external camera
por: Nogueira, Marcelo Borges
Publicado em: (2010)
por: Nogueira, Marcelo Borges
Publicado em: (2010)
article Maintaining the relative positions and orientations of multiple robots using vision
por: Paulino, António
Publicado em: (2001)
por: Paulino, António
Publicado em: (2001)
school Sistema de reconhecimento biométrico de múltiplas pessoas baseado em métodos de estimação de pose e rastreamento de objetos
por: Morelli, Luis Henrique
Publicado em: (2023)
por: Morelli, Luis Henrique
Publicado em: (2023)
school Reconhecimento de ações humanas baseado em articulações do esqueleto obtidas de poses 2D
por: Belluzzo, Bruno
Publicado em: (2023)
por: Belluzzo, Bruno
Publicado em: (2023)
article A system for the generation of in-car human body pose datasets
por: Silva, João Pedro Borges Araújo Oliveira
Publicado em: (2021)
por: Silva, João Pedro Borges Araújo Oliveira
Publicado em: (2021)
article Automated generation of synthetic in-car dataset for human body pose detection
por: Borges, João
Publicado em: (2020)
por: Borges, João
Publicado em: (2020)
school Human path prediction through machine learning trained with 2D video data and estimated 3D pose data
por: Camelo, Guilherme Antonio
Publicado em: (2019)
por: Camelo, Guilherme Antonio
Publicado em: (2019)
Atividades financiadas
Não foram encontrados projetos financiados.
Registos relacionados
-
school Multi-object multi-instance 6D pose estimation in industrial environments
por: Abreu, Manuel Nunes
Publicado em: (2025) -
school 6D Object Detection for Mobile Robotics targeting industrial applications: a case study
por: Arsénio, Gonçalo Tomaz
Publicado em: (2023) -
school 6DoF Object Pose Estimation from RGB-D Images Using Machine Learning Approaches
por: Lourenço, Francisco Rodrigues
Publicado em: (2021) -
school Multi-Instance and Multi-Modal object's 6D pose estimation with applications on AMRs
por: Lourenço, José Henrique Sequeira
Publicado em: (2024) -
school Deep Learning for Markerless Surgical Navigation in Orthopedics
por: Félix, Inês Dinis
Publicado em: (2020)