New Top-Down Pose Estimation Model - RTMPose by n-poulsen · Pull Request #2795 · DeepLabCut/DeepLabCut
Navigation Menu
{{ message }}
DeepLabCut / DeepLabCut Public
- Notifications You must be signed in to change notification settings
- Fork 1.8k
Merged
New Top-Down Pose Estimation Model - RTMPose#2795
n-poulsen merged 53 commits intopytorch_dlcfrom
New Top-Down Pose Estimation Model - RTMPose#2795
n-poulsen merged 53 commits intopytorch_dlcfrom
Conversation
Copy link
Contributor
This pull requests adds the implementation for RTMPose: Real-Time Multi-Person Pose Estimation.
Full changes:
- New mixin for backbones with pretrained weights on HuggingFace :
HuggingFaceWeightsMixin - New backbone:
CSPNeXt - New head:
RTMCCHead - New target generator:
SimCCGenerator - New predictor:
SimCCPredictor - New weight initializer:
Rtmpose - New
RandomBBoxTransformaugmentation for top-down models (jitters ground truth bounding boxes) - Configs for
CSPNeXtbackbones:cspnext_s,cspnext_m,cspnext_x - Configs for
RTMPosemodels:rtmpose_s,rtmpose_m,rtmpose_x - Updated way to scheduler configurations, to allow for the use of
SequentialLR(to match the RTMPose training schedulers) - Added documentation: using a
SequentialLRscheduler for warm-up epochs - Updated the top-down crop to function with no-square crops (and re-implemented with numpy)
- Added
top_down_crop_size: (crop_w, crop_h)andtop_down_crop_marginin thepytorch_config.yamlfile for an easy way to control the size of the crops for top-down models.
- Added
- Bug fix:
bbox_from_keypointswhen there's more than 1 individual (bug had no impact as method was always called in a way it wouldn't fail)
DEMO
ski-dlc.mov
n-poulsen added 30 commits
October 22, 2024 11:59n-poulsen added 6 commits
November 8, 2024 17:39
n-poulsen
added
the
DLC3.0🔥
label
n-poulsen
requested a review
from maximpavliv
n-poulsen added 7 commits
November 28, 2024 12:18
MMathisLab
requested a review
from AlexEMG
maximpavliv suggested changes Dec 10, 2024
deeplabcut/pose_estimation_pytorch/config/rtmpose/rtmpose_x.yaml
Outdated
Show resolved
Hide resolved
deeplabcut/pose_estimation_pytorch/config/rtmpose/rtmpose_x.yaml Outdated Show resolved Hide resolved
deeplabcut/pose_estimation_pytorch/data/dataset.py
Show resolved
Hide resolved
deeplabcut/pose_estimation_pytorch/data/dataset.py Show resolved Hide resolved
deeplabcut/pose_estimation_pytorch/data/transforms.py
Outdated
Show resolved
Hide resolved
deeplabcut/pose_estimation_pytorch/data/transforms.py Outdated Show resolved Hide resolved
deeplabcut/pose_estimation_pytorch/models/weight_init.py
Outdated
Show resolved
Hide resolved
deeplabcut/pose_estimation_pytorch/models/weight_init.py Outdated Show resolved Hide resolved
tests/pose_estimation_pytorch/data/test_transforms.py
Outdated
Show resolved
Hide resolved
tests/pose_estimation_pytorch/data/test_transforms.py Outdated Show resolved Hide resolved
n-poulsen and others added 8 commits
December 10, 2024 14:52
n-poulsen
requested a review
from maximpavliv
maximpavliv approved these changes Dec 18, 2024
Copy link
Contributor
maximpavliv
left a comment
•
edited
Loading
maximpavliv
left a comment
•
edited
Loading
edited
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Great!!
n-poulsen
merged commit
1d26325
into
pytorch_dlc
n-poulsen
deleted the
niels/rtmpose
branch
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters. Learn more about bidirectional Unicode characters
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment