🔥 New main backend Deep Learning Library (Engine) for DeepLabCut: PyTorch by MMathisLab · Pull Request #2613 · DeepLabCut/DeepLabCut
and others added 30 commits
March 19, 2024 15:06
* improved augmenter selection * improved pytorch config docs * added documentation for missing parameters * remove unused param from DLCParams * bug fix: add a shuffle
- makes usage of TQDM in evaluate_assembly optional (so it doesn't log during training) - only computes rmse_pcutoff if there are keypoints above the cutoff (otherwise a warning was printed) - force the logger updates when starting to train, otherwise it could be buggy - don't use `verbose`for the LR scheduler as it's deprecated - log a single time will all metrics instead of multiple - logs metrics and losses to different prefixes so they are put in the correct panels on wandb - log input images, target and output heatmaps to WandB
* fixed superanimal video inference * added demo notebook for transfer learning
updated code to get scorer for pytorch models, fixed bugs for video analysis
* Fix NaN centroids with 0 likelihood * Minor compatibility fixes * Improved error message * Fix config dict key setting * Delete redundant neighbor search implementations
…n data augmentation, add tests (#190) * bug fix: incorrectly reading snapshot index from config in analyze videos * added files for backwards compatibility (e.g. when loading pickles) * update default top down augmentation * fixed tokenpose cfg * added tests for topdown config creation, fixed bug * add coarse dropout test, pin albu * switch default resnet50 to GN model * changed default resnet output stride to 16 * freeze BN stats but not weights as default * fixed tests * fix topdown aug
* Loading SuperAnimal weights for model training * various bug fixes
* bug fix when creating train dataset, updated code to use model stride correctly * stride can be float
* prepare for 3.0.0rc1 (bump version) * Update version.py * Update reinstall.sh * Update NOTICE.yml (pytorch license)
Co-authored-by: Niels Poulsen <niels.poulsen@epfl.ch>
* added CSV logger * fixed imports
* Fix matching w/ single body parts * Minor fixes
niels: GUI bug fix, engine selector
* Tmp fix create_pretrained_project: create TF trainingset metadata * Type hints * Split create_pretrained_project() into tf and torch * Add individuals param to create_new_project() * Fix list_videos_in_folder() In original/tf methods (f.ex. analyze_videos), default value of videotype was "", this default value was not treated properly in list_videos_in_folder() * Refactor _create_and_save_fake_metadata * Refactor: _process_videos * Implement create_pretrained_project for torch * Update create_pretrained_project usages * Refactoring Move read_config_as_dict, write_config and pretty_print to core * Fix get_super_animal_project_cfg When calling read_config, the superanimal yaml config in the repo was modified * Write integration script * Fix other Superanimal tests * Run black
* improve testing * fix ID-based tracklet creation * fix ID metric computation when NaNs are present * fix id assignment during ID-only tracking
* Updates to the documentation - Maxim (#2869) * Updates to the docs (#2871) * add more docs in single animal userguide * unify train_network docs * unify train_network docs * improved augmentation code * remove link to 3mice TF Colab on homepage * Update readme and conda env * Update readme * docs/pytorch/user_guide Installation: point to docs/installation * Standardize subtitiles accross single and multi user guides * Add missing docstring * improved installation docs * added quick commands * improved docs * install torch and torchvision with pip in the DeepLabCut Conda file * updated labelling in userguides * Update DEEPLABCUT.yaml * install deeplabcut through the pre-release --------- Co-authored-by: Niels <45132115+n-poulsen@users.noreply.github.com> Co-authored-by: Niels Poulsen <niels.poulsen@epfl.ch> Co-authored-by: Mackenzie Mathis <mathis@rowland.harvard.edu>
…ne (#2868) * update openfield COLAB * updated COLAB_YOURDATA_TrainNetwork_VideoAnalysis and COLAB_maDLC_TrainNetwork_VideoAnalysis * fix ReID notebook * fix ReID notebook * save predictions to destfolder * update superanimal notebook * fixed demo_data.py, Demo_labeledexample_MouseReaching.ipynb * set default batch size to 8, fix notebooks * updated notebooks * fix edited config * fix edited config * fix edited config * update 3mice demo * install deeplabcut through prerelease --------- Co-authored-by: Mackenzie Mathis <mathis@rowland.harvard.edu>
* bug fix for bbox dict building * add option to export top-down models without detectors * add option to export top-down models without detectors * Update examples/openfield-Pranav-2018-10-30/config.yaml * Update examples/openfield-Pranav-2018-10-30/config.yaml --------- Co-authored-by: Mackenzie Mathis <mathis@rowland.harvard.edu>
MMathisLab
changed the title
[wip] 🔥 New main backend Deep Learning Library (Engine) for DeepLabCut: PyTorch
🔥 New main backend Deep Learning Library (Engine) for DeepLabCut: PyTorch
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters. Learn more about bidirectional Unicode characters