remove language_modeling by dimapihtar · Pull Request #14192 · NVIDIA-NeMo/NeMo

@dimapihtar

Signed-off-by: dimapihtar <dpihtar@gmail.com>

@github-actions bot added the NLP label

Jul 10, 2025

@dimapihtar

Signed-off-by: dimapihtar <dpihtar@gmail.com>

@dimapihtar

Signed-off-by: dimapihtar <dpihtar@gmail.com>
Signed-off-by: dimapihtar <dimapihtar@users.noreply.github.com>
Signed-off-by: dimapihtar <dpihtar@gmail.com>

@dimapihtar

Signed-off-by: dimapihtar <dpihtar@gmail.com>
Signed-off-by: dimapihtar <dpihtar@gmail.com>

github-advanced-security[bot]

Signed-off-by: dimapihtar <dpihtar@gmail.com>
Signed-off-by: dimapihtar <dpihtar@gmail.com>
Signed-off-by: dimapihtar <dimapihtar@users.noreply.github.com>
Signed-off-by: dimapihtar <dpihtar@gmail.com>
Signed-off-by: dimapihtar <dpihtar@gmail.com>
Signed-off-by: dimapihtar <dpihtar@gmail.com>

github-advanced-security[bot]

Signed-off-by: dimapihtar <dpihtar@gmail.com>
Signed-off-by: dimapihtar <dpihtar@gmail.com>
Signed-off-by: dimapihtar <dpihtar@gmail.com>
Signed-off-by: dimapihtar <dimapihtar@users.noreply.github.com>
Signed-off-by: dimapihtar <dpihtar@gmail.com>

@dimapihtar

Signed-off-by: dimapihtar <dpihtar@gmail.com>

@dimapihtar

Signed-off-by: dimapihtar <dimapihtar@users.noreply.github.com>

@dimapihtar

Signed-off-by: dimapihtar <dpihtar@gmail.com>

chtruong814

chtruong814

Signed-off-by: dimapihtar <dpihtar@gmail.com>
Signed-off-by: dimapihtar <dpihtar@gmail.com>

chtruong814

yaoyu-33

@dimapihtar dimapihtar deleted the dpykhtar/remove_language_modelling branch

October 14, 2025 16:32

dimapihtar added a commit that referenced this pull request

Oct 15, 2025
* remove language_modeling

Signed-off-by: dimapihtar <dpihtar@gmail.com>

* fix imports

Signed-off-by: dimapihtar <dpihtar@gmail.com>

* fix imports

Signed-off-by: dimapihtar <dpihtar@gmail.com>

* Apply isort and black reformatting

Signed-off-by: dimapihtar <dimapihtar@users.noreply.github.com>

* fix style

Signed-off-by: dimapihtar <dpihtar@gmail.com>

* fix style

Signed-off-by: dimapihtar <dpihtar@gmail.com>

* fix import

Signed-off-by: dimapihtar <dpihtar@gmail.com>

* fix imports

Signed-off-by: dimapihtar <dpihtar@gmail.com>

* Apply isort and black reformatting

Signed-off-by: dimapihtar <dimapihtar@users.noreply.github.com>

* fix style

Signed-off-by: dimapihtar <dpihtar@gmail.com>

* fix style

Signed-off-by: dimapihtar <dpihtar@gmail.com>

* fix style

Signed-off-by: dimapihtar <dpihtar@gmail.com>

* remove multimodal data unit tests

Signed-off-by: dimapihtar <dpihtar@gmail.com>

* remove nlp

Signed-off-by: dimapihtar <dpihtar@gmail.com>

* remove import checks for nlp

Signed-off-by: dimapihtar <dpihtar@gmail.com>

* Apply isort and black reformatting

Signed-off-by: dimapihtar <dimapihtar@users.noreply.github.com>

* remove check imposrts for nlp

Signed-off-by: dimapihtar <dpihtar@gmail.com>

* remove check imports for nlp

Signed-off-by: dimapihtar <dpihtar@gmail.com>

* fix nlp imports

Signed-off-by: dimapihtar <dpihtar@gmail.com>

* Apply isort and black reformatting

Signed-off-by: dimapihtar <dimapihtar@users.noreply.github.com>

* guard imports

Signed-off-by: dimapihtar <dpihtar@gmail.com>

* Apply isort and black reformatting

Signed-off-by: dimapihtar <dimapihtar@users.noreply.github.com>

* fix style

Signed-off-by: dimapihtar <dpihtar@gmail.com>

* move MegatronPretrainingBatchSampler

Signed-off-by: dimapihtar <dpihtar@gmail.com>

* Apply isort and black reformatting

Signed-off-by: dimapihtar <dimapihtar@users.noreply.github.com>

* fix import

Signed-off-by: dimapihtar <dpihtar@gmail.com>

* Apply isort and black reformatting

Signed-off-by: dimapihtar <dimapihtar@users.noreply.github.com>

* fix style

Signed-off-by: dimapihtar <dpihtar@gmail.com>

* Apply isort and black reformatting

Signed-off-by: dimapihtar <dimapihtar@users.noreply.github.com>

* fix style

Signed-off-by: dimapihtar <dpihtar@gmail.com>

* fix style

Signed-off-by: dimapihtar <dpihtar@gmail.com>

* fix import

Signed-off-by: dimapihtar <dpihtar@gmail.com>

* Apply isort and black reformatting

Signed-off-by: dimapihtar <dimapihtar@users.noreply.github.com>

* fix imports

Signed-off-by: dimapihtar <dpihtar@gmail.com>

* Apply isort and black reformatting

Signed-off-by: dimapihtar <dimapihtar@users.noreply.github.com>

* fix import

Signed-off-by: dimapihtar <dpihtar@gmail.com>

* Apply isort and black reformatting

Signed-off-by: dimapihtar <dimapihtar@users.noreply.github.com>

* fix style

Signed-off-by: dimapihtar <dpihtar@gmail.com>

* remove multimodal test

Signed-off-by: dimapihtar <dpihtar@gmail.com>

* fix import

Signed-off-by: dimapihtar <dpihtar@gmail.com>

* Apply isort and black reformatting

Signed-off-by: dimapihtar <dimapihtar@users.noreply.github.com>

* remove files

Signed-off-by: dimapihtar <dpihtar@gmail.com>

* resolve merge conflicts

Signed-off-by: dimapihtar <dpihtar@gmail.com>

* revert changes

Signed-off-by: dimapihtar <dpihtar@gmail.com>

* fix nlp data imports

Signed-off-by: dimapihtar <dpihtar@gmail.com>

* Apply isort and black reformatting

Signed-off-by: dimapihtar <dimapihtar@users.noreply.github.com>

* fix style

Signed-off-by: dimapihtar <dpihtar@gmail.com>

* Apply isort and black reformatting

Signed-off-by: dimapihtar <dimapihtar@users.noreply.github.com>

* fix style

Signed-off-by: dimapihtar <dpihtar@gmail.com>

* move list_available_models to nlp.modules

Signed-off-by: dimapihtar <dpihtar@gmail.com>

* Apply isort and black reformatting

Signed-off-by: dimapihtar <dimapihtar@users.noreply.github.com>

* get rid of language modelling modules

Signed-off-by: dimapihtar <dpihtar@gmail.com>

* Apply isort and black reformatting

Signed-off-by: dimapihtar <dimapihtar@users.noreply.github.com>

* fix style

Signed-off-by: dimapihtar <dpihtar@gmail.com>

* add Makefile

Signed-off-by: dimapihtar <dpihtar@gmail.com>

* add Makefile

Signed-off-by: dimapihtar <dpihtar@gmail.com>

---------

Signed-off-by: dimapihtar <dpihtar@gmail.com>
Signed-off-by: dimapihtar <dimapihtar@users.noreply.github.com>
Co-authored-by: dimapihtar <dimapihtar@users.noreply.github.com>

chtruong814 pushed a commit that referenced this pull request

Oct 15, 2025
* remove language_modeling



* fix imports



* fix imports



* Apply isort and black reformatting



* fix style



* fix style



* fix import



* fix imports



* Apply isort and black reformatting



* fix style



* fix style



* fix style



* remove multimodal data unit tests



* remove nlp



* remove import checks for nlp



* Apply isort and black reformatting



* remove check imposrts for nlp



* remove check imports for nlp



* fix nlp imports



* Apply isort and black reformatting



* guard imports



* Apply isort and black reformatting



* fix style



* move MegatronPretrainingBatchSampler



* Apply isort and black reformatting



* fix import



* Apply isort and black reformatting



* fix style



* Apply isort and black reformatting



* fix style



* fix style



* fix import



* Apply isort and black reformatting



* fix imports



* Apply isort and black reformatting



* fix import



* Apply isort and black reformatting



* fix style



* remove multimodal test



* fix import



* Apply isort and black reformatting



* remove files



* resolve merge conflicts



* revert changes



* fix nlp data imports



* Apply isort and black reformatting



* fix style



* Apply isort and black reformatting



* fix style



* move list_available_models to nlp.modules



* Apply isort and black reformatting



* get rid of language modelling modules



* Apply isort and black reformatting



* fix style



* add Makefile



* add Makefile



---------

Signed-off-by: dimapihtar <dpihtar@gmail.com>
Signed-off-by: dimapihtar <dimapihtar@users.noreply.github.com>
Co-authored-by: dimapihtar <dimapihtar@users.noreply.github.com>