Moved int8_mm_dequant from CPU to default backend by Egor-Krivov · Pull Request #1626 · bitsandbytes-foundation/bitsandbytes
Navigation Menu
{{ message }}
bitsandbytes-foundation / bitsandbytes Public
- Notifications You must be signed in to change notification settings
- Fork 828
Merged
matthewdouglas merged 1 commit intobitsandbytes-foundation:mainfrom
May 7, 2025Merged
Moved int8_mm_dequant from CPU to default backend#1626
matthewdouglas merged 1 commit intobitsandbytes-foundation:mainfrom
Moved int8_mm_dequant from CPU to default backend#1626
matthewdouglas merged 1 commit intobitsandbytes-foundation:mainfrom
Conversation
Copy link
Contributor
Egor-Krivov
commented
May 7, 2025
Egor-Krivov
commented
Moved bitsandbytes::int8_mm_dequant implementation from CPU to default backend to enable pytest tests/test_functional.py::TestLLMInt8Functional on both XPU and CPU. Since it's in default backend, we no longer need it in CPU backend.
matthewdouglas
self-requested a review
matthewdouglas
added
the
Cross Platform
label
matthewdouglas
added this to the
v0.46.0 milestone
matthewdouglas approved these changes May 7, 2025
Copy link
Member
matthewdouglas
left a comment
matthewdouglas
left a comment
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
LGTM, thank you!
Copy link
github-actions
bot
commented
May 7, 2025
github-actions bot commented
May 7, 2025The docs for this PR live here. All of your documentation changes will be reflected on that endpoint. The docs are available until 30 days after the last update.
Egor-Krivov
deleted the
egor/int8_mm_dequant
branch
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters. Learn more about bidirectional Unicode characters
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment