Skip to content

Pull requests: mit-han-lab/omniserve

New pull request New
4 Open 10 Closed
4 Open 10 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

Fix request id
#64 opened Mar 20, 2025 by ZisIsNotZis Loading…
Support bf16 for quant, layernorm and gemm OPs
#47 opened Dec 10, 2024 by guoyuhong Loading…
[Minor] Fix KV cache block size
#39 opened Oct 15, 2024 by dasistwo Loading…
[Update] Add rms norm general kernel and update sampler condition
#37 opened Sep 7, 2024 by jason-huang03 Loading…
ProTip! Follow long discussions with comments:>50.