Skip to content

Issues: microsoft/DeepSpeed-MII

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Clear current search query, filters, and sorts
196 Open 117 Closed
196 Open 117 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

Support for Albert and Swin/ViT
#119 opened Dec 12, 2022 by larry-fuy
1
Add local AML deployment option enhancement New feature or request
#44 opened Jul 27, 2022 by jeffra
1
Support multiple nodes deployment? enhancement New feature or request
#47 opened Aug 8, 2022 by pohunghuang-nctu
@mrwyattii
3
Support for Fairseq Translation Model
#74 opened Oct 24, 2022 by huzerD
1
feature request : Docker image for deepspeed-mii
#83 opened Oct 29, 2022 by Thytu
3
Can DeepSpeed-MII also support models/libraries like YOLO / Detectron2 / FCOS / VitDet? enhancement New feature or request
#89 opened Nov 1, 2022 by kartikeyporwal
@mrwyattii
1
Question : How to query a remote DeepSpeed server?
#94 opened Nov 6, 2022 by Thytu
4
RuntimeError: This event loop is already running enhancement New feature or request
#100 opened Nov 17, 2022 by heiko-hotz
3
Support for FLAN-T5
#106 opened Nov 21, 2022 by jihan-yin
3
Stop Sequence
#109 opened Nov 24, 2022 by volkerha
4
Is there a way to communicate with the individual models in an MII deployment?
#111 opened Nov 28, 2022 by Dango233
1
AML deployment error due to missing az cli arguments
#115 opened Dec 8, 2022 by aponte411
5
Expose DS-inference and ZeRO-inference configs to user enhancement New feature or request
#27 opened May 17, 2022 by jeffra
2
Stable Diffusion | Multi-Pipeline Support (i.e. img2img)
#118 opened Dec 11, 2022 by ghunkins
1
Is model split in OPT TP mode?
#120 opened Dec 13, 2022 by larry-fuy
2
Change number of max_tokens from 1024
#125 opened Dec 28, 2022 by mallorbc
1
Some generate parameters do not work for query
#127 opened Dec 29, 2022 by mallorbc
3
Question about a custom MII task
#131 opened Dec 31, 2022 by pablogranolabar
3
MII Text to Image Task Issue
#132 opened Jan 4, 2023 by gvijqb
3
How to do the batch inference enhancement New feature or request
#133 opened Jan 12, 2023 by Emerald01
@mrwyattii
7
Allow model_path only to deploy "local" models
#136 opened Jan 18, 2023 by philschmid
3
How to deal with imbalanced GPU memories?
#137 opened Jan 26, 2023 by lixinye-nju
Is there any plan to support dynamic batching or dynamic batching with different args ?
#139 opened Jan 30, 2023 by dumpmemory
don't work with stable diffusion 2.1
#140 opened Jan 30, 2023 by 0xDing
1
ValueError: Unsupported model type mllama
#549 opened Dec 1, 2024 by MaorSagi
ProTip! Find all open issues with in progress development work with linked:pr.