Skip to content

Issues: sgl-project/sglang

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

311 Open 981 Closed
311 Open 981 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

[Bug] Distributed Initialization of SGLang with accelerate launch
#3974 opened Mar 1, 2025 by jhinpan
5 tasks done
@jhinpan
3
[Feature] Support model unsloth/DeepSeek-R1-GGUF deepseek
#3973 opened Mar 1, 2025 by Qiaolin-Yu
2 tasks done
1
[Feature] Prefill assistant response feature
#3971 opened Feb 28, 2025 by RealWorga
2 tasks done
@jhinpan
1
[Bug] Sg-kernel and sglang build from source
#3970 opened Feb 28, 2025 by johnnynunez
5 tasks done
@jhinpan
1
Question sgl_kernel on amd paltforms amd
#3965 opened Feb 28, 2025 by etiennemlb
@jhinpan
2
DeepSeek-R1 Optimization Options Ablations deepseek high priority speculative-decoding
#3956 opened Feb 28, 2025 by m0g1cian
@shuaills
8
[Bug] RecursionError: maximum recursion depth exceeded while calling a Python object
#3953 opened Feb 28, 2025 by Hiwyl
5 tasks done
@FrankLeeeee
1
how to fix "CUDA_HOME environment variable is not set" in docker
#3952 opened Feb 28, 2025 by Flynn-Zh
@FrankLeeeee
3
[Bug] After using --enable-torch-compile, garbled output
#3944 opened Feb 28, 2025 by echozyr2001
5 tasks done
@FrankLeeeee
10
[Bug] DeepSeek R1/V3 error when enable dp-attention and speculative-algo NEXTN
#3943 opened Feb 28, 2025 by TianQiLin666666
5 tasks done
@shuaills
1
Why are there a group of processes concentrated on a single GPU? high priority
#3942 opened Feb 28, 2025 by WalterYOO
@FrankLeeeee
1
[Bug] pytest shouldn't be required in production
#3938 opened Feb 28, 2025 by KCFindstr
5 tasks done
1
@shuaills
3
[Bug] KeyError: 'model.layers.0.self_attn.k_scale'
#3936 opened Feb 27, 2025 by Swipe4057
5 tasks done
@FrankLeeeee
1
[Bug] loading phi4-mini-instruct with sglang
#3935 opened Feb 27, 2025 by aqweteddy
5 tasks done
@shuaills
1
[Bug] sglang crashes with multi node
#3932 opened Feb 27, 2025 by tchaton
5 tasks done
@shuaills
3
sglang serving crashes with torch profiler enabled
#3931 opened Feb 27, 2025 by dulvqingyun
2 of 5 tasks
@shuaills
2
[Feature] Add a hash for each new release
#3923 opened Feb 27, 2025 by niconiconi
2 tasks done
@shuaills
2
[Question] Why is the performance worse after --enable-flashinfer-mla on H20
#3917 opened Feb 27, 2025 by tianchongchong
@Fridge003 @shuaills
9
[Bug] OpenAI compatible api return finish_reason as empty string instead of null causing json deseriliazition failure
#3912 opened Feb 27, 2025 by jzhouw
5 tasks done
@shuaills
1
[Bug] Server crash when Input length exceeds the maximum allowed length
#3910 opened Feb 27, 2025 by YangZeyu95
2 of 5 tasks
@shuaills
1
[Question] Optimization Options for DeepSeek-r1 Implementation
#3906 opened Feb 27, 2025 by JiangLiNSCC
@Fridge003
8
[Question] three questions about fused MoE Gemm implementation
#3904 opened Feb 27, 2025 by danielhua23
@Fridge003
1
[Feature] Allow Serving Requests During CUDA Graph Capture feature good first issue Good for newcomers
#3902 opened Feb 27, 2025 by junliu-mde
2 tasks done
@Fridge003
4
[Bug] OpenAI Endpoint '/v1/batches': error: Object of type ChoiceLogprobs is not JSON serializable
#3895 opened Feb 26, 2025 by dcfidalgo
5 tasks done
1
@Fridge003
2
[Bug] Dimension mismatched error when capturing cuda graph while enabling NEXTN
#3891 opened Feb 26, 2025 by TangChangcheng
5 tasks done
@Fridge003
1
ProTip! Adding no:label will show everything without a label.