Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

moshi demo error --- Error Too many concurrent users. Come back later! #42

Open
cageyoko opened this issue Dec 20, 2024 · 2 comments
Open

Comments

@cageyoko
Copy link

cageyoko commented Dec 20, 2024

Thank you very much for your work, I have met a problem with moshi demo. After I press the button, it will be stuck in waiting
gradio==5.9.1
gradio-webrtc==0.0.24

this is your huggingface demo:
image

this is my local demo:
image

when I debug the code, I find this error
`

/opt/miniconda/lib/python3.10/site-packages/aiortc/rtcpeerconnection.py(1006)setRemoteDescription()
-> self.__pendingRemoteDescription = description
(Pdb) n
Internal StopIteration: RTCSessionDescription(sdp='v=0\r\no=- 3943680920 3943680920 IN IP4 0.0.0.0\r\ns=-\r\nt=0 0\r\na=group:BUNDLE 0 1\r\na=msid-semantic:WMS *\r\nm=audio 9 UDP/TLS/RTP/SAVPF 111 0 8\r\nc=IN IP4 0.0.0.0\r\na=sendrecv\r\na=extmap:1 urn:ietf:params:rtp-hdrext:ssrc-audio-level\r\na=extmap:4 urn:ietf:params:rtp-hdrext:sdes:mid\r\na=mid:0\r\na=msid:25d2c052-72c4-431b-8052-8bbea305932e 181cefbf-1a0e-4962-98a7-75d5af2f1ae8\r\na=rtcp:9 IN IP4 0.0.0.0\r\na=rtcp-mux\r\na=ssrc:3953674825 cname:5502e161-730d-4b19-be9f-7af0727cb882\r\na=rtpmap:111 opus/48000/2\r\na=rtpmap:0 PCMU/8000\r\na=rtpmap:8 PCMA/8000\r\na=ice-ufrag:iyDe\r\na=ice-pwd:WjBbX9dl57yCBNFxQHs9Fh\r\na=fingerprint:sha-256 21:01:E9:34:20:DB:A9:8E:33:E5:71:E9:66:27:10:19:C3:3E:70:DD:3A:CE:4A:01:94:A5:29:7C:58:98:44:95\r\na=setup:active\r\nm=application 9 UDP/DTLS/SCTP webrtc-datachannel\r\nc=IN IP4 0.0.0.0\r\na=mid:1\r\na=sctp-port:5000\r\na=max-message-size:65536\r\na=ice-ufrag:iyDe\r\na=ice-pwd:WjBbX9dl57yCBNFxQHs9Fh\r\na=fingerprint:sha-256 21:01:E9:34:20:DB:A9:8E:33:E5:71:E9:66:27:10:19:C3:3E:70:DD:3A:CE:4A:01:94:A5:29:7C:58:98:44:95\r\na=setup:active\r\n', type='answer')
/opt/miniconda/lib/python3.10/site-packages/gradio_webrtc/webrtc.py(882)offer()`

could you have any suggestions for this? thank you very much!!!

@freddyaboulton
Copy link
Owner

Hi @cageyoko - is the moshi model running locally on your computer as well? Where are you based?

@cageyoko
Copy link
Author

cageyoko commented Dec 23, 2024

Hi, @freddyaboulton moshi model running locally, Web-ui demo is ok, gradio demo is bad..
Fisrt
pip install moshi CUDA_VISIBLE_DEVICES=2 python -m moshi.server --static /nfs-speech-cfs/xx/models/moshi-artifacts/dist --tokenizer /nfs-speech-cfs/xx/models/moshika-pytorch-bf16/tokenizer_spm_32k_3.model --moshi-weight /nfs-speech-cfs/xx/models/moshika-pytorch-bf16/model.safetensors --mimi-weight /nfs-speech-cfs/xx/models/moshika-pytorch-bf16/tokenizer-e351c8d8-checkpoint125.safetensors --port=8885
and show this page, this page I can chat with demo.
image

And then, based on the https://github.com/kyutai-labs/moshi/blob/main/moshi/moshi/client_gradio.py or the code you provided.
python client_gradio.py --url http://0.0.0.0:8885
some detail information:
image

I met the problem and can't solve it. 😭

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants