Skip to content

Commit

Permalink
Readme
Browse files Browse the repository at this point in the history
  • Loading branch information
@jakep-allenai
jakep-allenai committed Jan 29, 2025
1 parent 496e162 commit 9a1be7e
Showing 1 changed file with 2 additions and 2 deletions.
4 changes: 2 additions & 2 deletions README.md
View file
Original file line number Diff line number Diff line change
Expand Up @@ -32,13 +32,13 @@ cd olmocr
pip install -e .
```

Finally, make sure you have sglang with flashinfer installed if you want to do efficient inference
Finally, make sure you have sglang with flashinfer installed if you want to run inference on your own GPU.
```bash
pip install sgl-kernel --force-reinstall --no-deps
pip install "sglang[all]" --find-links https://flashinfer.ai/whl/cu124/torch2.4/flashinfer/
```

## BETA TESTER NOTE:
**BETA TESTER NOTE:**
If you are a beta tester, you will need to login using the hugging-face CLI
to make sure you have access to https://huggingface.co/allenai/olmocr-preview

Expand Down

0 comments on commit 9a1be7e

Please sign in to comment.