Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

macOS support #33

Open
amitkot opened this issue Feb 26, 2025 · 11 comments
Open

macOS support #33

amitkot opened this issue Feb 26, 2025 · 11 comments

Comments

@amitkot
Copy link

amitkot commented Feb 26, 2025

🚀 The feature, motivation and pitch

Currently Nvidia HW is required - support for macOS will be really useful.

Alternatives

No response

Additional context

No response
@jakep-allenai
Copy link
Collaborator

Good idea, I had some thoughts here, so if there is interest I can take a closer look!

@DrewThomasson
Copy link

DrewThomasson commented Feb 26, 2025 •
edited
Loading

+1 interest gained

@F1Justin
Copy link

+1

2 similar comments
@jie7056
Copy link

jie7056 commented Feb 27, 2025

+1

@WendStation
Copy link

+1

@DrewThomasson
Copy link

Kind of related, been doing tests running the base model on CPU only inference on my Mac Pro M1 16gb Ram,

Results here: #38

@DrewThomasson DrewThomasson mentioned this issue Feb 27, 2025
Closed
@oadu-simplyai
Copy link

+1

@aman-17
Copy link
Member

aman-17 commented Feb 28, 2025

Hey everyone, I’ve pushed a quantized version of this model to HF, which can run on CPU/Mac for inference. Fully supporting Mac/CPUs is on our radar, and we’ll keep you updated on any progress.

@jorben
Copy link

jorben commented Feb 28, 2025

+1

2 similar comments
@agentcole
Copy link

+1

@vratclarkson
Copy link

+1

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests