Aug 28, 2023
Great job making it work.
HOW much is that M2 GPU?
It needs at least 16 GB (GPU/CPU RAM) to run 7B quantized model.
Sign up to discover human stories that deepen your understanding of the world.
Free
Distraction-free reading. No ads.
Organize your knowledge with lists and highlights.
Tell your story. Find your audience.
Membership
Read member-only stories
Support writers you read most
Earn money for your writing
Listen to audio narrations
Read offline with the Medium app
