Skip to content

Include Python dependencies in README - #6

Merged
ggerganov merged 1 commit into
ggml-org:masterfrom
simonw:patch-1
Mar 11, 2023
Merged

ggerganov merged 1 commit into
ggml-org:masterfrom
simonw:patch-1

Conversation

@simonw

@simonw simonw commented Mar 11, 2023 •

Copy link
Copy Markdown
Contributor

Should maybe note that you need Python 3.10 - because there's no torch wheel yet for Python 3.11.

@simonw

simonw commented Mar 11, 2023

Copy link
Copy Markdown
Contributor Author

See also https://til.simonwillison.net/llms/llama-7b-m2

@ggerganov
ggerganov merged commit 5f2f970 into ggml-org:master Mar 11, 2023
simonw added a commit to simonw/til that referenced this pull request Mar 11, 2023
This is documented in the LLaMA README now:
- ggml-org/llama.cpp#6
SlyEcho pushed a commit to SlyEcho/llama.cpp that referenced this pull request May 31, 2023
Buffer incomplete multibyte characters + other stuff.
ggerganov pushed a commit that referenced this pull request Oct 19, 2023
fix compilation errors with llvm
chsasank pushed a commit to chsasank/llama.cpp that referenced this pull request Dec 20, 2023
…gml-org#6)

* deprecate ffn_b

* get tensor offloading levels

* wip: split tensor loading

* wip: framework of loading sparse model tensors

* save and flush gpu alloc buffer

* vram budget will fall back to remaining free memory

* minor: remove vram safety margin

* add options for vram budget; clean old env vars

* minor: bugfix
chsasank pushed a commit to chsasank/llama.cpp that referenced this pull request Dec 20, 2023
* Update demo video in README.md

* Update demo at README.md
@Dyke-F Dyke-F mentioned this pull request Dec 21, 2023
3 tasks done
@segmond segmond mentioned this pull request Jan 14, 2024
4 tasks done
@m828 m828 mentioned this pull request Jul 16, 2024
@fan-chao fan-chao mentioned this pull request Aug 13, 2024
2 of 4 tasks
@slaren slaren mentioned this pull request Aug 15, 2024
2 of 4 tasks
younesbelkada pushed a commit to younesbelkada/llama.cpp that referenced this pull request May 15, 2025
@ngxson ngxson mentioned this pull request Jul 24, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants