Skip to content

ggml_new_tensor_impl: not enough space in the context's memory pool (needed 717778556, available 454395136) #153

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Closed
YongeBai opened this issue Mar 15, 2023 · 1 comment
Closed

ggml_new_tensor_impl: not enough space in the context's memory pool (needed 717778556, available 454395136) #153

YongeBai opened this issue Mar 15, 2023 · 1 comment
Labels
duplicate This issue or pull request already exists need more info The OP should provide more details about the issue

Comments

@YongeBai
Copy link

Hey, I know someone already posted a similar issue that has already been closed, but I ran into the same thing. On windows 10 and cloned just yesterday
@gjmulder gjmulder added duplicate This issue or pull request already exists need more info The OP should provide more details about the issue bug Something isn't working labels Mar 15, 2023
@ggerganov ggerganov removed the bug Something isn't working label Mar 15, 2023
hx507 added a commit to hx507/llama.cpp that referenced this issue Mar 16, 2023
@hx507
Scale buf_size linearly with n_ctx
7b88584 
This appear to solve ggml-org#153
where error of "ggml_new_tensor_impl: not enough space in the context's memory pool" is thrown in interactive mode. 

At least the out of memory error come from `ctx0` used here. Although I am not familiar with the code base enough to tell if this is indeed the cause.
@hx507 hx507 mentioned this issue Mar 16, 2023
Closed
@Dannythm Dannythm mentioned this issue Mar 23, 2023
Open
@Green-Sky Green-Sky mentioned this issue Mar 23, 2023
Closed
@wafflecomposite
Copy link

Constantly hitting it with -c 2048 -n 2048
As of now, #438 actually gets it fixed.

@kmcbest kmcbest mentioned this issue May 5, 2023
Closed
Deadsg pushed a commit to Deadsg/llama.cpp that referenced this issue Dec 19, 2023
@abetlen
Merge pull request ggml-org#153 from SagsMug/main
ed0f48b 
Update low_level_api examples
@Bearsaerker Bearsaerker mentioned this issue Mar 12, 2025
Open
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
duplicate This issue or pull request already exists need more info The OP should provide more details about the issue
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

dynamic estimate of required memory usage Green-Sky/llama.cpp
4 participants
@ggerganov @gjmulder @wafflecomposite @YongeBai