llama-cpp-python Log printing on Ubuntu

Question

I use llama-cpp-python to run LLMs locally on Ubuntu. While generating responses it prints its logs.

How to stop printing of logs??

I found a way to stop log printing for llama.cpp but not for llama-cpp-python. I just want to print the generated response.

this worked for me: github.com/abetlen/llama-cpp-python/issues/… — user3647558
– user3647558, Commented Feb 1, 2024 at 22:35

Ranul Navojith Dayarathne · Accepted Answer · 2024-04-14 18:44:07Z

3

You can stop printing logs by setting verbose=False

An example is as follows:

from langchain_community.llms import LlamaCpp

llm = LlamaCpp(
model_path="app/resources/llama-7b-chat-q4/llama-2-7b-chat.Q4_0.gguf",
temperature=0.01,
top_p=1,
verbose=False 
)

answered Apr 14, 2024 at 18:44

Ranul Navojith Dayarathne

596 bronze badges

Sign up to request clarification or add additional context in comments.

Collectives™ on Stack Overflow

llama-cpp-python Log printing on Ubuntu

1 Answer 1

Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

Comments

Your Answer

Sign up or log in

Post as a guest

Related