llama.cpp server have built-in native tools (exec_shell, edit_file, etc.)

r/LocalLLaMA
Generative AI Open Source AI

I was messing around with running local models recently, and while digging through the llama.cpp server docs, I noticed this experimental flag just sitting right there: --tools TOOL1,TOOL2,. It natively s read_file, file_glob_search, grep_search, exec_shell_command, write_file, edit_file, apply_diff, and get_datetime. That is a battery of tools that basically turns llama-server into a mini agent harness. You really don't need anything than your trusty.gguf file and the llama.cpp binary for basic AI assistance in your projects.