Skip to content

CLI

Usage

shell
npx --no node-llama-cpp <command> [options]

Commands

Command Description
node-llama-cpp pull [urls..]
Download models from URLs
node-llama-cpp chat [modelPath]
Chat with a model
node-llama-cpp init [name]
Generate a new node-llama-cpp project from a template
node-llama-cpp complete [modelPath]
Generate a completion for a given text
node-llama-cpp infill [modelPath]
Generate an infill completion for a given suffix and prefix texts
node-llama-cpp inspect <command>
Inspect the inner workings of node-llama-cpp
node-llama-cpp source <command>
Manage llama.cpp source code

Options

Command Description
-h, --help Show help
-v, --version Show version number