inspect command

Inspect the inner workings of node-llama-cpp

Usage

npx --no node-llama-cpp inspect <command>

Commands

Command	Description
node-llama-cpp inspect gpu	Show the detected GPU types and their VRAM usage
node-llama-cpp inspect gguf [modelPath]	Inspect a GGUF file
node-llama-cpp inspect measure [modelPath]	Measure VRAM consumption of a GGUF model file with all possible combinations of gpu layers and context sizes
node-llama-cpp inspect estimate [modelPath]	Estimate the compatibility of a model with the current hardware

Options

Option	Description
-h, --help	Show help
-v, --version	Show version number