Class: LlamaGrammar

Extended by

• LlamaJsonSchemaGrammar

Constructors

new LlamaGrammar()

new LlamaGrammar(llama: Llama, options: LlamaGrammarOptions): LlamaGrammar

GBNF files are supported. More info here: github:ggerganov/llama.cpp:grammars/README.md

Parameters

Parameter	Type	Description
llama	Llama
options	LlamaGrammarOptions

Returns

LlamaGrammar

Defined in

evaluator/LlamaGrammar.ts:44

Accessors

grammar

get grammar(): string

Returns

string

Defined in

evaluator/LlamaGrammar.ts:58

---

rootRuleName

get rootRuleName(): string

Returns

string

Defined in

evaluator/LlamaGrammar.ts:62

---

stopGenerationTriggers

get stopGenerationTriggers(): readonly (string | LlamaText | readonly (string | Token)[])[]

Returns

readonly (string | LlamaText | readonly (string | Token)[])[]

Defined in

evaluator/LlamaGrammar.ts:66

---

trimWhitespaceSuffix

get trimWhitespaceSuffix(): boolean

Returns

boolean

Defined in

evaluator/LlamaGrammar.ts:70

Methods

getFor()

static getFor(llama: Llama, type: 
  | "json"
  | "json_arr"
  | "list"
  | "c"
  | "arithmetic"
  | "japanese"
  | "chess"): Promise<LlamaGrammar>

Parameters

Parameter	Type
llama	Llama
type	| "json" | "json_arr" | "list" | "c" | "arithmetic" | "japanese" | "chess"

Returns

Promise<LlamaGrammar>

Defined in

evaluator/LlamaGrammar.ts:74