node-llama-cpp

Appearance

Class: LlamaModelTokens ​

Defined in: evaluator/LlamaModel/LlamaModel.ts:1006

Accessors ​

infill ​

Get Signature ​

ts
get infill(): LlamaModelInfillTokens;

Defined in: evaluator/LlamaModel/LlamaModel.ts:1031

Returns ​

LlamaModelInfillTokens

infill tokens

bos ​

Get Signature ​

ts
get bos(): Token | null;

Defined in: evaluator/LlamaModel/LlamaModel.ts:1043

Returns ​

Token | null

The BOS (Beginning Of Sequence) token.

eos ​

Get Signature ​

ts
get eos(): Token | null;

Defined in: evaluator/LlamaModel/LlamaModel.ts:1058

Returns ​

Token | null

The EOS (End Of Sequence) token.

eot ​

Get Signature ​

ts
get eot(): Token | null;

Defined in: evaluator/LlamaModel/LlamaModel.ts:1073

Returns ​

Token | null

The EOT (End Of Turn) token.

sep ​

Get Signature ​

ts
get sep(): Token | null;

Defined in: evaluator/LlamaModel/LlamaModel.ts:1088

Returns ​

Token | null

The SEP (Sentence Separator) token.

nl ​

Get Signature ​

ts
get nl(): Token | null;

Defined in: evaluator/LlamaModel/LlamaModel.ts:1103

Returns ​

Token | null

The NL (New Line) token.

bosString ​

Get Signature ​

ts
get bosString(): string | null;

Defined in: evaluator/LlamaModel/LlamaModel.ts:1118

Returns ​

string | null

The BOS (Beginning Of Sequence) token text representation.

eosString ​

Get Signature ​

ts
get eosString(): string | null;

Defined in: evaluator/LlamaModel/LlamaModel.ts:1135

Returns ​

string | null

The EOS (End Of Sequence) token text representation.

eotString ​

Get Signature ​

ts
get eotString(): string | null;

Defined in: evaluator/LlamaModel/LlamaModel.ts:1152

Returns ​

string | null

The EOT (End Of Turn) token text representation.

sepString ​

Get Signature ​

ts
get sepString(): string | null;

Defined in: evaluator/LlamaModel/LlamaModel.ts:1169

Returns ​

string | null

The SEP (Sentence Separator) token text representation.

nlString ​

Get Signature ​

ts
get nlString(): string | null;

Defined in: evaluator/LlamaModel/LlamaModel.ts:1186

Returns ​

string | null

The NL (New Line) token text representation.

shouldPrependBosToken ​

Get Signature ​

ts
get shouldPrependBosToken(): boolean;

Defined in: evaluator/LlamaModel/LlamaModel.ts:1203

Returns ​

boolean

Whether we should prepend a BOS (Beginning Of Sequence) token for evaluations with this model.

shouldAppendEosToken ​

Get Signature ​

ts
get shouldAppendEosToken(): boolean;

Defined in: evaluator/LlamaModel/LlamaModel.ts:1215

Returns ​

boolean

Whether we should append an EOS (End Of Sequence) token for evaluations with this model.