node-llama-cpp

Appearance

Class: LlamaModelTokens ​

Defined in: evaluator/LlamaModel/LlamaModel.ts:773

Accessors ​

infill ​

Get Signature ​

ts
get infill(): LlamaModelInfillTokens

Defined in: evaluator/LlamaModel/LlamaModel.ts:798

Returns ​

LlamaModelInfillTokens

infill tokens

bos ​

Get Signature ​

ts
get bos(): null | Token

Defined in: evaluator/LlamaModel/LlamaModel.ts:810

Returns ​

null | Token

The BOS (Beginning Of Sequence) token.

eos ​

Get Signature ​

ts
get eos(): null | Token

Defined in: evaluator/LlamaModel/LlamaModel.ts:825

Returns ​

null | Token

The EOS (End Of Sequence) token.

eot ​

Get Signature ​

ts
get eot(): null | Token

Defined in: evaluator/LlamaModel/LlamaModel.ts:840

Returns ​

null | Token

The EOT (End Of Turn) token.

sep ​

Get Signature ​

ts
get sep(): null | Token

Defined in: evaluator/LlamaModel/LlamaModel.ts:855

Returns ​

null | Token

The SEP (Sentence Separator) token.

nl ​

Get Signature ​

ts
get nl(): null | Token

Defined in: evaluator/LlamaModel/LlamaModel.ts:870

Returns ​

null | Token

The NL (New Line) token.

bosString ​

Get Signature ​

ts
get bosString(): null | string

Defined in: evaluator/LlamaModel/LlamaModel.ts:885

Returns ​

null | string

The BOS (Beginning Of Sequence) token text representation.

eosString ​

Get Signature ​

ts
get eosString(): null | string

Defined in: evaluator/LlamaModel/LlamaModel.ts:902

Returns ​

null | string

The EOS (End Of Sequence) token text representation.

eotString ​

Get Signature ​

ts
get eotString(): null | string

Defined in: evaluator/LlamaModel/LlamaModel.ts:919

Returns ​

null | string

The EOT (End Of Turn) token text representation.

sepString ​

Get Signature ​

ts
get sepString(): null | string

Defined in: evaluator/LlamaModel/LlamaModel.ts:936

Returns ​

null | string

The SEP (Sentence Separator) token text representation.

nlString ​

Get Signature ​

ts
get nlString(): null | string

Defined in: evaluator/LlamaModel/LlamaModel.ts:953

Returns ​

null | string

The NL (New Line) token text representation.

shouldPrependBosToken ​

Get Signature ​

ts
get shouldPrependBosToken(): boolean

Defined in: evaluator/LlamaModel/LlamaModel.ts:970

Returns ​

boolean

Whether we should prepend a BOS (Beginning Of Sequence) token for evaluations with this model.

shouldAppendEosToken ​

Get Signature ​

ts
get shouldAppendEosToken(): boolean

Defined in: evaluator/LlamaModel/LlamaModel.ts:982

Returns ​

boolean

Whether we should append an EOS (End Of Sequence) token for evaluations with this model.