Skip to content

Class: LlamaModelTokens

Defined in: evaluator/LlamaModel/LlamaModel.ts:777

Accessors

infill

Get Signature

ts
get infill(): LlamaModelInfillTokens

Defined in: evaluator/LlamaModel/LlamaModel.ts:802

Returns

LlamaModelInfillTokens

infill tokens


bos

Get Signature

ts
get bos(): null | Token

Defined in: evaluator/LlamaModel/LlamaModel.ts:814

Returns

null | Token

The BOS (Beginning Of Sequence) token.


eos

Get Signature

ts
get eos(): null | Token

Defined in: evaluator/LlamaModel/LlamaModel.ts:829

Returns

null | Token

The EOS (End Of Sequence) token.


eot

Get Signature

ts
get eot(): null | Token

Defined in: evaluator/LlamaModel/LlamaModel.ts:844

Returns

null | Token

The EOT (End Of Turn) token.


sep

Get Signature

ts
get sep(): null | Token

Defined in: evaluator/LlamaModel/LlamaModel.ts:859

Returns

null | Token

The SEP (Sentence Separator) token.


nl

Get Signature

ts
get nl(): null | Token

Defined in: evaluator/LlamaModel/LlamaModel.ts:874

Returns

null | Token

The NL (New Line) token.


bosString

Get Signature

ts
get bosString(): null | string

Defined in: evaluator/LlamaModel/LlamaModel.ts:889

Returns

null | string

The BOS (Beginning Of Sequence) token text representation.


eosString

Get Signature

ts
get eosString(): null | string

Defined in: evaluator/LlamaModel/LlamaModel.ts:906

Returns

null | string

The EOS (End Of Sequence) token text representation.


eotString

Get Signature

ts
get eotString(): null | string

Defined in: evaluator/LlamaModel/LlamaModel.ts:923

Returns

null | string

The EOT (End Of Turn) token text representation.


sepString

Get Signature

ts
get sepString(): null | string

Defined in: evaluator/LlamaModel/LlamaModel.ts:940

Returns

null | string

The SEP (Sentence Separator) token text representation.


nlString

Get Signature

ts
get nlString(): null | string

Defined in: evaluator/LlamaModel/LlamaModel.ts:957

Returns

null | string

The NL (New Line) token text representation.


shouldPrependBosToken

Get Signature

ts
get shouldPrependBosToken(): boolean

Defined in: evaluator/LlamaModel/LlamaModel.ts:974

Returns

boolean

Whether we should prepend a BOS (Beginning Of Sequence) token for evaluations with this model.


shouldAppendEosToken

Get Signature

ts
get shouldAppendEosToken(): boolean

Defined in: evaluator/LlamaModel/LlamaModel.ts:986

Returns

boolean

Whether we should append an EOS (End Of Sequence) token for evaluations with this model.