Class: LlamaModelTokens
Defined in: evaluator/LlamaModel/LlamaModel.ts:777
Accessors
infill
Get Signature
get infill(): LlamaModelInfillTokens
Defined in: evaluator/LlamaModel/LlamaModel.ts:802
Returns
infill tokens
bos
Get Signature
get bos(): null | Token
Defined in: evaluator/LlamaModel/LlamaModel.ts:814
Returns
null
| Token
The BOS (Beginning Of Sequence) token.
eos
Get Signature
get eos(): null | Token
Defined in: evaluator/LlamaModel/LlamaModel.ts:829
Returns
null
| Token
The EOS (End Of Sequence) token.
eot
Get Signature
get eot(): null | Token
Defined in: evaluator/LlamaModel/LlamaModel.ts:844
Returns
null
| Token
The EOT (End Of Turn) token.
sep
Get Signature
get sep(): null | Token
Defined in: evaluator/LlamaModel/LlamaModel.ts:859
Returns
null
| Token
The SEP (Sentence Separator) token.
nl
Get Signature
get nl(): null | Token
Defined in: evaluator/LlamaModel/LlamaModel.ts:874
Returns
null
| Token
The NL (New Line) token.
bosString
Get Signature
get bosString(): null | string
Defined in: evaluator/LlamaModel/LlamaModel.ts:889
Returns
null
| string
The BOS (Beginning Of Sequence) token text representation.
eosString
Get Signature
get eosString(): null | string
Defined in: evaluator/LlamaModel/LlamaModel.ts:906
Returns
null
| string
The EOS (End Of Sequence) token text representation.
eotString
Get Signature
get eotString(): null | string
Defined in: evaluator/LlamaModel/LlamaModel.ts:923
Returns
null
| string
The EOT (End Of Turn) token text representation.
sepString
Get Signature
get sepString(): null | string
Defined in: evaluator/LlamaModel/LlamaModel.ts:940
Returns
null
| string
The SEP (Sentence Separator) token text representation.
nlString
Get Signature
get nlString(): null | string
Defined in: evaluator/LlamaModel/LlamaModel.ts:957
Returns
null
| string
The NL (New Line) token text representation.
shouldPrependBosToken
Get Signature
get shouldPrependBosToken(): boolean
Defined in: evaluator/LlamaModel/LlamaModel.ts:974
Returns
boolean
Whether we should prepend a BOS (Beginning Of Sequence) token for evaluations with this model.
shouldAppendEosToken
Get Signature
get shouldAppendEosToken(): boolean
Defined in: evaluator/LlamaModel/LlamaModel.ts:986
Returns
boolean
Whether we should append an EOS (End Of Sequence) token for evaluations with this model.