Class: LlamaModelTokens

Accessors

infill

get infill(): LlamaModelInfillTokens

Returns

LlamaModelInfillTokens

infill tokens

Defined in

evaluator/LlamaModel/LlamaModel.ts:771

---

bos

get bos(): null | Token

Returns

null | Token

The BOS (Beginning Of Sequence) token.

Defined in

evaluator/LlamaModel/LlamaModel.ts:783

---

eos

get eos(): null | Token

Returns

null | Token

The EOS (End Of Sequence) token.

Defined in

evaluator/LlamaModel/LlamaModel.ts:798

---

eot

get eot(): null | Token

Returns

null | Token

The EOT (End Of Turn) token.

Defined in

evaluator/LlamaModel/LlamaModel.ts:813

---

nl

get nl(): null | Token

Returns

null | Token

The NL (New Line) token.

Defined in

evaluator/LlamaModel/LlamaModel.ts:828

---

bosString

get bosString(): null | string

Returns

null | string

The BOS (Beginning Of Sequence) token text representation.

Defined in

evaluator/LlamaModel/LlamaModel.ts:843

---

eosString

get eosString(): null | string

Returns

null | string

The EOS (End Of Sequence) token text representation.

Defined in

evaluator/LlamaModel/LlamaModel.ts:860

---

eotString

get eotString(): null | string

Returns

null | string

The EOT (End Of Turn) token text representation.

Defined in

evaluator/LlamaModel/LlamaModel.ts:877

---

nlString

get nlString(): null | string

Returns

null | string

The NL (New Line) token text representation.

Defined in

evaluator/LlamaModel/LlamaModel.ts:894

---

shouldPrependBosToken

get shouldPrependBosToken(): boolean

Returns

boolean

Whether we should prepend a BOS (Beginning Of Sequence) token for evaluations with this model.

Defined in

evaluator/LlamaModel/LlamaModel.ts:911