Class: LlamaEmbeddingContext

Defined in: evaluator/LlamaEmbeddingContext.ts:52

See

Using Embedding tutorial

Properties

onDispose

readonly onDispose: EventRelay<void>;

Defined in: evaluator/LlamaEmbeddingContext.ts:57

Accessors

disposed

Get Signature

get disposed(): boolean;

Defined in: evaluator/LlamaEmbeddingContext.ts:132

Returns

boolean

---

model

Get Signature

get model(): LlamaModel;

Defined in: evaluator/LlamaEmbeddingContext.ts:136

Returns

LlamaModel

Methods

getEmbeddingFor()

getEmbeddingFor(input: 
  | string
  | LlamaText
  | Token[]): Promise<LlamaEmbedding>;

Defined in: evaluator/LlamaEmbeddingContext.ts:78

Parameters

Parameter	Type
input	| string | LlamaText | Token[]

Returns

Promise<LlamaEmbedding>

---

calculateInputLength()

calculateInputLength(input: 
  | string
  | LlamaText
  | Token[]): number;

Defined in: evaluator/LlamaEmbeddingContext.ts:116

Calculate the evaluation tokens length for a given input so you can determine whether it fits in the context size

Parameters

Parameter	Type
input	| string | LlamaText | Token[]

Returns

number

---

dispose()

dispose(): Promise<void>;

Defined in: evaluator/LlamaEmbeddingContext.ts:123

Returns

Promise<void>