Appearance

Sidebar Navigation

Functions

getLlama

resolveModelFile

defineChatSessionFunction

createModelDownloader

resolveChatWrapper

tokenizeText

readGgufFileInfo

jsonDumps

appendUserMessageToChatHistory

combineModelDownloaders

getModuleVersion

Log levels

LlamaLogLevelGreaterThan

LlamaLogLevelGreaterThanOrEqual

Type guards

isGgufMetadataOfArchitectureType

isChatModelResponseFunctionCall

isLlamaText

Classes

Llama

LlamaModel

LlamaModelTokens

LlamaModelInfillTokens

LlamaContext

LlamaContextSequence

LlamaChatSession

LlamaChatSessionPromptCompletionEngine

LlamaCompletion

LlamaEmbeddingContext

LlamaEmbedding

LlamaGrammar

LlamaJsonSchemaGrammar

LlamaText

SpecialTokensText

SpecialToken

TokenBias

GgufInsights

GgufInsightsConfigurationResolver

LlamaChat

TokenMeter

TokenAttributes

ModelDownloader

ChatModelFunctionsDocumentationGenerator

LlamaGrammarEvaluationState

CombinedModelDownloader

ChatWrapper

Chat wrappers

GeneralChatWrapper

TemplateChatWrapper

JinjaTemplateChatWrapper

Llama3_1ChatWrapper

Llama3ChatWrapper

Llama2ChatWrapper

MistralChatWrapper

GemmaChatWrapper

ChatMLChatWrapper

FalconChatWrapper

AlpacaChatWrapper

FunctionaryChatWrapper

EmptyChatWrapper

Errors

NoBinaryFoundError

InsufficientMemoryError

UnsupportedError

LlamaJsonSchemaValidationError

Types

Token

Tokenizer

Detokenizer

LlamaGpuType

SpecializedChatWrapperTypeName

TemplateChatWrapperTypeName

ResolvableChatWrapperTypeName

BuiltInChatWrapperType

LlamaChatLoadAndCompleteUserResponse

LlamaCompletionResponse

LlamaContextSequenceRepeatPenalty

ContextTokensDeleteRange

EvaluationPriority

LlamaEmbeddingJSON

TokenMeterState

GgufInsightsResourceRequirements

ChatWrapperSettings

ChatWrapperGeneratedContextState

LLamaContextualRepeatPenalty

OverridesObject

LlamaClasses

ModelFileAccessTokens

GbnfJsonSchema

GbnfJsonSchemaImmutableType

GbnfJsonBasicSchema

GbnfJsonConstSchema

GbnfJsonEnumSchema

GbnfJsonOneOfSchema

GbnfJsonObjectSchema

GbnfJsonArraySchema

GbnfJsonSchemaToType

ChatHistoryItem

ChatSystemMessage

ChatUserMessage

ChatModelResponse

ChatModelFunctionCall

LlamaChatResponse

LlamaChatResponseFunctionCall

LlamaText

LlamaTextValue

LlamaTextInputValue

LlamaTextJSON

LlamaTextJSONValue

LlamaTextSpecialTokensTextJSON

LlamaTextSpecialTokenJSON

BuiltinSpecialTokenValue

GgufFileInfo

GgufTensorInfo

GgufMetadata

GgufMetadataLlmToType

GgufMetadataGeneral

GgufMetadataTokenizer

GgufMetadataDefaultArchitectureType

GgufMetadataLlmLLaMA

GgufMetadataMPT

GgufMetadataGPTNeoX

GgufMetadataGPTJ

GgufMetadataGPT2

GgufMetadataBloom

GgufMetadataFalcon

GgufMetadataMamba

Options

LlamaOptions

LastBuildOptions

LlamaChatOptions

LLamaChatGenerateResponseOptions

LLamaChatLoadAndCompleteUserMessageOptions

LLamaChatContextShiftOptions

LLamaChatCompletePromptOptions

LLamaChatPreloadPromptOptions

LLamaChatPromptCompletionEngineOptions

LlamaCompletionOptions

LlamaCompletionGenerationOptions

LlamaInfillGenerationOptions

ContextShiftOptions

LlamaEmbeddingOptions

LlamaEmbeddingContextOptions

LlamaGrammarOptions

LlamaGrammarEvaluationStateOptions

LlamaModelOptions

ChatWrapperGenerateContextStateOptions

ChatWrapperGenerateInitialHistoryOptions

ModelDownloaderOptions

CombinedModelDownloaderOptions

ResolveModelFileOptions

LlamaContextOptions

BatchingOptions

CustomBatchingDispatchSchedule

CustomBatchingPrioritizationStrategy

BatchItem

PrioritizedBatchItem

LlamaChatSessionOptions

LlamaChatSessionContextShiftOptions

ChatSessionModelFunction

LLamaChatPromptOptions

LlamaChatSessionRepeatPenalty

ChatModelFunctions

ChatSessionModelFunctions

Chat Wrapper Options

TemplateChatWrapperOptions

ChatHistoryFunctionCallMessageTemplate

ResolveChatWrapperOptions

JinjaTemplateChatWrapperOptions

JinjaTemplateChatWrapperOptionsConvertMessageFormat

Enums

LlamaLogLevel

LlamaVocabularyType

GgufArchitectureType

GgufFileType

GgufMetadataTokenizerTokenType

GgufMetadataArchitecturePoolingType

GgmlType

Variables

specializedChatWrapperTypeNames

templateChatWrapperTypeNames

resolvableChatWrapperTypeNames

chatWrappers

On this page

Class: UnsupportedError

Extends

Error

Pager

Previous pageInsufficientMemoryError

Next pageLlamaJsonSchemaValidationError