node-llama-cpp

Appearance

Type Alias: ResolveChatWrapperWithModelOptions ​

ts
type ResolveChatWrapperWithModelOptions = {
  type?:   | "auto"
     | SpecializedChatWrapperTypeName
     | TemplateChatWrapperTypeName;
  customWrapperSettings?: { [wrapper in keyof typeof chatWrappers]?: typeof JinjaTemplateChatWrapper extends typeof chatWrappers[wrapper] ? Partial<ConstructorParameters<typeof chatWrappers[wrapper]>[0]> : ConstructorParameters<typeof chatWrappers[wrapper]>[0] };
  warningLogs?: boolean;
  fallbackToOtherWrappersOnJinjaError?: boolean;
  noJinja?: boolean;
};

Defined in: chatWrappers/utils/resolveChatWrapper.ts:125

Properties ​

type? ​

ts
optional type: 
  | "auto"
  | SpecializedChatWrapperTypeName
  | TemplateChatWrapperTypeName;

Defined in: chatWrappers/utils/resolveChatWrapper.ts:132

Resolve to a specific chat wrapper type. You better not set this option unless you need to force a specific chat wrapper type.

Defaults to "auto".

customWrapperSettings? ​

ts
optional customWrapperSettings: { [wrapper in keyof typeof chatWrappers]?: typeof JinjaTemplateChatWrapper extends typeof chatWrappers[wrapper] ? Partial<ConstructorParameters<typeof chatWrappers[wrapper]>[0]> : ConstructorParameters<typeof chatWrappers[wrapper]>[0] };

Defined in: chatWrappers/utils/resolveChatWrapper.ts:134

warningLogs? ​

ts
optional warningLogs: boolean;

Defined in: chatWrappers/utils/resolveChatWrapper.ts:143

Defaults to true.

fallbackToOtherWrappersOnJinjaError? ​

ts
optional fallbackToOtherWrappersOnJinjaError: boolean;

Defined in: chatWrappers/utils/resolveChatWrapper.ts:148

Defaults to true.

noJinja? ​

ts
optional noJinja: boolean;

Defined in: chatWrappers/utils/resolveChatWrapper.ts:155

Don't resolve to a Jinja chat wrapper unless type is set to a Jinja chat wrapper type.

Defaults to false.