node-llama-cpp

Appearance

Type Alias: ResolveChatWrapperWithModelOptions ​

ts
type ResolveChatWrapperWithModelOptions = {
  type:   | "auto"
     | SpecializedChatWrapperTypeName
     | TemplateChatWrapperTypeName;
  customWrapperSettings: { [wrapper in keyof typeof chatWrappers]?: typeof JinjaTemplateChatWrapper extends typeof chatWrappers[wrapper] ? Partial<ConstructorParameters<typeof chatWrappers[wrapper]>[0]> : ConstructorParameters<typeof chatWrappers[wrapper]>[0] };
  warningLogs: boolean;
  fallbackToOtherWrappersOnJinjaError: boolean;
  noJinja: boolean;
};

Defined in: chatWrappers/utils/resolveChatWrapper.ts:105

Properties ​

type? ​

ts
optional type: 
  | "auto"
  | SpecializedChatWrapperTypeName
  | TemplateChatWrapperTypeName;

Defined in: chatWrappers/utils/resolveChatWrapper.ts:112

Resolve to a specific chat wrapper type. You better not set this option unless you need to force a specific chat wrapper type.

Defaults to "auto".

customWrapperSettings? ​

ts
optional customWrapperSettings: { [wrapper in keyof typeof chatWrappers]?: typeof JinjaTemplateChatWrapper extends typeof chatWrappers[wrapper] ? Partial<ConstructorParameters<typeof chatWrappers[wrapper]>[0]> : ConstructorParameters<typeof chatWrappers[wrapper]>[0] };

Defined in: chatWrappers/utils/resolveChatWrapper.ts:114

warningLogs? ​

ts
optional warningLogs: boolean;

Defined in: chatWrappers/utils/resolveChatWrapper.ts:123

Defaults to true.

fallbackToOtherWrappersOnJinjaError? ​

ts
optional fallbackToOtherWrappersOnJinjaError: boolean;

Defined in: chatWrappers/utils/resolveChatWrapper.ts:128

Defaults to true.

noJinja? ​

ts
optional noJinja: boolean;

Defined in: chatWrappers/utils/resolveChatWrapper.ts:135

Don't resolve to a Jinja chat wrapper unless type is set to a Jinja chat wrapper type.

Defaults to false.