node-llama-cpp

Appearance

Type Alias: TemplateChatWrapperSegmentsOptions ​

ts
type TemplateChatWrapperSegmentsOptions = {
  thoughtTemplate: `${string}${string}`;
  reopenThoughtAfterFunctionCalls: boolean;
  closeAllSegmentsTemplate: string;
  reiterateStackAfterFunctionCalls: boolean;
};

Defined in: chatWrappers/generic/utils/templateSegmentOptionsToChatWrapperSettings.ts:39

Properties ​

thoughtTemplate? ​

ts
optional thoughtTemplate: `${string}${string}`;

Defined in: chatWrappers/generic/utils/templateSegmentOptionsToChatWrapperSettings.ts:41

Template for a thought segment

reopenThoughtAfterFunctionCalls? ​

ts
optional reopenThoughtAfterFunctionCalls: boolean;

Defined in: chatWrappers/generic/utils/templateSegmentOptionsToChatWrapperSettings.ts:50

Automatically reopen a thought segment after function calls.

Useful for aligning the output of models that assume that a thought segment is already open after function calls.

Defaults to false.

closeAllSegmentsTemplate? ​

ts
optional closeAllSegmentsTemplate: string;

Defined in: chatWrappers/generic/utils/templateSegmentOptionsToChatWrapperSettings.ts:53

Consider all segments to be closed when this text is detected

reiterateStackAfterFunctionCalls? ​

ts
optional reiterateStackAfterFunctionCalls: boolean;

Defined in: chatWrappers/generic/utils/templateSegmentOptionsToChatWrapperSettings.ts:60

After function calls, reiterate the stack of the active segments to remind the model of the context.

Defaults to false.