Input to OpenAI class.

interface OpenAIInput {
    batchSize: number;
    frequencyPenalty: number;
    model: string;
    modelName: string;
    n: number;
    presencePenalty: number;
    streaming: boolean;
    temperature: number;
    topP: number;
    apiKey?: string;
    bestOf?: number;
    logitBias?: Record<string, number>;
    maxTokens?: number;
    modelKwargs?: Record<string, any>;
    openAIApiKey?: string;
    stop?: string[];
    stopSequences?: string[];
    streamUsage?: boolean;
    timeout?: number;
    user?: string;
}

Hierarchy (view full)

Implemented by

Properties

batchSize: number

Batch size to use when passing multiple documents to generate

frequencyPenalty: number

Penalizes repeated tokens according to frequency

model: string

Model name to use

modelName: string

Model name to use Alias for model

n: number

Number of completions to generate for each prompt

presencePenalty: number

Penalizes repeated tokens

streaming: boolean

Whether to stream the results or not. Enabling disables tokenUsage reporting

temperature: number

Sampling temperature to use

topP: number

Total probability mass of tokens to consider at each step

apiKey?: string

API key to use when making requests to OpenAI. Defaults to the value of OPENAI_API_KEY environment variable.

bestOf?: number

Generates bestOf completions server side and returns the "best"

logitBias?: Record<string, number>

Dictionary used to adjust the probability of specific tokens being generated

maxTokens?: number

Maximum number of tokens to generate in the completion. -1 returns as many tokens as possible given the prompt and the model's maximum context size.

modelKwargs?: Record<string, any>

Holds any additional parameters that are valid to pass to openai.createCompletion that are not explicitly specified on this class.

openAIApiKey?: string

API key to use when making requests to OpenAI. Defaults to the value of OPENAI_API_KEY environment variable. Alias for apiKey

stop?: string[]

List of stop words to use when generating Alias for stopSequences

stopSequences?: string[]

List of stop words to use when generating

streamUsage?: boolean

Whether or not to include token usage data in streamed chunks.

true
timeout?: number

Timeout to use when making requests to OpenAI.

user?: string

Unique string identifier representing your end-user, which can help OpenAI to monitor and detect abuse.

""