Skip to main content

LLM

The

LLM module facilitates creation of Large Language Models and Agents into Templates.

Example

 const price = new SourceBuilder("price")
.value({ value: 5 });

const message = new SourceBuilder("message",)
.writeable(AssistantInputStateType);

const sales = new SourceBuilder("sales")
.writeable(DictType(
StringType,
StructType({
date: DateTimeType,
item: StringType,
qty: IntegerType,
inventory: IntegerType,
price: FloatType,
amount: FloatType,
}))
)

const model = new SourceBuilder("model",)
.value({ value: variant('gpt-3.5-turbo-1106', null), type: LLMModelType });

const assistant = new LLMBuilder("assistant")
.input({ name: "sales", stream: sales.outputStream() })
.input({ name: "message", stream: message.outputStream() })
.input({ name: "model", stream: model.outputStream() })
.input({ name: "price", stream: price.outputStream() })
.assistant({
api_key: "...",
purpose: "You are a business analyst assistant",
prompt: (inputs) => inputs.message,
model: (inputs) => inputs.model,
})
.chart(
"chart_sales_data",
`Read, aggregate and chart the sales data`,
sales_data.outputStream(),
)

Classes

  • LLMAssistantBuilder
  • LLMBuilder

On this page