com.huaweicloud.pangu.dev.sdk.api.llms

Interface LLM

All Known Implementing Classes:

AbstractLLM, Gallery, OpenAI, Pangu

public interface LLM

LLM接口

Since:

2023-05-29

Method Summary

Modifier and Type	Method and Description
<RESP extends LLMResp> RESP	ask(List<ConversationMessage> chatMessages) 多轮问答
<RESP extends LLMResp> RESP	ask(List<ConversationMessage> chatMessages, LLMParamConfig paramConfig) 多轮问答
<RESP extends LLMResp> RESP	ask(String prompt) 单轮问答
<RESP extends LLMResp> RESP	ask(String prompt, LLMParamConfig paramConfig) 单轮问答
<T> T	askForObject(String prompt, Class<T> clazz) 单轮问答
<T> T	askForObject(String prompt, LLMParamConfig paramConfig, Class<T> clazz) 单轮问答
LLMConfig	getLLMConfig() 获取当前LLM的配置
void	setCache(Cache cache) 设置缓存
void	setStreamCallback(StreamCallBack streamCallback) 设置流式接口回调函数

Method Detail

ask

<RESP extends LLMResp> RESP ask(String prompt)

单轮问答

Type Parameters:

RESP - 响应类

Parameters:

prompt - ask LLM

Returns:

LLM answer

ask

<RESP extends LLMResp> RESP ask(String prompt,
                                LLMParamConfig paramConfig)

单轮问答

Type Parameters:

RESP - 响应类

Parameters:

prompt - ask LLM

paramConfig - LLM参数配置

Returns:

LLM answer

ask

<RESP extends LLMResp> RESP ask(List<ConversationMessage> chatMessages)

多轮问答

Type Parameters:

RESP - 响应类

Parameters:

chatMessages - ask LLM

Returns:

LLM answer

ask

<RESP extends LLMResp> RESP ask(List<ConversationMessage> chatMessages,
                                LLMParamConfig paramConfig)

多轮问答

Type Parameters:

RESP - 响应类

Parameters:

chatMessages - ask LLM

paramConfig - LLM参数配置

Returns:

LLM answer

askForObject

<T> T askForObject(String prompt,
                   Class<T> clazz)

单轮问答

Type Parameters:

T - 响应类

Parameters:

prompt - ask LLM

clazz - 需要LLM转换的类型

Returns:

LLM answer

askForObject

<T> T askForObject(String prompt,
                   LLMParamConfig paramConfig,
                   Class<T> clazz)

单轮问答

Type Parameters:

T - 响应类

Parameters:

prompt - ask LLM

paramConfig - LLM参数配置

clazz - 需要LLM转换的类型

Returns:

LLM answer

setCache

void setCache(Cache cache)

设置缓存

Parameters:

cache - Cache

setStreamCallback

void setStreamCallback(StreamCallBack streamCallback)

设置流式接口回调函数

Parameters:

streamCallback - StreamCallBack

getLLMConfig

LLMConfig getLLMConfig()

获取当前LLM的配置

Returns:

LLMConfig