com.huaweicloud.pangu.dev.sdk.llms.module

Class AbstractLLM<RESP extends LLMResp>

java.lang.Object

com.huaweicloud.pangu.dev.sdk.llms.module.AbstractLLM<RESP>

All Implemented Interfaces:

LLM

Direct Known Subclasses:

Gallery, OpenAI, Pangu

public abstract class AbstractLLM<RESP extends LLMResp>
extends Object
implements LLM

LLM基本接口抽象类

Since:

2023-05-30

Field Summary

Fields

Modifier and Type	Field and Description
protected LLMConfig	llmConfig
protected StreamCallBack	streamCallBack

Constructor Summary

Constructors

Constructor and Description
AbstractLLM(LLMConfig llmConfig) 初始化

Method Summary

Modifier and Type	Method and Description
<RESP extends LLMResp> RESP	ask(List<ConversationMessage> chatMessages) 多轮问答
<RESP extends LLMResp> RESP	ask(List<ConversationMessage> chatMessages, LLMParamConfig paramConfig) 多轮问答
RESP	ask(String prompt) 单轮问答
RESP	ask(String prompt, LLMParamConfig paramConfig) 单轮问答
<T> T	askForObject(String prompt, Class<T> clazz) 单轮问答
<T> T	askForObject(String prompt, LLMParamConfig paramConfig, Class<T> clazz) 单轮问答
protected String	getExistPrompt(String prompt) 从缓存中查找
LLMConfig	getLLMConfig() 获取当前LLM的配置
protected abstract RESP	getLLMResponse(List<ConversationMessage> chatMessages, LLMParamConfig llmParamConfig) 调用chat接口
protected abstract RESP	getLLMResponseFromCache(String cache) 从缓存获取结果
protected boolean	needAddNewSystemMessage()
void	setCache(Cache cache) 设置缓存
void	setStreamCallback(StreamCallBack streamCallback) 设置流式接口回调函数

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

llmConfig

protected LLMConfig llmConfig

streamCallBack

protected StreamCallBack streamCallBack

Constructor Detail

AbstractLLM

public AbstractLLM(LLMConfig llmConfig)

初始化

Parameters:

llmConfig - llm参数配置

Method Detail

getLLMResponse

protected abstract RESP getLLMResponse(List<ConversationMessage> chatMessages,
                                       LLMParamConfig llmParamConfig)

调用chat接口

Parameters:

chatMessages - LLM模型输入

llmParamConfig - 模型参数配置

Returns:

LLM模型返回

getLLMResponseFromCache

protected abstract RESP getLLMResponseFromCache(String cache)

从缓存获取结果

Parameters:

cache - 缓存

Returns:

LLM模型返回

setCache

public void setCache(Cache cache)

Description copied from interface: LLM

设置缓存

Specified by:

setCache in interface LLM

Parameters:

cache - Cache

setStreamCallback

public void setStreamCallback(StreamCallBack streamCallback)

Description copied from interface: LLM

设置流式接口回调函数

Specified by:

setStreamCallback in interface LLM

Parameters:

streamCallback - StreamCallBack

getLLMConfig

public LLMConfig getLLMConfig()

Description copied from interface: LLM

获取当前LLM的配置

Specified by:

getLLMConfig in interface LLM

Returns:

LLMConfig

getExistPrompt

protected String getExistPrompt(String prompt)

从缓存中查找

Parameters:

prompt - prompt

Returns:

cache

ask

public RESP ask(String prompt)

Description copied from interface: LLM

单轮问答

Specified by:

ask in interface LLM

Parameters:

prompt - ask LLM

Returns:

LLM answer

ask

public RESP ask(String prompt,
                LLMParamConfig paramConfig)

Description copied from interface: LLM

单轮问答

Specified by:

ask in interface LLM

Parameters:

prompt - ask LLM

paramConfig - LLM参数配置

Returns:

LLM answer

ask

public <RESP extends LLMResp> RESP ask(List<ConversationMessage> chatMessages)

Description copied from interface: LLM

多轮问答

Specified by:

ask in interface LLM

Type Parameters:

RESP - 响应类

Parameters:

chatMessages - ask LLM

Returns:

LLM answer

ask

public <RESP extends LLMResp> RESP ask(List<ConversationMessage> chatMessages,
                                       LLMParamConfig paramConfig)

Description copied from interface: LLM

多轮问答

Specified by:

ask in interface LLM

Type Parameters:

RESP - 响应类

Parameters:

chatMessages - ask LLM

paramConfig - LLM参数配置

Returns:

LLM answer

askForObject

public <T> T askForObject(String prompt,
                          Class<T> clazz)

Description copied from interface: LLM

单轮问答

Specified by:

askForObject in interface LLM

Type Parameters:

T - 响应类

Parameters:

prompt - ask LLM

clazz - 需要LLM转换的类型

Returns:

LLM answer

askForObject

public <T> T askForObject(String prompt,
                          LLMParamConfig paramConfig,
                          Class<T> clazz)

Description copied from interface: LLM

单轮问答

Specified by:

askForObject in interface LLM

Type Parameters:

T - 响应类

Parameters:

prompt - ask LLM

paramConfig - LLM参数配置

clazz - 需要LLM转换的类型

Returns:

LLM answer

needAddNewSystemMessage

protected boolean needAddNewSystemMessage()