| Modifier and Type | Method and Description |
|---|---|
void |
AbstractAgent.StreamAgentLlmCallBack.onNewToken(String callBackId,
LLMResp llmResp) |
| Modifier and Type | Method and Description |
|---|---|
default void |
StreamCallBack.onEnd(String callBackId,
StreamResult streamResult,
LLMResp llmResp)
结束调用,LLM流式调用结束后回调
|
default void |
StreamCallBack.onNewToken(String callBackId,
LLMResp llmResp)
LLM流式调用返回新的结果时回调
|
| Modifier and Type | Method and Description |
|---|---|
<RESP extends LLMResp> |
LLM.ask(List<ConversationMessage> chatMessages)
多轮问答
|
<RESP extends LLMResp> |
LLM.ask(List<ConversationMessage> chatMessages,
LLMParamConfig paramConfig)
多轮问答
|
<RESP extends LLMResp> |
LLM.ask(String prompt)
单轮问答
|
<RESP extends LLMResp> |
LLM.ask(String prompt,
LLMParamConfig paramConfig)
单轮问答
|
| Modifier and Type | Method and Description |
|---|---|
LLMResp |
Cache.lookup(String prompt)
查询
|
| Modifier and Type | Method and Description |
|---|---|
void |
Cache.update(String prompt,
LLMResp value)
更新
|
| Modifier and Type | Method and Description |
|---|---|
LLMResp |
InMemoryCache.lookup(String prompt)
查询
|
LLMResp |
SqlCache.lookup(String prompt) |
LLMResp |
RedisCache.lookup(String prompt)
查找缓存
|
LLMResp |
VectorSemanticCache.lookup(String prompt)
查询
|
| Modifier and Type | Method and Description |
|---|---|
void |
InMemoryCache.update(String prompt,
LLMResp value)
更新
|
void |
SqlCache.update(String prompt,
LLMResp value) |
void |
RedisCache.update(String prompt,
LLMResp value)
更新缓存
|
void |
VectorSemanticCache.update(String prompt,
LLMResp value)
更新
|
| Modifier and Type | Class and Description |
|---|---|
class |
AbstractLLM<RESP extends LLMResp>
LLM基本接口抽象类
|
| Modifier and Type | Method and Description |
|---|---|
<RESP extends LLMResp> |
AbstractLLM.ask(List<ConversationMessage> chatMessages) |
<RESP extends LLMResp> |
AbstractLLM.ask(List<ConversationMessage> chatMessages,
LLMParamConfig paramConfig) |
| Modifier and Type | Class and Description |
|---|---|
class |
LLMRespGallery
Gallery返回
|
class |
LLMRespOpenAI
OpenAI返回
|
class |
LLMRespPangu
pangu返回
|
Copyright © 2024. All rights reserved.