com.huaweicloud.pangu.dev.sdk.cache

Class VectorSemanticCache

java.lang.Object

com.huaweicloud.pangu.dev.sdk.cache.VectorSemanticCache

All Implemented Interfaces:

Cache

public class VectorSemanticCache
extends Object
implements Cache

基于向量库的语义缓存

Since:

2023-06-25

Field Summary

Fields

Modifier and Type	Field and Description
static String	PROMPT_KEY 向量库存储需要做embedding的key名，即prompt

Constructor Summary

Constructors

Constructor and Description
VectorSemanticCache(CacheStoreConfig config) 初始化实例

Method Summary

Modifier and Type	Method and Description
void	clear() 清空缓存
LLMResp	lookup(String prompt) 查询
void	setSessionTag(String sessionTag) 设置会话标识
void	update(String prompt, LLMResp value) 更新

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

PROMPT_KEY

public static final String PROMPT_KEY

向量库存储需要做embedding的key名，即prompt

See Also:

Constant Field Values

Constructor Detail

VectorSemanticCache

public VectorSemanticCache(CacheStoreConfig config)

初始化实例

Parameters:

config - 参数配置

Method Detail

setSessionTag

public void setSessionTag(String sessionTag)

Description copied from interface: Cache

设置会话标识

Specified by:

setSessionTag in interface Cache

Parameters:

sessionTag - 标识

lookup

public LLMResp lookup(String prompt)

查询

Specified by:

lookup in interface Cache

Parameters:

prompt - 提示词

Returns:

缓存的值

update

public void update(String prompt,
                   LLMResp value)

更新

Specified by:

update in interface Cache

Parameters:

prompt - 提示词

value - 待缓存的值

clear

public void clear()

清空缓存

Specified by:

clear in interface Cache