com.huaweicloud.pangu.dev.sdk.cache

Class InMemoryCache

java.lang.Object

com.huaweicloud.pangu.dev.sdk.cache.InMemoryCache

All Implemented Interfaces:

Cache

public class InMemoryCache
extends Object
implements Cache

内存型Cache

Since:

2023-06-19

Constructor Summary

Constructors

Constructor and Description
InMemoryCache() 构造函数
InMemoryCache(CacheStoreConfig config) 构造函数

Method Summary

Modifier and Type	Method and Description
void	clear() 清空
LLMResp	lookup(String prompt) 查询
void	setSessionTag(String sessionTag) 设置会话标识
void	update(String prompt, LLMResp value) 更新

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

InMemoryCache

public InMemoryCache()

构造函数

InMemoryCache

public InMemoryCache(CacheStoreConfig config)

构造函数

Parameters:

config - 统一配置

Method Detail

setSessionTag

public void setSessionTag(String sessionTag)

Description copied from interface: Cache

设置会话标识

Specified by:

setSessionTag in interface Cache

Parameters:

sessionTag - 标识

lookup

public LLMResp lookup(String prompt)

查询

Specified by:

lookup in interface Cache

Parameters:

prompt - 提示词

Returns:

结果

update

public void update(String prompt,
                   LLMResp value)

更新

Specified by:

update in interface Cache

Parameters:

prompt - 提示词

value - 回答结果

clear

public void clear()

清空

Specified by:

clear in interface Cache