f624971613
* chore(core.utils): 🚨 修正错误Lint
* chore(core.provider): 🚨 修复基类错误Lint
* chore(core.utils): 补全session_get()的重载
* chore(core.provider): 🚨 修正实现错误Lint
* chore(core.platform): 🚨 修正platform基类和webchat的错误Lint
* chore(core.platform): 修正错误实现Lint
* fix(core.provider): 修复循环调用和错误assert
* chore(core.platform): 修复部分实现Lint
* chore(core.provider): 补充Dify.text_chat_stream的参数类型
* chore(core.pipeline): 🚨 修复错误Lint
* fix(core.slack): 补充遗漏导入
* chore(core.utils): 修复错误的session_get声明
* chore(core.platform): 移除Lark adapter import中的wildcard
* chore(core.db): 修复声明和部分逻辑
* chore(core.db): 添加typings,使faiss参数能被正确识别。
* chore(core): 修复声明
* chore(core): 修改声明
* chore: 补充faiss声明
* chore(dashboard): 修改实现,减少报错
* chore(package): 修改部分声明与实现,减少报错
* chore(core): 添加Handler的overload,以去除部分assert同时通过类型检查
* chore(core.pipeline): 修改Pipeline Scheduler的execute,将判断属性改为判断类型,通过静态类型检查
* chore(core.config): 添加类型标注,通过类型检查
* chore(core.message): 为File._download_file添加检查,通过类型检查
* fix: 将断言改为条件判断以实现优雅关闭的容错性
* refactor: 移除 discord 客户端中的 assert,改用 if None 判断并抛出异常
Co-authored-by: aider (openai/gemini-3-pro-high) <aider@aider.chat>
* fix: DiscordPlatformAdapter 对 self.client.user 为 None 做日志并返回,移除断言
Co-authored-by: aider (openai/gemini-3-pro-high) <aider@aider.chat>
* fix: 增强 Lark 相关空值/异常检查并完善日志输出
Co-authored-by: aider (openai/gemini-3-pro-high) <aider@aider.chat>
* refactor: 将断言替换为条件检查并加入日志与错误处理
Co-authored-by: aider (openai/gemini-3-pro-high) <aider@aider.chat>
* chore: 移除LLM生成的无用注释
* refactor: 使用 File.get_file 替换下载逻辑并移除 assert,提供默认 filename
Co-authored-by: aider (openai/gemini-3-pro-high) <aider@aider.chat>
* fix: Slack Socket 未初始化抛出运行时异常,图片 URL 判空改为非空判断
* refactor: 将 WeChatPadProAdapter 的断言改为空值判断并添加日志
* refactor: 使用 isinstance 替代断言实现类型判断,便于静态检查
Co-authored-by: aider (openai/gemini-3-pro-high) <aider@aider.chat>
* fix: 去除cast,直接使用字段与字典访问,修正端口解析
Co-authored-by: aider (openai/gemini-3-pro-high) <aider@aider.chat>
* refactor: 使用 match-case 重构 ProviderManager 加载并通过类型检查抛出 TypeError
Co-authored-by: aider (openai/gemini-3-pro-high) <aider@aider.chat>
* fix: group_name_display 时若 group 对象为空则记录错误并返回
* fix: 将 _get_current_persona_id 的 assert 替换成 if guard 并返回 None
Co-authored-by: aider (openai/gemini-3-pro-high) <aider@aider.chat>
* fix: 优化插件目录存在性检查及图片URL非空验证,更新JSON排序配置
* fix: 将 datetime_str 的 assert 替换为显式检查并抛出异常
Co-authored-by: aider (openai/gemini-3-pro-high) <aider@aider.chat>
* refactor: 移除 cast,改为运行时检查并在找不到调度器时跳过
Co-authored-by: aider (openai/gemini-3-pro-high) <aider@aider.chat>
* refactor: 移除 cast,改用 isinstance 检查 FaissVecDB 并警告
Co-authored-by: aider (openai/gemini-3-pro-high) <aider@aider.chat>
* fix: 删除 typing.cast 导入,并在获取文件绝对路径前校验 file_
* refactor: 移除 typing.cast,简化内容安全检查调用
Co-authored-by: aider (openai/gemini-3-pro-high) <aider@aider.chat>
* refactor: 将 PlatformMetadata.id 设为必填并在注册时传入 id,移除 cast
* refactor: 移除 cast,改用 HasInitialize 与 isinstance 进行初始化
Co-authored-by: aider (openai/gemini-3-pro-high) <aider@aider.chat>
* fix: 为 ProviderManager.initialize 增加ID类型判断,避免 None 导致 get 失败
Co-authored-by: aider (openai/gemini-3-pro-high) <aider@aider.chat>
* refactor: 为 OTTSProvider 与 AzureNativeProvider 引入 _client 与 client 属性改进上下文管理
Co-authored-by: aider (openai/gemini-3-pro-high) <aider@aider.chat>
* fix: 为 Whisper 自托管源添加模型未初始化校验并直接调用 transcribe
Co-authored-by: aider (openai/gemini-3-pro-high) <aider@aider.chat>
* refactor: 移除未使用的 cast 导入并简化 platform_name 赋值
* refactor: 引入 cast 并对 id 使用 cast(str, ...) 提升类型安全
* fix: 将 _id_to_sid 返回改为 str,空值返回空串;对 id 与 message_id 使用 cast
Co-authored-by: aider (openai/gemini-3-pro-high) <aider@aider.chat>
* refactor: 重构 Discord 处理逻辑:强制 类型转换、优先斜杠指令并优化提及判断
Co-authored-by: aider (openai/gemini-3-pro-high) <aider@aider.chat>
* fix: 统一对 id 获取执行 cast,并在微信消息解析失败时抛错
* Revert "fix: 去除cast,直接使用字段与字典访问,修正端口解析"
This reverts commit 1cbfdf9d1b.
* fix: 百炼 Rerank 会话关闭时返回空结果;初始化 request.prompt 避免空值拼接
* fix: 统一处理搜索结果链接为字符串,新增 _get_url 助手并适配 Bing/Sogo
Co-authored-by: aider (openai/gemini-3-pro-high) <aider@aider.chat>
* refactor: 调整 call_handler 泛型、Discord 通道注解及 FishAudioTTS API 请求类型
* refactor: 使用 col(...) 替代列引用并对结果进行 CursorResult 强转
* chore: ruff format
---------
Co-authored-by: aider (openai/gemini-3-pro-high) <aider@aider.chat>
Co-authored-by: Soulter <905617992@qq.com>
393 lines
11 KiB
Python
393 lines
11 KiB
Python
import abc
|
|
import datetime
|
|
import typing as T
|
|
from contextlib import asynccontextmanager
|
|
from dataclasses import dataclass
|
|
|
|
from deprecated import deprecated
|
|
from sqlalchemy.ext.asyncio import AsyncSession, async_sessionmaker, create_async_engine
|
|
|
|
from astrbot.core.db.po import (
|
|
Attachment,
|
|
ConversationV2,
|
|
Persona,
|
|
PlatformMessageHistory,
|
|
PlatformSession,
|
|
PlatformStat,
|
|
Preference,
|
|
Stats,
|
|
)
|
|
|
|
|
|
@dataclass
|
|
class BaseDatabase(abc.ABC):
|
|
"""数据库基类"""
|
|
|
|
DATABASE_URL = ""
|
|
|
|
def __init__(self) -> None:
|
|
self.engine = create_async_engine(
|
|
self.DATABASE_URL,
|
|
echo=False,
|
|
future=True,
|
|
)
|
|
self.AsyncSessionLocal = async_sessionmaker(
|
|
self.engine,
|
|
class_=AsyncSession,
|
|
expire_on_commit=False,
|
|
)
|
|
|
|
async def initialize(self):
|
|
"""初始化数据库连接"""
|
|
|
|
@asynccontextmanager
|
|
async def get_db(self) -> T.AsyncGenerator[AsyncSession, None]:
|
|
"""Get a database session."""
|
|
if not self.inited:
|
|
await self.initialize()
|
|
self.inited = True
|
|
async with self.AsyncSessionLocal() as session:
|
|
yield session
|
|
|
|
@deprecated(version="4.0.0", reason="Use get_platform_stats instead")
|
|
@abc.abstractmethod
|
|
def get_base_stats(self, offset_sec: int = 86400) -> Stats:
|
|
"""获取基础统计数据"""
|
|
raise NotImplementedError
|
|
|
|
@deprecated(version="4.0.0", reason="Use get_platform_stats instead")
|
|
@abc.abstractmethod
|
|
def get_total_message_count(self) -> int:
|
|
"""获取总消息数"""
|
|
raise NotImplementedError
|
|
|
|
@deprecated(version="4.0.0", reason="Use get_platform_stats instead")
|
|
@abc.abstractmethod
|
|
def get_grouped_base_stats(self, offset_sec: int = 86400) -> Stats:
|
|
"""获取基础统计数据(合并)"""
|
|
raise NotImplementedError
|
|
|
|
# New methods in v4.0.0
|
|
|
|
@abc.abstractmethod
|
|
async def insert_platform_stats(
|
|
self,
|
|
platform_id: str,
|
|
platform_type: str,
|
|
count: int = 1,
|
|
timestamp: datetime.datetime | None = None,
|
|
) -> None:
|
|
"""Insert a new platform statistic record."""
|
|
...
|
|
|
|
@abc.abstractmethod
|
|
async def count_platform_stats(self) -> int:
|
|
"""Count the number of platform statistics records."""
|
|
...
|
|
|
|
@abc.abstractmethod
|
|
async def get_platform_stats(self, offset_sec: int = 86400) -> list[PlatformStat]:
|
|
"""Get platform statistics within the specified offset in seconds and group by platform_id."""
|
|
...
|
|
|
|
@abc.abstractmethod
|
|
async def get_conversations(
|
|
self,
|
|
user_id: str | None = None,
|
|
platform_id: str | None = None,
|
|
) -> list[ConversationV2]:
|
|
"""Get all conversations for a specific user and platform_id(optional).
|
|
|
|
content is not included in the result.
|
|
"""
|
|
...
|
|
|
|
@abc.abstractmethod
|
|
async def get_conversation_by_id(self, cid: str) -> ConversationV2:
|
|
"""Get a specific conversation by its ID."""
|
|
...
|
|
|
|
@abc.abstractmethod
|
|
async def get_all_conversations(
|
|
self,
|
|
page: int = 1,
|
|
page_size: int = 20,
|
|
) -> list[ConversationV2]:
|
|
"""Get all conversations with pagination."""
|
|
...
|
|
|
|
@abc.abstractmethod
|
|
async def get_filtered_conversations(
|
|
self,
|
|
page: int = 1,
|
|
page_size: int = 20,
|
|
platform_ids: list[str] | None = None,
|
|
search_query: str = "",
|
|
**kwargs,
|
|
) -> tuple[list[ConversationV2], int]:
|
|
"""Get conversations filtered by platform IDs and search query."""
|
|
...
|
|
|
|
@abc.abstractmethod
|
|
async def create_conversation(
|
|
self,
|
|
user_id: str,
|
|
platform_id: str,
|
|
content: list[dict] | None = None,
|
|
title: str | None = None,
|
|
persona_id: str | None = None,
|
|
cid: str | None = None,
|
|
created_at: datetime.datetime | None = None,
|
|
updated_at: datetime.datetime | None = None,
|
|
) -> ConversationV2:
|
|
"""Create a new conversation."""
|
|
...
|
|
|
|
@abc.abstractmethod
|
|
async def update_conversation(
|
|
self,
|
|
cid: str,
|
|
title: str | None = None,
|
|
persona_id: str | None = None,
|
|
content: list[dict] | None = None,
|
|
) -> None:
|
|
"""Update a conversation's history."""
|
|
...
|
|
|
|
@abc.abstractmethod
|
|
async def delete_conversation(self, cid: str) -> None:
|
|
"""Delete a conversation by its ID."""
|
|
...
|
|
|
|
@abc.abstractmethod
|
|
async def delete_conversations_by_user_id(self, user_id: str) -> None:
|
|
"""Delete all conversations for a specific user."""
|
|
...
|
|
|
|
@abc.abstractmethod
|
|
async def insert_platform_message_history(
|
|
self,
|
|
platform_id: str,
|
|
user_id: str,
|
|
content: dict,
|
|
sender_id: str | None = None,
|
|
sender_name: str | None = None,
|
|
) -> PlatformMessageHistory:
|
|
"""Insert a new platform message history record."""
|
|
...
|
|
|
|
@abc.abstractmethod
|
|
async def delete_platform_message_offset(
|
|
self,
|
|
platform_id: str,
|
|
user_id: str,
|
|
offset_sec: int = 86400,
|
|
) -> None:
|
|
"""Delete platform message history records newer than the specified offset."""
|
|
...
|
|
|
|
@abc.abstractmethod
|
|
async def get_platform_message_history(
|
|
self,
|
|
platform_id: str,
|
|
user_id: str,
|
|
page: int = 1,
|
|
page_size: int = 20,
|
|
) -> list[PlatformMessageHistory]:
|
|
"""Get platform message history for a specific user."""
|
|
...
|
|
|
|
@abc.abstractmethod
|
|
async def get_platform_message_history_by_id(
|
|
self,
|
|
message_id: int,
|
|
) -> PlatformMessageHistory | None:
|
|
"""Get a platform message history record by its ID."""
|
|
...
|
|
|
|
@abc.abstractmethod
|
|
async def insert_attachment(
|
|
self,
|
|
path: str,
|
|
type: str,
|
|
mime_type: str,
|
|
):
|
|
"""Insert a new attachment record."""
|
|
...
|
|
|
|
@abc.abstractmethod
|
|
async def get_attachment_by_id(self, attachment_id: str) -> Attachment:
|
|
"""Get an attachment by its ID."""
|
|
...
|
|
|
|
@abc.abstractmethod
|
|
async def get_attachments(self, attachment_ids: list[str]) -> list[Attachment]:
|
|
"""Get multiple attachments by their IDs."""
|
|
...
|
|
|
|
@abc.abstractmethod
|
|
async def delete_attachment(self, attachment_id: str) -> bool:
|
|
"""Delete an attachment by its ID.
|
|
|
|
Returns True if the attachment was deleted, False if it was not found.
|
|
"""
|
|
...
|
|
|
|
@abc.abstractmethod
|
|
async def delete_attachments(self, attachment_ids: list[str]) -> int:
|
|
"""Delete multiple attachments by their IDs.
|
|
|
|
Returns the number of attachments deleted.
|
|
"""
|
|
...
|
|
|
|
@abc.abstractmethod
|
|
async def insert_persona(
|
|
self,
|
|
persona_id: str,
|
|
system_prompt: str,
|
|
begin_dialogs: list[str] | None = None,
|
|
tools: list[str] | None = None,
|
|
) -> Persona:
|
|
"""Insert a new persona record."""
|
|
...
|
|
|
|
@abc.abstractmethod
|
|
async def get_persona_by_id(self, persona_id: str) -> Persona:
|
|
"""Get a persona by its ID."""
|
|
...
|
|
|
|
@abc.abstractmethod
|
|
async def get_personas(self) -> list[Persona]:
|
|
"""Get all personas for a specific bot."""
|
|
...
|
|
|
|
@abc.abstractmethod
|
|
async def update_persona(
|
|
self,
|
|
persona_id: str,
|
|
system_prompt: str | None = None,
|
|
begin_dialogs: list[str] | None = None,
|
|
tools: list[str] | None = None,
|
|
) -> Persona | None:
|
|
"""Update a persona's system prompt or begin dialogs."""
|
|
...
|
|
|
|
@abc.abstractmethod
|
|
async def delete_persona(self, persona_id: str) -> None:
|
|
"""Delete a persona by its ID."""
|
|
...
|
|
|
|
@abc.abstractmethod
|
|
async def insert_preference_or_update(
|
|
self,
|
|
scope: str,
|
|
scope_id: str,
|
|
key: str,
|
|
value: dict,
|
|
) -> Preference:
|
|
"""Insert a new preference record."""
|
|
...
|
|
|
|
@abc.abstractmethod
|
|
async def get_preference(self, scope: str, scope_id: str, key: str) -> Preference:
|
|
"""Get a preference by scope ID and key."""
|
|
...
|
|
|
|
@abc.abstractmethod
|
|
async def get_preferences(
|
|
self,
|
|
scope: str,
|
|
scope_id: str | None = None,
|
|
key: str | None = None,
|
|
) -> list[Preference]:
|
|
"""Get all preferences for a specific scope ID or key."""
|
|
...
|
|
|
|
@abc.abstractmethod
|
|
async def remove_preference(self, scope: str, scope_id: str, key: str) -> None:
|
|
"""Remove a preference by scope ID and key."""
|
|
...
|
|
|
|
@abc.abstractmethod
|
|
async def clear_preferences(self, scope: str, scope_id: str) -> None:
|
|
"""Clear all preferences for a specific scope ID."""
|
|
...
|
|
|
|
# @abc.abstractmethod
|
|
# async def insert_llm_message(
|
|
# self,
|
|
# cid: str,
|
|
# role: str,
|
|
# content: list,
|
|
# tool_calls: list = None,
|
|
# tool_call_id: str = None,
|
|
# parent_id: str = None,
|
|
# ) -> LLMMessage:
|
|
# """Insert a new LLM message into the conversation."""
|
|
# ...
|
|
|
|
# @abc.abstractmethod
|
|
# async def get_llm_messages(self, cid: str) -> list[LLMMessage]:
|
|
# """Get all LLM messages for a specific conversation."""
|
|
# ...
|
|
|
|
@abc.abstractmethod
|
|
async def get_session_conversations(
|
|
self,
|
|
page: int = 1,
|
|
page_size: int = 20,
|
|
search_query: str | None = None,
|
|
platform: str | None = None,
|
|
) -> tuple[list[dict], int]:
|
|
"""Get paginated session conversations with joined conversation and persona details, support search and platform filter."""
|
|
...
|
|
|
|
# ====
|
|
# Platform Session Management
|
|
# ====
|
|
|
|
@abc.abstractmethod
|
|
async def create_platform_session(
|
|
self,
|
|
creator: str,
|
|
platform_id: str = "webchat",
|
|
session_id: str | None = None,
|
|
display_name: str | None = None,
|
|
is_group: int = 0,
|
|
) -> PlatformSession:
|
|
"""Create a new Platform session."""
|
|
...
|
|
|
|
@abc.abstractmethod
|
|
async def get_platform_session_by_id(
|
|
self, session_id: str
|
|
) -> PlatformSession | None:
|
|
"""Get a Platform session by its ID."""
|
|
...
|
|
|
|
@abc.abstractmethod
|
|
async def get_platform_sessions_by_creator(
|
|
self,
|
|
creator: str,
|
|
platform_id: str | None = None,
|
|
page: int = 1,
|
|
page_size: int = 20,
|
|
) -> list[PlatformSession]:
|
|
"""Get all Platform sessions for a specific creator (username) and optionally platform."""
|
|
...
|
|
|
|
@abc.abstractmethod
|
|
async def update_platform_session(
|
|
self,
|
|
session_id: str,
|
|
display_name: str | None = None,
|
|
) -> None:
|
|
"""Update a Platform session's updated_at timestamp and optionally display_name."""
|
|
...
|
|
|
|
@abc.abstractmethod
|
|
async def delete_platform_session(self, session_id: str) -> None:
|
|
"""Delete a Platform session by its ID."""
|
|
...
|