f624971613
* chore(core.utils): 🚨 修正错误Lint
* chore(core.provider): 🚨 修复基类错误Lint
* chore(core.utils): 补全session_get()的重载
* chore(core.provider): 🚨 修正实现错误Lint
* chore(core.platform): 🚨 修正platform基类和webchat的错误Lint
* chore(core.platform): 修正错误实现Lint
* fix(core.provider): 修复循环调用和错误assert
* chore(core.platform): 修复部分实现Lint
* chore(core.provider): 补充Dify.text_chat_stream的参数类型
* chore(core.pipeline): 🚨 修复错误Lint
* fix(core.slack): 补充遗漏导入
* chore(core.utils): 修复错误的session_get声明
* chore(core.platform): 移除Lark adapter import中的wildcard
* chore(core.db): 修复声明和部分逻辑
* chore(core.db): 添加typings,使faiss参数能被正确识别。
* chore(core): 修复声明
* chore(core): 修改声明
* chore: 补充faiss声明
* chore(dashboard): 修改实现,减少报错
* chore(package): 修改部分声明与实现,减少报错
* chore(core): 添加Handler的overload,以去除部分assert同时通过类型检查
* chore(core.pipeline): 修改Pipeline Scheduler的execute,将判断属性改为判断类型,通过静态类型检查
* chore(core.config): 添加类型标注,通过类型检查
* chore(core.message): 为File._download_file添加检查,通过类型检查
* fix: 将断言改为条件判断以实现优雅关闭的容错性
* refactor: 移除 discord 客户端中的 assert,改用 if None 判断并抛出异常
Co-authored-by: aider (openai/gemini-3-pro-high) <aider@aider.chat>
* fix: DiscordPlatformAdapter 对 self.client.user 为 None 做日志并返回,移除断言
Co-authored-by: aider (openai/gemini-3-pro-high) <aider@aider.chat>
* fix: 增强 Lark 相关空值/异常检查并完善日志输出
Co-authored-by: aider (openai/gemini-3-pro-high) <aider@aider.chat>
* refactor: 将断言替换为条件检查并加入日志与错误处理
Co-authored-by: aider (openai/gemini-3-pro-high) <aider@aider.chat>
* chore: 移除LLM生成的无用注释
* refactor: 使用 File.get_file 替换下载逻辑并移除 assert,提供默认 filename
Co-authored-by: aider (openai/gemini-3-pro-high) <aider@aider.chat>
* fix: Slack Socket 未初始化抛出运行时异常,图片 URL 判空改为非空判断
* refactor: 将 WeChatPadProAdapter 的断言改为空值判断并添加日志
* refactor: 使用 isinstance 替代断言实现类型判断,便于静态检查
Co-authored-by: aider (openai/gemini-3-pro-high) <aider@aider.chat>
* fix: 去除cast,直接使用字段与字典访问,修正端口解析
Co-authored-by: aider (openai/gemini-3-pro-high) <aider@aider.chat>
* refactor: 使用 match-case 重构 ProviderManager 加载并通过类型检查抛出 TypeError
Co-authored-by: aider (openai/gemini-3-pro-high) <aider@aider.chat>
* fix: group_name_display 时若 group 对象为空则记录错误并返回
* fix: 将 _get_current_persona_id 的 assert 替换成 if guard 并返回 None
Co-authored-by: aider (openai/gemini-3-pro-high) <aider@aider.chat>
* fix: 优化插件目录存在性检查及图片URL非空验证,更新JSON排序配置
* fix: 将 datetime_str 的 assert 替换为显式检查并抛出异常
Co-authored-by: aider (openai/gemini-3-pro-high) <aider@aider.chat>
* refactor: 移除 cast,改为运行时检查并在找不到调度器时跳过
Co-authored-by: aider (openai/gemini-3-pro-high) <aider@aider.chat>
* refactor: 移除 cast,改用 isinstance 检查 FaissVecDB 并警告
Co-authored-by: aider (openai/gemini-3-pro-high) <aider@aider.chat>
* fix: 删除 typing.cast 导入,并在获取文件绝对路径前校验 file_
* refactor: 移除 typing.cast,简化内容安全检查调用
Co-authored-by: aider (openai/gemini-3-pro-high) <aider@aider.chat>
* refactor: 将 PlatformMetadata.id 设为必填并在注册时传入 id,移除 cast
* refactor: 移除 cast,改用 HasInitialize 与 isinstance 进行初始化
Co-authored-by: aider (openai/gemini-3-pro-high) <aider@aider.chat>
* fix: 为 ProviderManager.initialize 增加ID类型判断,避免 None 导致 get 失败
Co-authored-by: aider (openai/gemini-3-pro-high) <aider@aider.chat>
* refactor: 为 OTTSProvider 与 AzureNativeProvider 引入 _client 与 client 属性改进上下文管理
Co-authored-by: aider (openai/gemini-3-pro-high) <aider@aider.chat>
* fix: 为 Whisper 自托管源添加模型未初始化校验并直接调用 transcribe
Co-authored-by: aider (openai/gemini-3-pro-high) <aider@aider.chat>
* refactor: 移除未使用的 cast 导入并简化 platform_name 赋值
* refactor: 引入 cast 并对 id 使用 cast(str, ...) 提升类型安全
* fix: 将 _id_to_sid 返回改为 str,空值返回空串;对 id 与 message_id 使用 cast
Co-authored-by: aider (openai/gemini-3-pro-high) <aider@aider.chat>
* refactor: 重构 Discord 处理逻辑:强制 类型转换、优先斜杠指令并优化提及判断
Co-authored-by: aider (openai/gemini-3-pro-high) <aider@aider.chat>
* fix: 统一对 id 获取执行 cast,并在微信消息解析失败时抛错
* Revert "fix: 去除cast,直接使用字段与字典访问,修正端口解析"
This reverts commit 1cbfdf9d1b.
* fix: 百炼 Rerank 会话关闭时返回空结果;初始化 request.prompt 避免空值拼接
* fix: 统一处理搜索结果链接为字符串,新增 _get_url 助手并适配 Bing/Sogo
Co-authored-by: aider (openai/gemini-3-pro-high) <aider@aider.chat>
* refactor: 调整 call_handler 泛型、Discord 通道注解及 FishAudioTTS API 请求类型
* refactor: 使用 col(...) 替代列引用并对结果进行 CursorResult 强转
* chore: ruff format
---------
Co-authored-by: aider (openai/gemini-3-pro-high) <aider@aider.chat>
Co-authored-by: Soulter <905617992@qq.com>
288 lines
11 KiB
Python
288 lines
11 KiB
Python
import base64
|
|
import logging
|
|
import os
|
|
import shutil
|
|
import socket
|
|
import ssl
|
|
import time
|
|
import uuid
|
|
import zipfile
|
|
from pathlib import Path
|
|
|
|
import aiohttp
|
|
import certifi
|
|
import psutil
|
|
from PIL import Image
|
|
|
|
from .astrbot_path import get_astrbot_data_path
|
|
|
|
logger = logging.getLogger("astrbot")
|
|
|
|
|
|
def on_error(func, path, exc_info):
|
|
"""A callback of the rmtree function."""
|
|
import stat
|
|
|
|
if not os.access(path, os.W_OK):
|
|
os.chmod(path, stat.S_IWUSR)
|
|
func(path)
|
|
else:
|
|
raise exc_info[1]
|
|
|
|
|
|
def remove_dir(file_path: str) -> bool:
|
|
if not os.path.exists(file_path):
|
|
return True
|
|
shutil.rmtree(file_path, onerror=on_error)
|
|
return True
|
|
|
|
|
|
def port_checker(port: int, host: str = "localhost"):
|
|
sk = socket.socket(socket.AF_INET, socket.SOCK_STREAM)
|
|
sk.settimeout(1)
|
|
try:
|
|
sk.connect((host, port))
|
|
sk.close()
|
|
return True
|
|
except Exception:
|
|
sk.close()
|
|
return False
|
|
|
|
|
|
def save_temp_img(img: Image.Image | bytes) -> str:
|
|
temp_dir = os.path.join(get_astrbot_data_path(), "temp")
|
|
# 获得文件创建时间,清除超过 12 小时的
|
|
try:
|
|
for f in os.listdir(temp_dir):
|
|
path = os.path.join(temp_dir, f)
|
|
if os.path.isfile(path):
|
|
ctime = os.path.getctime(path)
|
|
if time.time() - ctime > 3600 * 12:
|
|
os.remove(path)
|
|
except Exception as e:
|
|
print(f"清除临时文件失败: {e}")
|
|
|
|
# 获得时间戳
|
|
timestamp = f"{int(time.time())}_{uuid.uuid4().hex[:8]}"
|
|
p = os.path.join(temp_dir, f"{timestamp}.jpg")
|
|
|
|
if isinstance(img, Image.Image):
|
|
img.save(p)
|
|
else:
|
|
with open(p, "wb") as f:
|
|
f.write(img)
|
|
return p
|
|
|
|
|
|
async def download_image_by_url(
|
|
url: str,
|
|
post: bool = False,
|
|
post_data: dict | None = None,
|
|
path: str | None = None,
|
|
) -> str:
|
|
"""下载图片, 返回 path"""
|
|
try:
|
|
ssl_context = ssl.create_default_context(
|
|
cafile=certifi.where(),
|
|
) # 使用 certifi 提供的 CA 证书
|
|
connector = aiohttp.TCPConnector(ssl=ssl_context) # 使用 certifi 的根证书
|
|
async with aiohttp.ClientSession(
|
|
trust_env=True,
|
|
connector=connector,
|
|
) as session:
|
|
if post:
|
|
async with session.post(url, json=post_data) as resp:
|
|
if not path:
|
|
return save_temp_img(await resp.read())
|
|
with open(path, "wb") as f:
|
|
f.write(await resp.read())
|
|
return path
|
|
else:
|
|
async with session.get(url) as resp:
|
|
if not path:
|
|
return save_temp_img(await resp.read())
|
|
with open(path, "wb") as f:
|
|
f.write(await resp.read())
|
|
return path
|
|
except (aiohttp.ClientConnectorSSLError, aiohttp.ClientConnectorCertificateError):
|
|
# 关闭SSL验证(仅在证书验证失败时作为fallback)
|
|
logger.warning(
|
|
f"SSL certificate verification failed for {url}. "
|
|
"Disabling SSL verification (CERT_NONE) as a fallback. "
|
|
"This is insecure and exposes the application to man-in-the-middle attacks. "
|
|
"Please investigate and resolve certificate issues."
|
|
)
|
|
ssl_context = ssl.create_default_context()
|
|
ssl_context.check_hostname = False
|
|
ssl_context.verify_mode = ssl.CERT_NONE
|
|
async with aiohttp.ClientSession() as session:
|
|
if post:
|
|
async with session.post(url, json=post_data, ssl=ssl_context) as resp:
|
|
if not path:
|
|
return save_temp_img(await resp.read())
|
|
with open(path, "wb") as f:
|
|
f.write(await resp.read())
|
|
return path
|
|
else:
|
|
async with session.get(url, ssl=ssl_context) as resp:
|
|
if not path:
|
|
return save_temp_img(await resp.read())
|
|
with open(path, "wb") as f:
|
|
f.write(await resp.read())
|
|
return path
|
|
except Exception as e:
|
|
raise e
|
|
|
|
|
|
async def download_file(url: str, path: str, show_progress: bool = False):
|
|
"""从指定 url 下载文件到指定路径 path"""
|
|
try:
|
|
ssl_context = ssl.create_default_context(
|
|
cafile=certifi.where(),
|
|
) # 使用 certifi 提供的 CA 证书
|
|
connector = aiohttp.TCPConnector(ssl=ssl_context)
|
|
async with aiohttp.ClientSession(
|
|
trust_env=True,
|
|
connector=connector,
|
|
) as session:
|
|
async with session.get(url, timeout=1800) as resp:
|
|
if resp.status != 200:
|
|
raise Exception(f"下载文件失败: {resp.status}")
|
|
total_size = int(resp.headers.get("content-length", 0))
|
|
downloaded_size = 0
|
|
start_time = time.time()
|
|
if show_progress:
|
|
print(f"文件大小: {total_size / 1024:.2f} KB | 文件地址: {url}")
|
|
with open(path, "wb") as f:
|
|
while True:
|
|
chunk = await resp.content.read(8192)
|
|
if not chunk:
|
|
break
|
|
f.write(chunk)
|
|
downloaded_size += len(chunk)
|
|
if show_progress:
|
|
elapsed_time = (
|
|
time.time() - start_time
|
|
if time.time() - start_time > 0
|
|
else 1
|
|
)
|
|
speed = downloaded_size / 1024 / elapsed_time # KB/s
|
|
print(
|
|
f"\r下载进度: {downloaded_size / total_size:.2%} 速度: {speed:.2f} KB/s",
|
|
end="",
|
|
)
|
|
except (aiohttp.ClientConnectorSSLError, aiohttp.ClientConnectorCertificateError):
|
|
# 关闭SSL验证(仅在证书验证失败时作为fallback)
|
|
logger.warning(
|
|
"SSL 证书验证失败,已关闭 SSL 验证(不安全,仅用于临时下载)。请检查目标服务器的证书配置。"
|
|
)
|
|
logger.warning(
|
|
f"SSL certificate verification failed for {url}. "
|
|
"Falling back to unverified connection (CERT_NONE). "
|
|
"This is insecure and exposes the application to man-in-the-middle attacks. "
|
|
"Please investigate certificate issues with the remote server."
|
|
)
|
|
ssl_context = ssl.create_default_context()
|
|
ssl_context.check_hostname = False
|
|
ssl_context.verify_mode = ssl.CERT_NONE
|
|
async with aiohttp.ClientSession() as session:
|
|
async with session.get(url, ssl=ssl_context, timeout=120) as resp:
|
|
total_size = int(resp.headers.get("content-length", 0))
|
|
downloaded_size = 0
|
|
start_time = time.time()
|
|
if show_progress:
|
|
print(f"文件大小: {total_size / 1024:.2f} KB | 文件地址: {url}")
|
|
with open(path, "wb") as f:
|
|
while True:
|
|
chunk = await resp.content.read(8192)
|
|
if not chunk:
|
|
break
|
|
f.write(chunk)
|
|
downloaded_size += len(chunk)
|
|
if show_progress:
|
|
elapsed_time = time.time() - start_time
|
|
speed = downloaded_size / 1024 / elapsed_time # KB/s
|
|
print(
|
|
f"\r下载进度: {downloaded_size / total_size:.2%} 速度: {speed:.2f} KB/s",
|
|
end="",
|
|
)
|
|
if show_progress:
|
|
print()
|
|
|
|
|
|
def file_to_base64(file_path: str) -> str:
|
|
with open(file_path, "rb") as f:
|
|
data_bytes = f.read()
|
|
base64_str = base64.b64encode(data_bytes).decode()
|
|
return "base64://" + base64_str
|
|
|
|
|
|
def get_local_ip_addresses():
|
|
net_interfaces = psutil.net_if_addrs()
|
|
network_ips = []
|
|
|
|
for interface, addrs in net_interfaces.items():
|
|
for addr in addrs:
|
|
if addr.family == socket.AF_INET: # 使用 socket.AF_INET 代替 psutil.AF_INET
|
|
network_ips.append(addr.address)
|
|
|
|
return network_ips
|
|
|
|
|
|
async def get_dashboard_version():
|
|
dist_dir = os.path.join(get_astrbot_data_path(), "dist")
|
|
if os.path.exists(dist_dir):
|
|
version_file = os.path.join(dist_dir, "assets", "version")
|
|
if os.path.exists(version_file):
|
|
with open(version_file, encoding="utf-8") as f:
|
|
v = f.read().strip()
|
|
return v
|
|
return None
|
|
|
|
|
|
async def download_dashboard(
|
|
path: str | None = None,
|
|
extract_path: str = "data",
|
|
latest: bool = True,
|
|
version: str | None = None,
|
|
proxy: str | None = None,
|
|
) -> None:
|
|
"""下载管理面板文件"""
|
|
if path is None:
|
|
zip_path = Path(get_astrbot_data_path()).absolute() / "dashboard.zip"
|
|
else:
|
|
zip_path = Path(path).absolute()
|
|
|
|
if latest or len(str(version)) != 40:
|
|
ver_name = "latest" if latest else version
|
|
dashboard_release_url = f"https://astrbot-registry.soulter.top/download/astrbot-dashboard/{ver_name}/dist.zip"
|
|
logger.info(
|
|
f"准备下载指定发行版本的 AstrBot WebUI 文件: {dashboard_release_url}",
|
|
)
|
|
try:
|
|
await download_file(
|
|
dashboard_release_url,
|
|
str(zip_path),
|
|
show_progress=True,
|
|
)
|
|
except BaseException as _:
|
|
if latest:
|
|
dashboard_release_url = "https://github.com/AstrBotDevs/AstrBot/releases/latest/download/dist.zip"
|
|
else:
|
|
dashboard_release_url = f"https://github.com/AstrBotDevs/AstrBot/releases/download/{version}/dist.zip"
|
|
if proxy:
|
|
dashboard_release_url = f"{proxy}/{dashboard_release_url}"
|
|
await download_file(
|
|
dashboard_release_url,
|
|
str(zip_path),
|
|
show_progress=True,
|
|
)
|
|
else:
|
|
url = f"https://github.com/AstrBotDevs/astrbot-release-harbour/releases/download/release-{version}/dist.zip"
|
|
logger.info(f"准备下载指定版本的 AstrBot WebUI: {url}")
|
|
if proxy:
|
|
url = f"{proxy}/{url}"
|
|
await download_file(url, str(zip_path), show_progress=True)
|
|
with zipfile.ZipFile(zip_path, "r") as z:
|
|
z.extractall(extract_path)
|