Medical AI Consultation Platform

Fri, 01 Aug 2025 00:00:00 +0000

An end-to-end medical AI platform developed from Oct 2024 to Aug 2025, covering both model training and product deployment.

Part 1 — Multimodal Medical LLM:

Three-stage fine-tuning: Medical Alignment → Instruction Tuning & Routing → Domain Expert Routing
Image-text cross-attention alignment for CT/MRI images and medical text
MoE-style routing: directs tasks to specialized expert modules (radiology, clinical text, etc.)
Architecture reference: EMNLP 2024 routing framework

Part 2 — Cloud Platform:

Coze multi-agent workflow for medication assistance and health check-in
Visual imaging analysis + report OCR pipeline
Web frontend: symptom analysis, drug recommendation, health knowledge base
Deployed and validated with real hospital feedback

Reflection: Identified product-market fit issues early — physician trust barriers and unclear monetization in B2B healthcare remain the core challenge for medical AI products.

Stack: PyTorch · Transformers · Coze · Vue · Cloud deployment

Model Training Pipeline

Three-stage fine-tuning: Medical Alignment → Instruction Tuning & Routing → Domain Expert Routing (reference: EMNLP 2024).

Coze Multi-Agent Workflow

Coze multi-agent workflow for medication assistance, health check-in, and domain routing.

Platform Frontend

智慧医疗AI平台 — symptom analysis, drug recommendation, visual report OCR, deployed and validated with hospital feedback.

医疗 AI 问诊平台

Fri, 01 Aug 2025 00:00:00 +0000

从 2024 年 10 月到 2025 年 8 月自研的端到端医疗 AI 平台，涵盖模型训练与产品部署全流程。

第一部分 — 多模态医疗大模型：

三阶段微调：医学对齐 → 指令微调与路由 → 领域专家路由
CT/MRI 图像与医学文本的跨注意力对齐
MoE 式路由：将任务分配至专项专家模块（放射科、临床文本等）
架构参考：EMNLP 2024 路由框架

第二部分 — 云端平台：

Coze 多智能体工作流，覆盖用药辅助与健康打卡
影像分析 + 报告 OCR 流水线
Web 前端：症状分析、药品推荐、健康知识库
已部署并获得真实医院反馈验证

反思： 较早识别出产品市场匹配问题 — 医生信任壁垒与 B2B 医疗变现路径不清晰，是医疗 AI 产品的核心挑战。

技术栈： PyTorch · Transformers · Coze · Vue · 云端部署

模型训练架构

三阶段微调流程：医学对齐 → 指令微调与路由 → 领域专家路由（参考 EMNLP 2024）。

Coze 多智能体工作流

Coze 多智能体工作流，覆盖用药辅助、健康打卡与领域路由。

平台前端

智慧医疗AI平台 — 症状分析、药品推荐、影像报告 OCR，已部署并获得医院反馈验证。

Full-Stack | Liu Yue — Embodied AI Researcher