AGV Reception & Inspection Robot — Tongji Deployment

May 1, 2024 · 2 min read
Reception robot deployed in Tongji Exhibition Hall; inspection robot in teaching building

Participated in the R&D of an intelligent AGV robot platform deployed across Tongji University’s exhibition hall and teaching buildings. The system integrates two robot roles — reception (迎宾) and inspection (巡检) — on a shared AGV chassis with a modular AI brain architecture.

My contribution: Led the voice module localization for Middle East clients — adapting the NLP pipeline for Arabic speech recognition, TTS, and interaction flows to support overseas commercial deployment.


Deployment

Left: Reception robot in Tongji University Exhibition Hall. Right: Inspection robot in Tongji teaching building.

Left: Reception robot in Tongji University Exhibition Hall. Right: Inspection robot in Tongji teaching building.


System Architecture

Dual-brain architecture: AI大脑 (data analysis / model inference / HRI) + AGV大脑 (autonomous navigation controller) on a unified AGV platform.

Dual-brain architecture: AI大脑 (data analysis / model inference / HRI) + AGV大脑 (autonomous navigation controller) on a unified AGV platform.

The robot uses a dual-brain architecture:

  • AI 大脑 — handles 数据分析, 模型推理, 人机交互 (vision, NLP, multimodal interaction)
  • AGV 大脑 — autonomous navigation controller (SLAM, path planning, motor control)

Hardware Specs

Hardware: T1 industrial LiDAR, SONY 4G i640 compute unit, 60W×2 brushless drive motors, 24V/16Ah battery pack.

Hardware: T1 industrial LiDAR, SONY 4G i640 compute unit, 60W×2 brushless drive motors, 24V/16Ah battery pack.

ModuleSpec
LiDAR单线激光雷达,180° FOV,测距精度 0.1°
ComputeSONY 4G i640,Ubuntu 16.04
Drive橡胶车轮,60W×2 无刷电机,最高速 0.5m/s
Battery18650锂电,24V/16Ah,续航 2h

Perception Capabilities

人员监测(人脸/穿戴/姿态/行为识别)× 环境监测(温湿度/烟雾/火警)

人员监测(人脸/穿戴/姿态/行为识别)× 环境监测(温湿度/烟雾/火警)

人员监测:

  • 人脸识别与比对
  • 穿戴识别(衣物、着装规范)
  • 姿态检测(人体骨骼关键点)
  • 行为识别(吸烟检测、摔倒预警)

环境监测:

  • 温湿度检测(区域/物体温度)
  • 烟雾报警(有害气体 + 烟雾检测)
  • 火警预警(融合温度、热图、烟雾多源判断)

Face Recognition & Edge AI

人脸识别 + 红外测温实时上传,支持二次开发与定制化功能扩展。

人脸识别 + 红外测温实时上传,支持二次开发与定制化功能扩展。

  • 人脸识别 + 红外测温数据实时上传
  • 考勤数据大屏可视化
  • 支持二次开发,可为客户定制化功能模块(含中东客户阿拉伯语语音交互落地)