模型调度与端侧推理集成工程师

Why Work at Lenovo

We are Lenovo. We do what we say. We own what we do. We WOW our customers. 

Lenovo is a US$83 billion revenue global technology powerhouse, ranked #153 in the Fortune Global 500, and serving millions of customers every day in 180 markets. Focused on a bold vision to deliver Smarter Technology for All, Lenovo has built on its success as the world’s largest PC company with a full-stack portfolio of AI-enabled, AI-ready, and AI-optimized devices (PCs, workstations, smartphones, tablets), infrastructure (server, storage, edge, high performance computing and software defined infrastructure), software, solutions, and services. Lenovo’s continued investment in world-changing innovation is building a more equitable, trustworthy, and smarter future for everyone, everywhere. Lenovo is listed on the Hong Kong stock exchange under Lenovo Group Limited (HKSE: 992) (ADR: LNVGY). 

This transformation together with Lenovo’s world-changing innovation is building a more inclusive, trustworthy, and smarter future for everyone, everywhere. To find out more visit www.lenovo.com, and read about the latest news via our StoryHub.

Description and Requirements

岗位职责：

1. 负责多模型（LLM、人脸识别、OCR、ASR、声纹）端侧部署、量化及推理性能调优；
2. 设计并开发统一模型调度框架，实现模型按需加载/热卸载、算力优先级调度，以及NPU和内存资源争抢隔离；
3. 封装统一推理 Runtime，对接各类模型，实现推理任务队列、限流及闲时任务调度；
4. 针对 Center / Mini 等不同配置硬件，制定模型分级和降级策略；
5. 负责数据挖掘离线管线开发，包括人脸聚类、媒体特征提取及模型推理任务执行；
6. 评测模型时延、内存占用及功耗表现，持续优化端侧推理效率。

岗位要求：

1. 本科及以上学历；
2. 具备 2~3 年端侧 AI 模型部署经验，熟悉 NCNN、MNN、Tengine、QNN、ONNX Runtime 等至少一种推理框架；
3. 精通多模态主流评测指标及评测数据集，能够区分学术基准指标与真实端侧业务落地指标，并具备端侧部署性能评测经验；
4. 熟练使用评测工具，能够搭建自动化评测脚本，熟悉 OpenAI Evals、LM Eval 或多模态评测开源框架者优先；
5. 熟悉模型量化、KV Cache 优化及多进程、多模型资源调度方案；
6. 具备 Whisper ASR、人脸CV模型或本地LLM部署实战经验者优先；
7. 熟练掌握 C++、Python 开发，熟悉 Linux 服务开发及进程资源管控；
8. 具备算力受限嵌入式设备 AI 落地经验者优先。