工作内容：
• 研发稳定高效的 LLM 推理系统，支持低延迟和高吞吐
• 设计和优化分离式推理框架，实现低延迟、高吞吐
• 开发和优化分布式 KV 缓存（KV Cache）框架
• 进行 CUDA 内核优化，提高计算效率和 GPU 资源利用率
岗位要求：
• 熟悉大语言模型（如 LLaMA、Qwen）推理流程
• 了解主流模型推理加速技术（模型量化、算子融合、P/D 分离、Prefix Caching、Speculative Decoding、KV Cache 压缩与调度）
• 掌握 vLLM、TensorRT-LLM 等主流推理加速框架，能分析并优化其加速技术
• 熟悉 Hugging Face Transformers 及常见深度学习库
• 具备 GPU 高性能计算优化能力，熟悉 CUDA 并行计算、访存优化、低比特计算
• 深入理解计算机体系结构，具有基于 CUDA 的 GPU 性能优化经验
• 熟悉深度学习算法、神经网络架构及算子计算
加分项：
• 了解至少一种深度学习训练框架（如 PyTorch、TensorFlow）及其模型文件解析方式
• 具备软硬件联合设计经验
• 有 P/D 分离系统、分布式 KV Cache 系统优化经验
• 熟悉底层性能优化（Cutlass、NCCL 等）
Ways of Working
Our structured hybrid approach is centered around our offices and remote work environments. The work style of each role, Hybrid, Remote, or In-Person is indicated in the job description/posting.
Benefits
As part of our award-winning workplace culture and commitment to delivering happiness, our benefits program offers a variety of perks, benefits, and options to help employees maintain their physical, mental, emotional, and financial health; support work-life balance; and contribute to their community in meaningful ways. Click Learn
for more information.
About Us
Zoomies help people stay connected so they can get more done together. We set out to build the best collaboration platform for the enterprise, and today help people communicate better with products like Zoom Contact Center, Zoom Phone, Zoom Events, Zoom Apps, Zoom Rooms, and Zoom Webinars.
We’re problem-solvers, working at a fast pace to design solutions with our customers and users in mind. Find room to grow with opportunities to stretch your skills and advance your career in a collaborative, growth-focused environment.
Our Commitment
At Zoom, we believe great work happens when people feel supported and empowered. We’re committed to fair hiring practices that ensure every candidate is evaluated based on skills, experience, and potential. If you require an accommodation during the hiring process, let us know—we’re here to support you at every step.
If you need assistance navigating the interview process due to a medical disability, please submit an Accommodations Request Form and someone from our team will reach out soon. This form is solely for applicants who require an accommodation due to a qualifying medical disability. Non-accommodation-related requests, such as application follow-ups or technical issues, will not be addressed.
