我们正在打造新一代 AI 驱动的在线协作文档平台,将实时协作与智能化能力深度融合。我们正在寻找一位 AI Evaluation Engineer,负责为 AI 系统建立严格的质量标准。您将设计评测框架、构建自动化测试流程,并从多个维度衡量系统表现。您的工作将确保我们的 AI 能力为用户提供可靠、高质量的大规模体验。
岗位职责:
1.负责 AI 产品和 Agent 系统评测体系建设。
2.构建 Benchmark、测试集和典型用户场景数据集。
3.建设自动化评测和回归测试平台。
4.建立效果评估指标体系，包括任务完成率、正确率、稳定性、响应速度和用户满意度等。
5.分析失败案例并推动质量优化。
6.支持模型对比、Prompt 优化和 A/B 实验。
7.建立上线质量门禁和长期质量监控机制。
任职要求:
1.本科或以上学历，3 年以上软件研发、机器学习、数据分析、测试开发或相关经验。
2.有 AI 产品、搜索、推荐、智能助手或机器学习系统评测经验。
3.熟悉实验设计、Benchmark 构建和数据分析方法。
4.具备自动化测试平台或质量平台建设经验。
5.熟练掌握 Python 及常用数据分析工具。
6.具备较强的数据分析能力和工程落地能力。
7.对 AI 产品质量提升有浓厚兴趣。
Ways of Working
Our structured hybrid approach is centered around our offices and remote work environments. The work style of each role, Hybrid, Remote, or In-Person is indicated in the job description/posting.
Benefits
As part of our award-winning workplace culture and commitment to delivering happiness, our benefits program offers a variety of perks, benefits, and options to help employees maintain their physical, mental, emotional, and financial health; support work-life balance; and contribute to their community in meaningful ways. Click Learn
for more information.
About Us
Zoomies help people stay connected so they can get more done together. We set out to build the best collaboration platform for the enterprise, and today help people communicate better with products like Zoom Contact Center, Zoom Phone, Zoom Events, Zoom Apps, Zoom Rooms, and Zoom Webinars.
We’re problem-solvers, working at a fast pace to design solutions with our customers and users in mind. Find room to grow with opportunities to stretch your skills and advance your career in a collaborative, growth-focused environment.
Our Commitment
At Zoom, we believe great work happens when people feel supported and empowered. We’re committed to fair hiring practices that ensure every candidate is evaluated based on skills, experience, and potential. If you require an accommodation during the hiring process, let us know—we’re here to support you at every step.
If you need assistance navigating the interview process due to a medical disability, please submit an Accommodations Request Form and someone from our team will reach out soon. This form is solely for applicants who require an accommodation due to a qualifying medical disability. Non-accommodation-related requests, such as application follow-ups or technical issues, will not be addressed.
Our interviews are supported by BrightHire, a tool that helps us create a consistent and thoughtful interview experience and may include recordings. Please refer to our candidate privacy statement for more information of how we use your data.
