AI Evaluation Project Intern(Corporate Service System)- 2026 Start
- Dubai, United Arab Emirates
Posted 3 days ago
About the role
Location
:
Dubai
Team
:
Product
Employment Type
:
Intern
Job Code
:
A62230B
Responsibilities
We are the AI Vertical Scenarios Team within ByteDance's Corporate Service System, based in Dubai. Our mission is to set the standard for AI native applications across ByteDance's internal workplace and procurement scenarios, and to drive consistent AI experiences for employees globally. We build flagship AI applications in-house and use a full scope evaluation suite as our measurement foundation to track how well leading models perform on the real, day to day tasks ByteDance employees carry out.
Why join us
Applications are reviewed on a rolling basis, so we encourage you to apply early.
Online Assessment
Candidates who pass resume screening will be invited to participate in Our Company's technical online assessment.
Responsibilities:
1. Ground the work in real user needs through user interviews, literature review, and usage data analysis.
2. Propose research methodology: how queries are generated, how rubrics are structured, and how models are scored.
3. Write curated queries with prerequisites, across three difficulty levels: Simple, Medium, and Complex.
4. Write rubrics: checklist items defining a correct answer (e.g., for a leave request: leave type, date parsing, balance check, approver routing, form completeness, submission state).
5. Run models against the queries and score outputs on an ongoing cadence, reviewing multiple agents and models against the benchmark each month.
6. Automate the evaluation so the loop can be re-run as models and internal systems evolve.
7. Write the evaluation report covering findings, failure patterns, and recommendations.
1. Identifying manual workflows across the business and prototyping AI solutions to automate them.
2. Contributing to AI product work by shaping agent capabilities, and helping ship new AI features into internal workplace and knowledge tools.
Qualifications
Minimum Qualifications
Job Information
About Us
Founded in 2012, ByteDance's mission is to inspire creativity and enrich life. With a suite of more than a dozen products, including TikTok, Lemon8, CapCut and Pico as well as platforms specific to the China market, including Toutiao, Douyin, and Xigua, ByteDance has made it easier and more fun for people to connect with, consume, and create content.
Why Join ByteDance
Inspiring creativity is at the core of ByteDance's mission. Our innovative products are built to help people authentically express themselves, discover and connect – and our global, diverse teams make that possible. Together, we create value for our communities, inspire creativity and enrich life - a mission we work towards every day.
As ByteDancers, we strive to do great things with great people. We lead with curiosity, humility, and a desire to make impact in a rapidly growing tech company. By constantly iterating and fostering an "Always Day 1" mindset, we achieve meaningful breakthroughs for ourselves, our Company, and our users. When we create and grow together, the possibilities are limitless. Join us.
Diversity & Inclusion
ByteDance is committed to creating an inclusive space where employees are valued for their skills, experiences, and unique perspectives. Our platform connects people from across the globe and so does our workplace. At ByteDance, our mission is to inspire creativity and enrich life. To achieve that goal, we are committed to celebrating our diverse voices and to creating an environment that reflects the many communities we reach. We are passionate about this and hope you are too.
:
Dubai
Team
:
Product
Employment Type
:
Intern
Job Code
:
A62230B
Responsibilities
We are the AI Vertical Scenarios Team within ByteDance's Corporate Service System, based in Dubai. Our mission is to set the standard for AI native applications across ByteDance's internal workplace and procurement scenarios, and to drive consistent AI experiences for employees globally. We build flagship AI applications in-house and use a full scope evaluation suite as our measurement foundation to track how well leading models perform on the real, day to day tasks ByteDance employees carry out.
Why join us
- Real scenarios, real users: the evaluations you design and the AI applications you contribute to are grounded in the actual workflows of ByteDance employees worldwide.
- Hands on with frontier AI: work directly with Claude, Doubao Seed 2.1, and internal agent infrastructure and agent-building tools.
- Broad scope: opportunities to prototype AI solutions to manual workflows, and to contribute to strategic AI projects that shape how ByteDance employees experience corporate services globally.
Applications are reviewed on a rolling basis, so we encourage you to apply early.
Online Assessment
Candidates who pass resume screening will be invited to participate in Our Company's technical online assessment.
Responsibilities:
- Core evaluation work:
1. Ground the work in real user needs through user interviews, literature review, and usage data analysis.
2. Propose research methodology: how queries are generated, how rubrics are structured, and how models are scored.
3. Write curated queries with prerequisites, across three difficulty levels: Simple, Medium, and Complex.
4. Write rubrics: checklist items defining a correct answer (e.g., for a leave request: leave type, date parsing, balance check, approver routing, form completeness, submission state).
5. Run models against the queries and score outputs on an ongoing cadence, reviewing multiple agents and models against the benchmark each month.
6. Automate the evaluation so the loop can be re-run as models and internal systems evolve.
7. Write the evaluation report covering findings, failure patterns, and recommendations.
- Additional project work:
1. Identifying manual workflows across the business and prototyping AI solutions to automate them.
2. Contributing to AI product work by shaping agent capabilities, and helping ship new AI features into internal workplace and knowledge tools.
Qualifications
Minimum Qualifications
- Currently pursuing a Undergraduate in Computer Science, AI, Information Management or a related technical discipline. Strong hands on AI experience from non CS backgrounds is equally welcome.
- Available to start the internship immediately, ideally within one week.
- Clear logical thinking, self driven, and user value oriented, with strong communication and cross team collaboration skills.
- Genuine interest in AI products and a habit of following the latest developments in the LLM and agent space.
- Able to work on site in Dubai full time or part time (ideally 2 to 3 days per week).
- Relevant internship or project experience in AI products or AI evaluations.
- Prior experience designing or running LLM evaluations.
- Prior work translating user problems into AI applications, particularly in office automation, knowledge management, or adjacent productivity domains.
Job Information
About Us
Founded in 2012, ByteDance's mission is to inspire creativity and enrich life. With a suite of more than a dozen products, including TikTok, Lemon8, CapCut and Pico as well as platforms specific to the China market, including Toutiao, Douyin, and Xigua, ByteDance has made it easier and more fun for people to connect with, consume, and create content.
Why Join ByteDance
Inspiring creativity is at the core of ByteDance's mission. Our innovative products are built to help people authentically express themselves, discover and connect – and our global, diverse teams make that possible. Together, we create value for our communities, inspire creativity and enrich life - a mission we work towards every day.
As ByteDancers, we strive to do great things with great people. We lead with curiosity, humility, and a desire to make impact in a rapidly growing tech company. By constantly iterating and fostering an "Always Day 1" mindset, we achieve meaningful breakthroughs for ourselves, our Company, and our users. When we create and grow together, the possibilities are limitless. Join us.
Diversity & Inclusion
ByteDance is committed to creating an inclusive space where employees are valued for their skills, experiences, and unique perspectives. Our platform connects people from across the globe and so does our workplace. At ByteDance, our mission is to inspire creativity and enrich life. To achieve that goal, we are committed to celebrating our diverse voices and to creating an environment that reflects the many communities we reach. We are passionate about this and hope you are too.