Loading…

agentjob.dev — Jobs for engineers who build AI agents.

Terms
Privacy
Refund policy
About
Contact
Post a job

agentjob.dev

Jobs for engineers who build AI agents

Orchestration, multi-agent systems, tool-use backends and local LLM infrastructure — one focused board for agent engineering roles.

Search jobs

All roles
Agent Orchestration
Multi-Agent Systems
Tool-Use Backends
Local LLM Infrastructure
Retrieval & Memory
Evals & Observability
Agent Platform & DevTools

Anywhere
Remote
Hybrid
On-site

90 roles in Evals & Observability · On-site

Clear filters

O
OpenAI
Machine Learning Engineer, Monetization AI/ML
1mo ago
- San Francisco
- On-site
- Full-time
- $381K – $555K
Evals & Observability
- PyTorch
- Fine-tuning

← Newer

Page 2 of 3

Older →

Weekly digest

Get AI agent jobs straight to your inbox

One email a week with the newest roles. No spam, unsubscribe anytime.

Website

Email address

Anthropic

Forward Deployed Engineer

2mo ago

London, UK
On-site
Full-time

Evals & Observability

MCP
Evals
Python
TypeScript

LangChain

Senior Fullstack Engineer, AI Observability & Evals Platform

2mo ago

Boston, MA
On-site
Full-time

Evals & Observability

LangChain
Evals
Python

LangChain

Senior Backend Software Engineer, AI Observability & Evals Platform (LangSmith)

2mo ago

Boston, MA
On-site
Full-time

Evals & Observability

LangChain
Evals
Python

Databricks

Specialist Solutions Architect - AI/ML

2mo ago

Seoul, South Korea
On-site
Full-time

Evals & Observability

LangChain
Multi-Agent
RAG

OpenAI

Applied AI Engineer, Codex | Tokyo

2mo ago

Tokyo, Japan
On-site
Full-time

Evals & Observability

Evals
Python
TypeScript

Anthropic

Applied AI, Research Engineer

2mo ago

San Francisco, CA | New York City, NY
On-site
Full-time

Evals & Observability

Evals

Anthropic

Staff+ Software Engineer, Claude Science

2mo ago

San Francisco, CA | New York City, NY
On-site
Full-time

Evals & Observability

Multi-Agent
Evals

OpenAI

Researcher, Agent Safety, Oversight and System Mitigations

2mo ago

San Francisco
On-site
Full-time
$380K – $500K

Evals & Observability

Evals

OpenAI

Researcher, Agent Safety, Training and Evaluations

2mo ago

San Francisco
On-site
Full-time
$380K – $500K

Evals & Observability

Evals

Scale AI

Staff Software Engineer, RL Environments

2mo ago

San Francisco, CA; New York, NY
On-site
Full-time

Evals & Observability

MCP
Evals
vLLM

Databricks

AI Engineer – Forward Deployed Engineering (AI FDE), U.S. Public Sector (Federal Focus)

2mo ago

Maryland; Virginia; Washington, D.C.
On-site
Full-time

Evals & Observability

LangChain
Multi-Agent
RAG

Scale AI

Machine Learning Research Scientist, Evaluations

2mo ago

San Francisco, CA; Seattle, WA; New York, NY
On-site
Full-time

Evals & Observability

Evals
Fine-tuning

LangChain

Deployed Engineer (Atlanta)

2mo ago

Atlanta, GA
On-site
Full-time

Evals & Observability

LangGraph
LangChain
Evals

Anthropic

Applied AI Engineer, Enterprise

2mo ago

Paris, France
On-site
Full-time

Evals & Observability

Evals

Anthropic

Applied AI Engineer, Enterprise

2mo ago

Munich, Germany
On-site
Full-time

Evals & Observability

Evals

Anthropic

Forward Deployed Engineer

2mo ago

Munich, Germany
On-site
Full-time

Evals & Observability

MCP
Evals
Python
TypeScript

Anthropic

Forward Deployed Engineer

2mo ago

Paris, France
On-site
Full-time

Evals & Observability

MCP
Evals
Python
TypeScript

Databricks

Sr. Specialist Solutions Architect

3mo ago

Melbourne, Australia; Sydney, Australia
On-site
Full-time

Evals & Observability

LangChain
Multi-Agent
RAG

LangChain

Frontend Engineer, AI Observability & Evals Platform

3mo ago

San Francisco, CA
On-site
Full-time

Evals & Observability

LangChain
Evals
TypeScript

OpenAI

Researcher, Frontier Cybersecurity Risks

3mo ago

San Francisco
On-site
Full-time
$380K – $500K

Evals & Observability

Evals
PyTorch
Fine-tuning

Databricks

Senior AI Engineer - FDE (Forward Deployed Engineer)

3mo ago

Tokyo, Japan
On-site
Full-time

Evals & Observability

LangChain
Multi-Agent
RAG

OpenAI

Applied AI Software Engineer, GTM Growth Engineering

3mo ago

San Francisco
On-site
Full-time
$266K – $405K

Evals & Observability

Evals
Python

OpenAI

Applied AI Engineer, Sign in with ChatGPT

3mo ago

San Francisco
On-site
Full-time
$197K – $280K

Evals & Observability

MCP
Evals

Anthropic

Red Team Engineer, Safeguards

4mo ago

San Francisco, CA
On-site
Full-time

Evals & Observability

Evals

OpenAI

Applied AI Engineer, Cyber | Tokyo

4mo ago

Tokyo, Japan
On-site
Full-time

Evals & Observability

Evals
Python

Anthropic

Staff+ Software Engineer, Developer Acceleration

4mo ago

San Francisco, CA | Seattle, WA
On-site
Full-time

Evals & Observability

Evals

Databricks

Specialist Solutions Architect - AI/ML

5mo ago

Mumbai, India
On-site
Full-time

Evals & Observability

LangChain
Multi-Agent
RAG

Databricks

Specialist Solutions Architect - AI/ML

5mo ago

Bengaluru, India
On-site
Full-time

Evals & Observability

LangChain
Multi-Agent
RAG

LangChain

Deployed Engineer (Seattle)

5mo ago

Seattle, WA
On-site
Full-time

Evals & Observability

LangGraph
LangChain
Evals