Description
Harvey’s legal AI products depend on a shared intelligence layer that sits underneath every agent and user-facing workflow. This Staff Software Engineer role focuses on building that foundation rather than owning a single product feature.
Legal work creates unusually demanding conditions for AI. A matter can involve hundreds or thousands of documents, long-running workflows, sensitive client information, complex instructions, and very little tolerance for hallucination or inconsistent reasoning. The platform therefore has to manage what models see, how context is assembled, how state is preserved, and which model should handle a particular task.
The engineer will work on systems for context management, session state, agent memory, model integration, routing, and evaluation. Harvey operates across multiple model providers, so the platform also needs abstractions that make it possible to adopt new frontier models quickly without forcing every product team to redesign its application.
Evaluation infrastructure is another major part of the position. Product teams need shared tools for measuring agent quality, comparing model behavior, identifying regressions, and understanding whether a new prompt, routing strategy, or foundation model actually improves outcomes.
The role also includes building SDKs and reusable platform primitives for other engineers. Good developer experience matters because the AI Platform team acts as an internal multiplier: improvements here can affect every agentic product built on top of it.
Harvey is looking for substantial backend experience, production exposure to multi-model or multi-provider AI systems, and strong judgment around abstractions. Experience with function calling, memory systems, eval frameworks, agent architectures, or other high-stakes AI environments is particularly relevant.
This is a staff-level role with broad ownership. The engineer is expected to influence architecture across teams, prototype emerging AI approaches, and help determine what becomes part of Harvey’s long-term AI foundation.
Curated opportunity. Please verify details and apply via the original link below. No Signals are required for this project/job.
https://www.harvey.ai/company/careers/ebf00b72-4693-4894-b540-5f82a60fdbdc