IT · BZ - 30015

Senior AI Engineer

Complete the application form

New York City, New York, United StatesOn-site / hybrid
On-site / hybrid role. Based in New York City, New York.

Candidates should live in or near New York City, or be able to relocate. Check the description for the on-site schedule.

Key skills

  • Python
  • CI/CD
  • Risk Management

About the role

We are seeking a hands-on Senior AI Engineer to design, develop, and operationalize agentic AI applications for risk management. This role is based in New York City and requires in-person collaboration.

What you’ll do

  • Design and build modular, maintainable Python applications, APIs, and services that integrate LLMs, enterprise data, and business tools.
  • Develop LangGraph-based agent workflows with explicit state, conditional routing, tool execution, checkpointing, and human-in-the-loop approval or escalation.
  • Engineer the context supplied to agents by selecting and assembling relevant instructions, retrieved information, tool outputs, and conversation history.
  • Design, version, and test prompts, including structured outputs, grounding instructions, and safe handling of incomplete or conflicting information.
  • Implement appropriate short- and long-term memory strategies, including persistence, retrieval, summarization, retention, and isolation between users and sessions.
  • Build evaluation frameworks with representative datasets, repeatable regression tests, and appropriate automated and human evaluation.
  • Implement LLM and agent observability using Galileo or comparable platforms, including execution traces, quality signals, latency, token usage, cost, and failure analysis.
  • Apply guardrails for prompt injection, unsafe tool use, sensitive-data exposure, and unsupported outputs.
  • Collaborate with risk specialists, product owners, data engineers, and platform teams to translate requirements into tested applications.
  • Contribute technical design reviews, code reviews, documentation, and engineering guidance while remaining actively involved in coding.

What you’ll bring

  • Strong hands-on Python software engineering, including application design, asynchronous programming, APIs, automated testing, error handling, and maintainable code.
  • Demonstrated experience implementing AI agents with LangGraph, including stateful orchestration and integration with external tools or services.
  • Practical understanding of LLMs, embeddings, retrieval-augmented generation (RAG), vector search, and the tradeoffs involved in retrieval and context assembly.
  • Hands-on experience with context engineering, prompt engineering, and agent memory management.
  • Experience designing and implementing evaluation frameworks for LLM or agent applications.
  • Experience with Galileo or a comparable LLM/agent evaluation and observability platform.
  • Experience delivering and supporting deployed applications, with sound understanding of security, reliability, version control, CI/CD, and production troubleshooting.
  • Ability to explain technical decisions and collaborate effectively with business and engineering stakeholders.

The practical details

Location
New York City, New York, United States
Postal code
10001
Work arrangement
On-site / hybrid
Industry
IT
Employment type
Contract
Expected start
Expected end
N/A
Applications close
Posted
Job code
BZ - 30015

Senior AI EngineerNew York City, New York · On-site / hybrid

Apply