IT · BZ - 30015
Senior AI Engineer
Complete the application form
On-site / hybrid role. Based in New York City, New York.
Candidates should live in or near New York City, or be able to relocate. Check the description for the on-site schedule.
Key skills
- Python
- CI/CD
- Risk Management
About the role
We are seeking a hands-on Senior AI Engineer to design, develop, and operationalize agentic AI applications for risk management. This role is based in New York City and requires in-person collaboration.
What you’ll do
- Design and build modular, maintainable Python applications, APIs, and services that integrate LLMs, enterprise data, and business tools.
- Develop LangGraph-based agent workflows with explicit state, conditional routing, tool execution, checkpointing, and human-in-the-loop approval or escalation.
- Engineer the context supplied to agents by selecting and assembling relevant instructions, retrieved information, tool outputs, and conversation history.
- Design, version, and test prompts, including structured outputs, grounding instructions, and safe handling of incomplete or conflicting information.
- Implement appropriate short- and long-term memory strategies, including persistence, retrieval, summarization, retention, and isolation between users and sessions.
- Build evaluation frameworks with representative datasets, repeatable regression tests, and appropriate automated and human evaluation.
- Implement LLM and agent observability using Galileo or comparable platforms, including execution traces, quality signals, latency, token usage, cost, and failure analysis.
- Apply guardrails for prompt injection, unsafe tool use, sensitive-data exposure, and unsupported outputs.
- Collaborate with risk specialists, product owners, data engineers, and platform teams to translate requirements into tested applications.
- Contribute technical design reviews, code reviews, documentation, and engineering guidance while remaining actively involved in coding.
What you’ll bring
- Strong hands-on Python software engineering, including application design, asynchronous programming, APIs, automated testing, error handling, and maintainable code.
- Demonstrated experience implementing AI agents with LangGraph, including stateful orchestration and integration with external tools or services.
- Practical understanding of LLMs, embeddings, retrieval-augmented generation (RAG), vector search, and the tradeoffs involved in retrieval and context assembly.
- Hands-on experience with context engineering, prompt engineering, and agent memory management.
- Experience designing and implementing evaluation frameworks for LLM or agent applications.
- Experience with Galileo or a comparable LLM/agent evaluation and observability platform.
- Experience delivering and supporting deployed applications, with sound understanding of security, reliability, version control, CI/CD, and production troubleshooting.
- Ability to explain technical decisions and collaborate effectively with business and engineering stakeholders.
The practical details
- Location
- New York City, New York, United States
- Postal code
- 10001
- Work arrangement
- On-site / hybrid
- Industry
- IT
- Employment type
- Contract
- Expected start
- Expected end
- N/A
- Applications close
- Posted
- Job code
- BZ - 30015
Senior AI EngineerNew York City, New York · On-site / hybrid
Apply