CoastHiring

AI Operations Engineer

  • New York, NY
  • Mid-level
  • Posted 10 days ago
In one line

Builder role on a two-person internal AI team at a fleet payments company, shipping agents that teams use every day.

About the role

Suits someone who likes to sit with a team, map how work really happens, then build the agent that takes it over. Success shows up as hours saved and agents that keep improving.

At a glance

Pay
Not stated in the posting
Location
New York, NY
Seniority
Mid-level
Skills
Claude, Evals
Posted
6 Nov 2026
Last checked
16 Nov 2026

What you will do

  • Build event-driven agents that handle multi-step work across the stack, including loops, handoffs and escalation to people
  • Trace every run, score outputs against test sets from real outcomes and keep reliability, latency and cost in check
  • Architect shared foundations such as knowledge bases, databases, templates, tools and connectors, then teach people to use them

What they look for

  • Comfortable writing code some weeks and running a workshop or redesigning a process in others
  • Can design agent loops, sub-agent handoffs and decide when an agent acts alone or asks a human
  • Able to model shared memory as a knowledge graph and control what each agent sees, keeps and drops

Nice to have

  • Experience trying new models and tools as they land and measuring them against what is already running

A typical week

  • Some weeks are mostly coding on agent tooling and orchestration
  • Other weeks go to workshops with teams and process redesign
  • Time goes to tracing runs, checking evals and watching production cost and latency
  • Office hours, training and hackathons to help colleagues build their own skills

How Keywordise applies for you

  1. 1Upload your CVAdd your CV once. It takes about a minute.
  2. 2Tailored to this jobKeywordise writes a CV and a cover letter for this job from your real experience.
  3. 3The form fills itselfName, email, experience and screening questions, field by field.
  4. 4Application sentYou get a receipt and follow it in your dashboard.

Apply with Keywordise AI7-day free trial, no card.

Apply from your AI assistant

Connect Keywordise to your assistant once, then send it the prompt. It applies for you.

Claude

  1. In Claude, open Settings, then Connectors, and choose Add custom connector.
  2. Name it Keywordise and paste the connector URL.
  3. Click Connect, log in to Keywordise and approve. Then send the prompt in a new chat.
Connector URL
https://keywordise.com/mcp

Disconnect any time in your Keywordise settings.

ChatGPT

  1. In ChatGPT, open Settings, then Connectors. On plans that need it, turn on developer mode first.
  2. Add a new connector with the connector URL and choose OAuth. Leave the client ID and secret empty.
  3. Log in to Keywordise and approve. Then send the prompt in a new chat.
Connector URL
https://keywordise.com/mcp

Disconnect any time in your Keywordise settings.

Muse

  1. Open Muse (muse.ai or the app) and send it the message below.
  2. If Muse asks how to sign in, answer OAuth. Open the sign-in link it sends, log in to Keywordise and approve.
  3. Send the prompt. Muse asks before it sends anything.
Message for Muse
Add a custom connector called Keywordise. It is a remote MCP server at https://keywordise.com/mcp and uses OAuth. Give me the sign-in link.

Muse is available in the US only for now.

Prompt
Apply to Keywordise job 3233koq7st
How to connect

Questions about this job

Where is this job based?

The posting lists AI Operations Engineer as a role based in New York, NY, United States.

What does this job pay?

No pay range is stated in the posting.

What experience is needed?

It is a mid-level role. The posting asks for: comfortable writing code some weeks and running a workshop or redesigning a process in others; can design agent loops, sub-agent handoffs and decide when an agent acts alone or asks a human; able to model shared memory as a knowledge graph and control what each agent sees, keeps and drops. Skills it names include Claude, Evals.

How do I apply with Keywordise AI?

Press the Apply with Keywordise AI button and add your CV. Keywordise tailors your CV and cover letter to this posting and sends the application for you, with a free 7-day trial and no card.

More IT and software jobs in New York, NY

All IT and software jobs in New York, NY
CoastNew York, NY
Apply with Keywordise AI