Business Analyst, AI Response Evaluation Specialist
- Remote, United States
- Mid-level
- Posted 4 weeks ago
or apply from Claude / ChatGPT / Muse
Business analyst role on a project that scores and compares chatbot answers against business criteria; five days a week with two weekdays off.
About the role
Assessing AI-generated answers against agreed quality criteria and turning the findings into structured, evidence-based reports that help technical and business teams improve the systems.
At a glance
- Pay
- Not stated in the posting
- Remote scope
- Remote, United States
- Seniority
- Mid-level
- Skills
- Excel, SQL, Power BI, Tableau, UAT
- Posted
- 19 Oct 2026
- Last checked
- 15 Nov 2026
What you will do
- Collect and write down business requirements, stakeholder expectations and project goals.
- Score several chatbot replies on accuracy, relevance, completeness and fit with the criteria.
- Turn requirements into functional specs, evaluation criteria and usable documentation.
- Map workflows and data to find gaps, inefficiencies and chances to improve.
What they look for
- Three or more years as a business analyst or in a comparable analytical job.
- Comfort with Excel plus SQL, Power BI, Tableau or similar reporting tools.
- Clear writing for reports and documentation, and a careful eye for detail.
How Keywordise applies for you
Alex Demo
[email protected]
From your CV
Yes, fully remote
- Sent
- 09:41
- Attached
- Your tailored CV
- 1Upload your CVAdd your CV once. It takes about a minute.
- 2Tailored to this jobKeywordise writes a CV and a cover letter for this job from your real experience.
- 3The form fills itselfName, email, experience and screening questions, field by field.
- 4Application sentYou get a receipt and follow it in your dashboard.
Apply with Keywordise AI7-day free trial, no card.
Apply from your AI assistant
Connect Keywordise to your assistant once, then send it the prompt. It applies for you.
Claude
- In Claude, open Settings, then Connectors, and choose Add custom connector.
- Name it Keywordise and paste the connector URL.
- Click Connect, log in to Keywordise and approve. Then send the prompt in a new chat.
https://keywordise.com/mcpDisconnect any time in your Keywordise settings.
ChatGPT
- In ChatGPT, open Settings, then Connectors. On plans that need it, turn on developer mode first.
- Add a new connector with the connector URL and choose OAuth. Leave the client ID and secret empty.
- Log in to Keywordise and approve. Then send the prompt in a new chat.
https://keywordise.com/mcpDisconnect any time in your Keywordise settings.
Muse
- Open Muse (muse.ai or the app) and send it the message below.
- If Muse asks how to sign in, answer OAuth. Open the sign-in link it sends, log in to Keywordise and approve.
- Send the prompt. Muse asks before it sends anything.
Add a custom connector called Keywordise. It is a remote MCP server at https://keywordise.com/mcp and uses OAuth. Give me the sign-in link.Muse is available in the US only for now.
Apply to Keywordise job vtgihttwazQuestions about this job
Can I do this job remotely, and from which countries?
The posting lists it as remote for people in the United States.
What does this job pay?
No pay range is stated in the posting.
What experience is needed?
It is a mid-level role. The posting asks for: three or more years as a business analyst or in a comparable analytical job; comfort with Excel plus SQL, Power BI, Tableau or similar reporting tools; clear writing for reports and documentation, and a careful eye for detail. Skills it names include Excel, SQL, Power BI, Tableau.
How do I apply with Keywordise AI?
Click Apply with Keywordise AI, create an account and upload your CV. Your CV and cover letter are written for this job from what you have really done, then Keywordise applies for you. Trial: 7 days, no card.
More remote business and finance jobs
- GGramianBusiness Analyst (AI Training)
- Remote, United States
- A large company with a pricing center of excellencePricing Strategy Analyst
- Remote, United States
- SSentaraEnterprise Analytics Consultant
- Remote, worldwide
BusinessolverManager, Finance Business Partner- Remote, United States
- WEWEXBusiness Solutions Specialist
- Remote, United States
- RRRMA Renal Treatment Centers - Mid Atlantic, Inc.Analyst, Reporting (ROPS)
- Remote, worldwide