AI Operations Specialist - LLM & Conversation Systems

AI Operations Specialist – LLM, Prompt Engineering & Conversation Systems | Remote Position Type: Full-Time, Remote Working Hours: U.S. Business Hours Industry: Artificial Intelligence / SaaS / Telehealth Technology Department: AI Operations / Conversational AI Focus: Production LLM Systems, AI Conversation Optimization & Conversion Performance About the Role At Pavago , one of our clients is hiring a highly skilled AI Operations Specialist to manage, monitor, troubleshoot, and continuously optimize production AI conversation systems. Our client operates an AI-powered SMS lead recovery platform serving telehealth brands , processing millions of messages every month. These AI systems communicate directly with customers, making conversation quality, reliability, and conversion performance critical to business success. This is a hands-on, execution-focused role for someone with proven experience operating Large Language Model (LLM) systems in production , rather than simply experimenting with AI tools. You’ll be responsible for onboarding new clients, configuring AI conversation workflows, managing knowledge bases and integrations, monitoring live customer interactions, identifying AI failure modes, optimizing prompts, and measuring the impact of changes on conversion performance. The ideal candidate combines technical AI knowledge, prompt engineering expertise, analytical thinking, and operational ownership with the ability to work independently in a fast-moving environ