Sr. AI Engineer Primary Objective
Provide technical leadership for AI application support, prompt tuning, model evaluation, root-cause analysis, and continuous improvement of the Picarro AI Assistant.
Responsibilities Analyze and troubleshoot AI-related production issues within the approved support scope. Perform prompt tuning, retrieval tuning, and knowledge-grounding optimizations for existing functionality. Review low-confidence responses, hallucination patterns, and user feedback trends. Conduct root-cause analysis for AI performance and response-quality issues. Support evaluation and testing of LLM behavior changes resulting from model updates or content updates. Recommend improvements to prompts, guardrails, embeddings, and retrieval configurations. Collaborate with Picarro SMEs to validate AI responses and business context. Provide technical oversight for defect resolution activities. Support regression testing of AI workflows after approved changes. Estimate support effort and raise change requests for items outside the agreed scope. Maintain AI tuning, support, and resolution documentation.