Table of Contents

1. Web Admin Overview
2. Authorization
3. Screenshots
   1. Model Completions
   2. Tasks
   3. Conversations
   4. Agents
   5. Model Tool Invocations
   6. Prompt Studio
   7. Stats

Web Admin Overview

Raif includes a web admin interface for viewing all interactions with the LLM. Assuming you have the engine mounted at /raif, you can access the admin interface at /raif/admin.

The admin interface contains sections for:

• Model Completions
• Tasks
• Conversations
• Agents
• Model Tool Invocations
• Prompt Studio
• Stats

Authorization

To control authorization for the admin interface, you can configure the authorize_admin_controller_action option in your initializer:

Raif.configure do |config|
  config.authorize_admin_controller_action = ->{ current_user&.admin? }
end

Screenshots

Model Completions

List of Raif::ModelCompletion records:

Raif::ModelCompletion record detail:

Tasks

List of Raif::Task records:

Raif::Task record detail:

Conversations

List of Raif::Conversation records:

Raif::Conversation record detail:

Agents

List of Raif::Agent records:

Raif::Agent record detail:

Model Tool Invocations

List of Raif::ModelToolInvocation records:

Raif::ModelToolInvocation record detail:

Prompt Studio

Prompt Studio lets you inspect and compare prompt templates using real database records. Select a task, conversation, or agent type, browse existing instances, and see a side-by-side comparison of the current prompt versus the prompt that was originally stored when the record was created. This makes it easy to see how template changes affect real-world inputs.

Prompt Studio is available at:

• /raif/admin/prompt_studio/tasks
• /raif/admin/prompt_studio/conversations
• /raif/admin/prompt_studio/agents

Stats

Stats & estimated cost tracking:

Aggregated task stats & estimated cost tracking:

---

Read next: Response Formats