Skip to main content

​
What is Rocky AI Root Cause Analysis?

Rocky AI — Checkly’s AI service — can automatically analyze, categorize and summarize any failure or error from one of Checkly’s synthetic checks and / or monitoring checks.
Light mode Rocky AI Root Cause Analysis
Using any available artifacts like error message, user code, logs, metrics, trace routes, packet captures, Playwright traces, screenshots and other evidence, it will quickly assess what the impact is of a failure and what the underlying (possible) root cause is. It will also provide a suggested code fix for any check based on (Playwright) code.

​
How do I use Rocky AI Root Cause Analysis?

  1. Make sure Rocky AI is enabled in its settings page.
  2. Click the “Analyze Root Cause” button on any failing check result, test session result and / or error group.
Rocky AI Root Cause Analysis is available for all synthetic and monitor check types in both testing and monitoring use cases.

​
Automatic analysis

When Rocky AI is enabled, it automatically generates a root cause analysis for every new error group. This is on by default — no manual action is needed for new errors to be analyzed. Each automatic analysis counts as one AI invocation against your plan’s invocation quota. If the same analysis is sent to multiple alert channels, it still counts as a single invocation. You can disable automatic analysis in the Rocky AI settings if you prefer to only run analyses manually.
When automatic analysis is enabled, AI-generated fields like root cause and user impact are included in your alert notifications. You can use these fields in custom webhook payloads — see Using AI analysis data in webhooks.

​
Key Capabilities

  • Categorize: Rocky AI determines if an error is of a specific category. For example: is it a typo in your code or is it an infrastructure error?
  • End-user impact: Rocky AI analyzes the failure and provides you with a list of impacted user groups and features. The text used is generated by AI and can be enriched with organisation-specific domain knowledge using the Tag description editor the AI settings screen.
  • Step summary: Where applicable, Rocky AI summarizes the steps in the check script, making it easier to understand what the check is doing and where it failed. This typically works for any Playwright based check.
  • Root cause: Rocky AI analyzes the failure and provides you with a root cause analysis, helping you quickly remediate the issue. It uses any and all available artifacts to come to this analysis and list these artifacts as “evidence”.
Light mode Rocky AI Root Cause Analysis

​
Benefits

  • Faster Triaging: Determine if it is a typo in a script or an infrastructure error
  • Reduced Manual Work: Automate routine analysis tasks
  • Better Understanding: Gain deeper insights into system behavior
  • Proactive Management: Identify issues before they become problems
For more information on AI, security and data privacy see the general Rocky AI page