Reliability Score

Estimated reading: 3 minutes

The Reliability Score page evaluates the strength and stability of locators generated for recorded UI elements. It analyzes the properties used to identify each element and assigns a score based on how consistently and uniquely the locator can identify the element during automation execution.

A higher score indicates a more stable locator that is less likely to break when the application’s UI changes. A lower score suggests that the locator may require improvement to ensure reliable automation execution.

The page also provides recommendations to help improve locator quality before running the automation.

Overview

The Reliability Score page displays the following metrics:

a. Total Events: Total number of recorded UI actions analyzed.
b. Strong (≥80%): Number of elements with highly reliable locators.
c. Moderate (50%-79%): Number of elements with acceptable reliability that may benefit from optimization.
d. Weak (<50%): Number of elements with low reliability and a higher risk of failure.

Available Options

a. Search: Find a recorded element by name.
b. Show Weak Only: Display only elements with weak reliability scores.
c. Clear: Remove applied filters.

Element Details: Select an element from the left panel to view a detailed analysis of its locator.

Locator Reliability

The Locator Reliability score indicates the overall quality and stability of the locator used to identify the selected UI element.

Example: A score of 55/100 (Moderate) indicates that the locator can identify the element successfully but may become unreliable if the application’s UI structure changes.

Reviewing locator reliability helps identify potential weaknesses and improve automation stability.

Property Scores

Each locator property contributes to the overall reliability score.

Selector Properties

Property	Description
AutomationId	Unique identifier assigned by the application. A stable and unique AutomationId significantly improves selector reliability.
ClassName	The UI control's class name used for element identification.
Role	The control type, such as Button, TextBox, or Graphic.
Name	The visible or accessible name of the UI element.
Index	The position of the element among similar controls. Since positions can change, index-based identification is generally less reliable.
Anchor	Uses nearby stable elements as reference points to locate the target element.
XPath	Identifies the element using its location within the UI hierarchy. Long or deeply nested XPath expressions are typically less reliable.

Note: Each property displays its individual contribution to the overall reliability score, helping you evaluate the effectiveness of the selector and identify potential areas for improvement.

Locator Complexity

The Locator Complexity section provides additional metrics that help assess locator maintainability and stability.

Node Count

Displays the number of UI nodes used to identify the element. Higher counts generally indicate a more complex locator.

Anchor Depth

Shows how deeply the anchor element is located within the UI hierarchy. Lower values are typically more stable and easier to maintain.

XPath Length

Displays the total length of the generated XPath expression. Shorter XPath expressions are generally easier to maintain and less susceptible to UI changes.

Reliability Levels

Score	Status	Description
80% and above	Strong	The locator is highly reliable and is expected to remain stable across application changes.
50% - 79%	Moderate	The locator is usable but may benefit from optimization for improved long-term stability.
Below 50%	Weak	The locator has a high risk of failure and should be reviewed before execution.

Reliability Score

Locator Reliability

Property Scores

Selector Properties

Locator Complexity

Reliability Levels

Reliability Score

CONTENTS