1.1.0 - Override AI Test Results & AI Efficacy Insights
We’ve introduced the ability to override AI-generated test results, giving users greater control, transparency, and accuracy in their validation workflows. [embed: https://www.youtube.com/watch?v=cyOsNH3vX0g] Users can now manually change a test outcome (pass/fail) and provide an override reason, ensuring that edge cases, environmental factors, or known limitations are properly captured. Overrides can be applied directly from the test results list or within the detailed test run view, alongside actions and screenshots. All overridden results are tracked and visible, including the reason for override and the complexity of the affected tests. This not only improves auditability but also provides valuable context when reviewing outcomes. These human-reviewed adjustments play a critical role in improving AI performance over time. By feeding real-world corrections back into the system, we enable continuous learning and more accurate future results. To support this, we’ve also introduced AI Efficacy graphs, offering clear visibility into: The number of overridden tests over time The percentage of results that have been human-reviewed This reinforces a key principle of the platform: human-in-the-loop validation. By combining AI-driven automation with expert oversight, you get the best of both worlds—speed, scale, and confidence in your results. See the Known and Fixed issues list for important changes outside of features: https://learn.rimo3.com/knowledge-base/atp360-known-and-fixed-issues
