OpenSearchCon Europe 2025

There are lots of statistics we can calculate for search relevance: NDCG, precision, MAP, …. OpenSearch 3.0 calculates and displays them for you.

But metrics don’t tell the whole story. In particular, NDCG can’t give you the qualitative analysis that one algorithm is great for author names, and a different one is good for shapes and sizes. For that, you need eyeballing, that is, human intuition and judgment.

That’s why we’ve built tools to help you dig deeper into your search results. The Search Comparison tool in OpenSearch 2.11 is just the starting point – in 3.0, it lets you define search configurations and test sets of multiple queries and determine which queries’ results have changed the most… and then zoom in to the individual cases. You can integrate data on judgments and query frequency from User Behavior Insights for deeper analysis.

In this talk, we’ll discuss how traditional statistical metrics are complemented by eyeballing, how the new tools in OpenSearch 3.0 support disciplined eyeballing, and how you can use them to improve the quality of your search results.

In this technical session, I'll demonstrate practical implementations of OpenSearch Security Analytics powered by community-driven detection rules. Through hands-on examples, you'll learn:

1. Configuring Security Analytics dashboards for threat detection
2. Building and sharing custom detection rules that benefit the community
3. Testing and validating community-contributed security rules
4. Contributing your validated rules back to OpenSearch

The demonstrations will cover security rule syntax, detection logic, and dashboard configuration. You'll learn both the technical implementation and the collaborative workflow for sharing security rules with the community. We'll explore how shared security patterns strengthen the entire OpenSearch ecosystem, turning individual security insights into community-wide protection.

Target Audience: Security practitioners and OpenSearch operators with basic security monitoring knowledge.