OpenSearchCon Europe 2025

Search engines guide users from their initial goals to the information that fulfills those goals. The retrieved items are deemed relevant when they align with the user's intent. Ensuring relevant results involves having the data in the catalog, analyzing it accurately, representing it through text and vectors, ranking it appropriately, and performing other actions.
In this session, discover how auction houses utilize vector search, powered by Amazon OpenSearch Service, to find similar items within their extensive database, enhancing the customer experience and preventing issues with counterfeit artworks, and see how it assists users in obtaining the most relevant results.
This session also uncovers some peculiarities in getting embeddings with AWS Bedrock and AWS SageMaker serverless inference for the abovementioned goals.

Dive deep into OpenSearch workload management and optimize your cluster's performance and resource allocation. This talk is suitable for both seasoned users and newcomers to OpenSearch.

We'll cover workload management fundamentals, exploring core concepts and principles specific to OpenSearch environments. You'll discover the benefits through real-world scenarios. We'll also guide you through implementation strategies, offering best practices and helping you avoid common pitfalls.

Gain insights into the various resource types supported by OpenSearch's workload management feature, enabling informed allocation decisions. We'll update you on current capabilities and provide a glimpse into the exciting future roadmap of this feature.

By attending, you'll gain actionable insights for immediate application, learn to address common OpenSearch challenges. This talk is ideal for OpenSearch administrators, DevOps professionals with large-scale search and analytics, IT decision-makers, and open-source enthusiasts.

Join us to master WLM in OpenSearch. Enhance your skills, optimize your clusters, and become part of the vibrant OpenSearch community driving innovation in search technology.

FinOps has revolutionized cloud cost management, with many vendors emerging over the years to offer tools to curb skyrocketing cloud expenses. However, in distributed organizations, where teams independently adopt observability & cloud-native tooling, cost control becomes even more challenging without centralized strategies.

This talk explores how policies can enable distributed teams to balance innovation with financial accountability. We'll examine the unique challenges of managing o11y costs in these environments, where usage often grows unpredictably due to independent decisions across teams. Starting with an overview of how observability tool pricing structures create cost variability, we'll discuss key policy-driven strategies for defining data retention limits, curbing over-collection, and aligning team usage with organizational budgets.

We'll dive into real-world examples of resource-intensive services that can quickly inflate observability costs, offer benchmarks to guide cost-effective observability practices and how to codify these into cross-organizational policies, and reveal whether your teams might be unintentionally "spamming" o11y systems with unnecessary data.

This session will provide an overview of key advancements in OpenSearch Dashboards delivered in 2024, including the launch of the next-generation OpenSearch UI. Highlights include multiple data source integration, OpenSearch Workspaces for tailored collaboration, and an enhanced Discover experience featuring natural language query capabilities. These updates have streamlined workflows, improved user experience, and expanded data visualization options.

Looking ahead, the session will outline the roadmap for OpenSearch Dashboards, focusing on enhancing user workflows, improving integration across observability modules, and simplifying data management. Attendees will gain insights into the platform’s direction and how it aims to address common challenges, including fragmented workflows, feature silos, and configuration complexities, to deliver a more unified and efficient analytics experience.

I'm breaking down key insights from our latest RFC that's shaping the future of core OpenSearch performance.
https://github.com/opensearch-project/OpenSearch/issues/16841

It touch on core fundemental issues that are essential to master to take the OpenSearch Core performance codebase to the next level.
In particular it surveys real live examples from OpenSearch and shows us patterns that are common in Operating systems Kernels and State of the art databases for reliable low latency high throughput performance.
The talk also provides background on core fundemental concepts for data plane engineering such as "Dynamic Memory Allocation", GC, GC tunning, Circular buffers, CPU branching, JIT, JMH profiling.

Geared towards developers looking to contribute to a new or existing OpenSearch or OpenSearch Dashboards plugin, this talk will explore the testing practices of the OpenSearch project in depth. We'll delve into the functional test repository and Cypress standards used for testing Dashboards plugins, providing insights into setting up robust and maintainable test suites. On the backend side, we'll cover unit, integration, and backward compatibility (BWC) testing strategies for OpenSearch plugins, ensuring stability and seamless upgrades. We'll also discuss the use of yamlRestTest for validating REST APIs and remote cluster testing to ensure seamless interoperability during development and release cycles. Finally, we'll examine the TestClusters framework from OpenSearch Core, showcasing how it simplifies testing in distributed environments. Whether you're a seasoned contributor or new to the ecosystem, this talk will equip you with the knowledge to implement effective testing in your plugins and contribute with confidence.

Forget the old search paradigms—AI is here to change everything! By blending sparse (traditional term-based) and dense (vectorized) search methods, OpenSearch creates a hybrid solution that optimizes search results, from precision to performance.

Learn how to implement hybrid search, combine neural embeddings from LLMs with traditional search techniques, and enhance scalability. This solution bridges the gap between legacy systems and AI-driven search, improving accuracy and relevance while scaling to enterprise-level needs. Transform how you search, analyze, and scale with OpenSearch.

This talk will dive deep into building a multi-region, highly scalable enterprise-grade logging platform on OpenSearch. The platform can scale to handle over 100 terabytes of log ingestion per day and store over a petabyte of log data. The speaker will discuss the key challenges encountered when building a logging solution at this scale, and share the solutions leveraging open-source components like OpenTelemetry agents for log ingestion and Data Prepper for aggregation, distillation, enrichment, and buffering. Attendees will learn best practices for constructing a comprehensive, resilient logging infrastructure on top of the OpenSearch ecosystem.