OpenSearchCon Europe 2025

OpenSearch provides several tools for search and information retrieval, important in many stages of prompt processing. However, to be used in a varied range of industries and regulations such as healthcare, telco or finance, the solution must be proven to be secure, robust and highly available.

In this talk we will discuss how to build a secure conversational chat infra from the ground up to answer your prompts, using OpenSearch. We will explore how we can use existing features of OpenSearch to build the basis of this infra, e.g. vector search and RAG. We will discuss the latest technologies such as confidential computing and hardware acceleration to get the most out of the environment. We will also explore an OpenSearch VM operator that helps with the lifecycle of the cluster. It provides the features needed to scale, upgrade, specialize nodes in different roles according to the needs and manage security such as certificate rotation and user management.