Name: PutOpenSearchVector QueryOpenSearchVector: Use Case of Two Python NiFi Processors for OpenSearch - Vincenzo Lombardo, Seacom
Start: 2025-05-01T13:45:00+0200
End: 2025-05-01T14:05:00+0200

In-person
30 April - 1 May 2025
Learn More and Register to Attend

The Sched app allows you to build your schedule but is not a substitute for your event registration. You must be registered for OpenSearchCon Europe 2025 to participate in the sessions. If you have not registered but would like to join us, please go to the event registration page to purchase a registration.

Please note: This schedule is automatically displayed in Central European Summer Time (UTC+02:00). To see the schedule in your preferred timezone, please select from the drop-down located at the bottom of the menu to the right.

IMPORTANT NOTE: Timing of sessions and room locations are subject to change.

Thursday May 1, 2025 13:45 - 14:05 CEST

Zurich II

With NiFi version 2.x, the ability to interface with OpenSearch using pre-built Python components (processors) was introduced.

These processors address various needs related to AI solutions, specifically vector embedding using tools like ChatGPT or HuggingFace. The selection and implementation of these components were partly driven by the increasing interest in these topics in recent times.

In the presentation, we will showcase an ETL flow for populating an OpenSearch index with vector fields. The flow is built using NiFi for both data acquisition and vector embedding generation, as well as querying via the dedicated OpenSearch components.

A growing trend in recent times is the demand for AI systems that use local engines, independent of external access.

As an example of possible application, we will present a solution based on customizing PutOpenSearchVector QueryOpenSearchVector processors to perform vector embedding and search using local LLMs based on Ollama.

Speakers

Vincenzo Lombardo

Operations Manager and Team Leader Nifi, Seacom

I follow the technologies related to the No Code area with a focus mainly on the nifi ecosystem (nifi, minifi, nifi registry, c2 server, nifikop) and its use in the etl field and integration with other information systems. I have experience in the search field (Google Search Appliance... Read More →

Thursday May 1, 2025 13:45 - 14:05 CEST
Zurich II

OpenSearchCon Europe 2025

Vincenzo Lombardo

Sign up or log in to save this to your schedule, view media, leave feedback and see who's attending!