Featured image

Recording: Haystack v2 - Office Hours

Slides: Haystack v2 - Status Update

All the material can also be found here.


In this Office Hours I’ve presented for the first time to our Discord community a preview of the upcoming 2.0 release of Haystack, which has been in the works since the start of the year. As rumors started to arise at the presence of a preview module in the latest Haystack 1.x releases, we took the opportunity to share this early draft of the project to collect early feedback.

Haystack 2.0 is a total rewrite that rethinks many of the core concepts of the framework and makes LLMs support its primary concern, but makes sure to support all the usecases its predecessor enabled. The rewrite addresses some well-know, old issues about the pipeline’s design, the relationship between the pipeline, its components, and the document stores, and aims at improving drastically the developer experience and the framework’s extensibility.

As the main designer of this rewrite, I walked the community through a slightly re-hashed version of the slide deck I’ve presented internally just a few days earlier in an All Hands on the same topic.