2 posts tagged with "nlp"

Image credit: DALL-E 3 by OpenAI

Prompt: "lets make a cool image for RAG fusion, with some nuclear theme"

Last week we published our first significant RAG pipeline refactor since releasing the bot for limited testing.

Even if we are just getting started, the results so far look promising. These techniques are being explored by many teams around the world and learning from the best can save us time and effort.

Here is one to take a look at:

https://towardsdatascience.com/forget-rag-the-future-is-rag-fusion-1147298d8ad1

Image credit: DALL-E 3 by OpenAI

Prompt: "high-tech graphic showing multi-stage text processing"

With all the focus on chat bots, it can be easy to forget how relevant large language models are for general purpose NLP tasks. Natural Language Processing is a broad field with an extensive history of specialized tool development for specific tasks. By connecting different models together with various pre- and post-processors, it is possible to hardwire an effective, multi-stage pipeline. But if something were to change in your input data, your entire downstream processing might be affected.

With the advent of LLMs, we got a new way of constructing processing pipelines. Rather than setup discrete processing stages, we could simply pack a whole series of instructions into a single prompt. Social media quickly started filling up with examples of amazing super-prompts. So what's the catch?