{"id":666,"date":"2024-02-01T12:25:10","date_gmt":"2024-02-01T12:25:10","guid":{"rendered":"https:\/\/www.stefan-wagenpfeil.de\/unkategorisiert\/retrieval-augmented-generation-rag\/"},"modified":"2024-06-10T13:19:03","modified_gmt":"2024-06-10T13:19:03","slug":"retrieval-augmented-generation-rag","status":"publish","type":"post","link":"https:\/\/www.stefan-wagenpfeil.de\/en\/unkategorisiert\/retrieval-augmented-generation-rag\/","title":{"rendered":"Retrieval Augmented Generation (RAG)"},"content":{"rendered":"\n

Retrieval Augmented Generation (RAG) in the AI environment…. What is this again? <\/p>\n\n

Yesterday, Microsoft and NVIDIA held an interesting event in Munich on “Industrial Metaverse”, of course packed with the latest graphics, crazy computing and computing power, parallelization, and lots of generative AI that can be used to simulate, train, and build digital twins for manufacturing, automotive, etc. <\/p>\n\n

In Ekaterina Sirazitdinova<\/a> ‘s presentation, a very nice and catchy graphic on the subject of RAG was shown (see also below, (c) NVIDIA) and I would like to briefly lose a few thoughts on this term…. <\/p>\n\n

We all know the problem that GenAI systems sometimes hallucinate that people suddenly have three legs and that texts are somehow generated in a strange way. This is always quite easy to recognize in pictures, but often not in texts or “data”. In particular, if artificial data has to be generated and annotated to train models (see below), such errors can naturally propagate into the later models and lead to very unattractive effects. The wonderful old rule applies here: shit-in > shit-out. This problem is now being tackled by means of RAG. <\/p>\n\n

This involves comparing data generated with GenAI (= artificial data) with real information (= real data). E.g. it is checked that people actually only have two legs instead of three. Generated data that does not conform to the model is discarded. This enrichment (= augmentation) of generated data with verified information naturally requires that the latter can also be found quickly and efficiently. Classic methods from information retrieval are used here, such as Graph databases (see also https:\/\/lnkd.in\/ekTt_hYb)<\/a>. So you try to combine the best of two worlds. <\/p>\n\n

Of course, this approach stands and falls with the fact that a review is possible at all. But since we have been working in information retrieval for decades on algorithms, concepts, databases, feature graphs and ontologies that provide such information in a (more or less) structured form, this is quite promising and could also enable approaches to the verifiability of AI. <\/p>\n\n

An important point here is the need to have realistic, comprehensive, correct and annotated data sets for the training of AI. So that an AI can, for example recognizes defective screws, 10,000s of images of defective screws must be available for training. However, since we often cannot break 10,000 screws, such images are generated in all conceivable variants using GenAI and then given to the image recognition system for training. The better these are, the better the “real broken screws” will be recognized later. <\/p>\n\n

In my view, RAG will play a central role in the AI environment in the future!<\/p>\n","protected":false},"excerpt":{"rendered":"

Retrieval Augmented Generation (RAG) in the AI environment…. What is this again? Yesterday, Microsoft and NVIDIA held an interesting event in Munich on “Industrial Metaverse”, of course packed with the latest graphics, crazy computing and computing power, parallelization, and lots Continue Reading<\/a><\/span><\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[1],"tags":[],"yoast_head":"\nRetrieval Augmented Generation (RAG) - Prof. Dr.-Ing. Stefan Wagenpfeil<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.stefan-wagenpfeil.de\/en\/unkategorisiert\/retrieval-augmented-generation-rag\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Retrieval Augmented Generation (RAG) - Prof. Dr.-Ing. Stefan Wagenpfeil\" \/>\n<meta property=\"og:description\" content=\"Retrieval Augmented Generation (RAG) in the AI environment…. What is this again? Yesterday, Microsoft and NVIDIA held an interesting event in Munich on “Industrial Metaverse”, of course packed with the latest graphics, crazy computing and computing power, parallelization, and lots Continue Reading\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.stefan-wagenpfeil.de\/en\/unkategorisiert\/retrieval-augmented-generation-rag\/\" \/>\n<meta property=\"og:site_name\" content=\"Prof. Dr.-Ing. Stefan Wagenpfeil\" \/>\n<meta property=\"article:published_time\" content=\"2024-02-01T12:25:10+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2024-06-10T13:19:03+00:00\" \/>\n<meta name=\"author\" content=\"admin\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"admin\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"2 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\/\/www.stefan-wagenpfeil.de\/en\/unkategorisiert\/retrieval-augmented-generation-rag\/\",\"url\":\"https:\/\/www.stefan-wagenpfeil.de\/en\/unkategorisiert\/retrieval-augmented-generation-rag\/\",\"name\":\"Retrieval Augmented Generation (RAG) - Prof. Dr.-Ing. Stefan Wagenpfeil\",\"isPartOf\":{\"@id\":\"https:\/\/www.stefan-wagenpfeil.de\/en\/#website\"},\"datePublished\":\"2024-02-01T12:25:10+00:00\",\"dateModified\":\"2024-06-10T13:19:03+00:00\",\"author\":{\"@id\":\"https:\/\/www.stefan-wagenpfeil.de\/en\/#\/schema\/person\/ed92f1680d5c102ab0092d8214ca4bf8\"},\"breadcrumb\":{\"@id\":\"https:\/\/www.stefan-wagenpfeil.de\/en\/unkategorisiert\/retrieval-augmented-generation-rag\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/www.stefan-wagenpfeil.de\/en\/unkategorisiert\/retrieval-augmented-generation-rag\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/www.stefan-wagenpfeil.de\/en\/unkategorisiert\/retrieval-augmented-generation-rag\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Startseite\",\"item\":\"https:\/\/www.stefan-wagenpfeil.de\/en\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Retrieval Augmented Generation (RAG)\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/www.stefan-wagenpfeil.de\/en\/#website\",\"url\":\"https:\/\/www.stefan-wagenpfeil.de\/en\/\",\"name\":\"Prof. Dr.-Ing. Stefan Wagenpfeil\",\"description\":\"Software Engineering | IT-Management | Gutachter f\u00fcr Informatik\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/www.stefan-wagenpfeil.de\/en\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Person\",\"@id\":\"https:\/\/www.stefan-wagenpfeil.de\/en\/#\/schema\/person\/ed92f1680d5c102ab0092d8214ca4bf8\",\"name\":\"admin\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.stefan-wagenpfeil.de\/en\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/364447c30e0a86fe1a0790af9be5f43f?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/364447c30e0a86fe1a0790af9be5f43f?s=96&d=mm&r=g\",\"caption\":\"admin\"},\"sameAs\":[\"http:\/\/smart-mmir.de\"],\"url\":\"https:\/\/www.stefan-wagenpfeil.de\/en\/author\/admin\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Retrieval Augmented Generation (RAG) - Prof. Dr.-Ing. Stefan Wagenpfeil","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.stefan-wagenpfeil.de\/en\/unkategorisiert\/retrieval-augmented-generation-rag\/","og_locale":"en_US","og_type":"article","og_title":"Retrieval Augmented Generation (RAG) - Prof. Dr.-Ing. Stefan Wagenpfeil","og_description":"Retrieval Augmented Generation (RAG) in the AI environment…. What is this again? Yesterday, Microsoft and NVIDIA held an interesting event in Munich on “Industrial Metaverse”, of course packed with the latest graphics, crazy computing and computing power, parallelization, and lots Continue Reading","og_url":"https:\/\/www.stefan-wagenpfeil.de\/en\/unkategorisiert\/retrieval-augmented-generation-rag\/","og_site_name":"Prof. Dr.-Ing. Stefan Wagenpfeil","article_published_time":"2024-02-01T12:25:10+00:00","article_modified_time":"2024-06-10T13:19:03+00:00","author":"admin","twitter_card":"summary_large_image","twitter_misc":{"Written by":"admin","Est. reading time":"2 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/www.stefan-wagenpfeil.de\/en\/unkategorisiert\/retrieval-augmented-generation-rag\/","url":"https:\/\/www.stefan-wagenpfeil.de\/en\/unkategorisiert\/retrieval-augmented-generation-rag\/","name":"Retrieval Augmented Generation (RAG) - Prof. Dr.-Ing. Stefan Wagenpfeil","isPartOf":{"@id":"https:\/\/www.stefan-wagenpfeil.de\/en\/#website"},"datePublished":"2024-02-01T12:25:10+00:00","dateModified":"2024-06-10T13:19:03+00:00","author":{"@id":"https:\/\/www.stefan-wagenpfeil.de\/en\/#\/schema\/person\/ed92f1680d5c102ab0092d8214ca4bf8"},"breadcrumb":{"@id":"https:\/\/www.stefan-wagenpfeil.de\/en\/unkategorisiert\/retrieval-augmented-generation-rag\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.stefan-wagenpfeil.de\/en\/unkategorisiert\/retrieval-augmented-generation-rag\/"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/www.stefan-wagenpfeil.de\/en\/unkategorisiert\/retrieval-augmented-generation-rag\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Startseite","item":"https:\/\/www.stefan-wagenpfeil.de\/en\/"},{"@type":"ListItem","position":2,"name":"Retrieval Augmented Generation (RAG)"}]},{"@type":"WebSite","@id":"https:\/\/www.stefan-wagenpfeil.de\/en\/#website","url":"https:\/\/www.stefan-wagenpfeil.de\/en\/","name":"Prof. Dr.-Ing. Stefan Wagenpfeil","description":"Software Engineering | IT-Management | Gutachter f\u00fcr Informatik","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.stefan-wagenpfeil.de\/en\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Person","@id":"https:\/\/www.stefan-wagenpfeil.de\/en\/#\/schema\/person\/ed92f1680d5c102ab0092d8214ca4bf8","name":"admin","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.stefan-wagenpfeil.de\/en\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/364447c30e0a86fe1a0790af9be5f43f?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/364447c30e0a86fe1a0790af9be5f43f?s=96&d=mm&r=g","caption":"admin"},"sameAs":["http:\/\/smart-mmir.de"],"url":"https:\/\/www.stefan-wagenpfeil.de\/en\/author\/admin\/"}]}},"_links":{"self":[{"href":"https:\/\/www.stefan-wagenpfeil.de\/en\/wp-json\/wp\/v2\/posts\/666"}],"collection":[{"href":"https:\/\/www.stefan-wagenpfeil.de\/en\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.stefan-wagenpfeil.de\/en\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.stefan-wagenpfeil.de\/en\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.stefan-wagenpfeil.de\/en\/wp-json\/wp\/v2\/comments?post=666"}],"version-history":[{"count":1,"href":"https:\/\/www.stefan-wagenpfeil.de\/en\/wp-json\/wp\/v2\/posts\/666\/revisions"}],"predecessor-version":[{"id":668,"href":"https:\/\/www.stefan-wagenpfeil.de\/en\/wp-json\/wp\/v2\/posts\/666\/revisions\/668"}],"wp:attachment":[{"href":"https:\/\/www.stefan-wagenpfeil.de\/en\/wp-json\/wp\/v2\/media?parent=666"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.stefan-wagenpfeil.de\/en\/wp-json\/wp\/v2\/categories?post=666"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.stefan-wagenpfeil.de\/en\/wp-json\/wp\/v2\/tags?post=666"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}