So now the time has come… In a new paper(https://lnkd.in/eADdp5r6), some colleagues from Standord and Rice University prove what has been bothering me for some time:
đđŋđŽđļđģđļđ˛đŋđ đēđŽđģ đđ đēđļđ đđ-đ´đ˛đģđ˛đŋđļđ˛đŋđđ˛đģ đ§đŋđŽđļđģđļđģđ´đđąđŽđđ˛đģ, đđ˛đŋđąđ˛đģ đąđļđ˛ đđŋđ´đ˛đ¯đģđļđđđ˛ đđ°đĩđšđ˛đ°đĩđđ˛đŋ (i.e. they are becoming more and more similar).
This effect is impressively demonstrated in the paper using the example of image generation, but in general this applies to any type of generative AI!
So also, for example, if you train
Chat-GPT with data generated by Chat-GPT…
AI then cannibalizes itself at some point.
We are currently living in an age in which the ratio of generated to real data is still very favorable (AI is only just beginning).
However, this is changing rapidly.
And that means that we will soon have nothing left with which we can train the AIs in a meaningful way (almost all available data is already trained in the large language models anyway).
Because even if new information is constantly being produced – if we cannot distinguish between what is human-generated and what is AI-generated, then we will no longer be able to use anything qualified for training, i.e. our AIs will no longer improve at some point.
đđ˛đŋđŽđąđ˛ đŗđĖđŋ đ¨đģđđ˛đŋđģđ˛đĩđēđ˛đģ đļđđ đąđŽđ đąđ˛đŋ đ¯đšđŽđģđ¸đ˛ đđŧđŋđŋđŧđŋ!
As soon as your company’s employees start using generative AI in an uncontrolled/unguided manner, you are digging your own potential data grave, because at some point you will no longer be able to rely on your data.
And your data is your capital…
đđŽđĩđ˛đŋ đēđđđ đŽđ¸đđđ˛đšđš đąđļđ˛ đŧđ¯đ˛đŋđđđ˛ đŖđŋđļđŧđŋđļđđŽĖđ đđ˛đļđģ, đđ-đđŽđđ˛đģ đđ đ¸đ˛đģđģđđ˛đļđ°đĩđģđ˛đģ!
Difficult to impossible in public, but fortunately feasible within the company.
If you don’t know how to do this, please contact me!
—
P.S.: Of course, there are also applications where synthetic data is very helpful.
However, these are isolated exceptions and not the general rule.
P.P.S.: here are some of my previous posts on this topic:
https://lnkd.in/eY8rC8C7
https://lnkd.in/e3bcJ_92
https://lnkd.in/efAex_M2
https://lnkd.in/eHZMm6KZ
P.P.P.S.: I generated the cover picture with Midjourney.
Because our Generative AI is still working đ
