Yesterday, Open AI published two new open source models(https://openai.com/index/introducing-gpt-oss/). With very exciting specifications, especially for use in companies.
Even if these models are not up to date with the current Chat GPT, they can be operated internally, especially for security-critical data. You can run a “small Chat GPT” on your own server, with your own data, without any internet connection.
Open AI is pursuing the strategy that it is better for customers to get everything from a single provider rather than relying on competitor models for internal, secure purposes. The company is thus positioning itself in all areas:
– Free online version (note: data protection issues)
– Paid version (EUR 23), better data protection, better model
– Pro version (EUR 229), Ph.D. level assistant
– Open source version for self-installation
This is not meant to be an advertisement for Open AI (God forbid), but it shows the ways in which the big AI companies are going about achieving customer loyalty as well as end-to-end solutions.
However, if you really want to approach the subject seriously (and in a corporate context), you also need to provide the appropriate hardware. An A100 from NVIDIA is recommended here, which can easily cost over 35k. However, you then also have your “own little chat GPT” in the basement…
Irrespective of this, there are of course now tons of language models from various providers. The most common is probably the Llama model from Meta, which is also used in many corporate applications.
In any case, I’m curious to see how the use of these models develops and will try it out myself.