Meta open sources a language model built on publicly available data that outperforms GPT-3 (at less than 1/10th the inference cost)
!
!
Clear threat to openAI/MSFT
This could take the wind out of OpenAIβs language API calls just like Stable Diffusion shifted developer activity away from Dall-E
This could take the wind out of OpenAIβs language API calls just like Stable Diffusion shifted developer activity away from Dall-E
Suspect youβll see a lot of activity migrate over to this.
All AI startups that have a call to an openAI GPT-3 API will want to look at running direct on AWS using this much less expensive model as the foundation
All AI startups that have a call to an openAI GPT-3 API will want to look at running direct on AWS using this much less expensive model as the foundation
A reinforcement learning with human feedback overlay on top of this model may become a separate part of the value chain.
In effect packaged human tuning of this open source model becomes its own business.
In effect packaged human tuning of this open source model becomes its own business.
(There is a real discrepancy between the attributed license and the terms that Meta asks you to sign to when you request the model weights)
Loading suggestions...