The three AI scaling laws and what they mean for AI infrastructure

Model size, dataset size and compute all depend on the availability of necessary AI infrastructure In January 2020, a team of OpenAI researchers led by Jared Kaplan, who moved on to co-found Anthropic, published a paper titled “Scaling Laws for Neural Language Models.” The researchers observed “precise power-law scalings for performance as a function of […]

Model size, dataset size and compute all depend on the availability of necessary AI infrastructure In January 2020, a team of OpenAI researchers led by Jared Kaplan, who moved on to co-found Anthropic, published a paper titled “Scaling Laws for Neural Language Models.” The researchers observed “precise power-law scalings for performance as a function of […]