Semi-Log and Log-Log Graphs

Artificial Intelligence | AI on Instagram: "Neural scaling laws describe how a model’s performance improves (predictably) as we increase the amount of training data, the size of the model (in terms of parameters), or the total compute used (measured in FLOPs or floating point operations per second). The scaling laws are power laws, meaning that as we scale things up, the performance increases proportionally. For instance, as we increase the size of the model, we should expect better performance