Cost of tuning hyperparameters using μTransfer was 7% of what it would be to pre-train GPT-3
Companies scaling up their neural network models could cut expensive training costs by employing a technique developed by researchers at Microsoft and OpenAI.…
