Link: https://cdn.openai.com/papers/gpt-4.pdf Changes in short: Context doubled (x8) Keeping training secret “Given both the competitive landscape and the safety implications of large-scale models like GPT-4, this report
contains no further details about the architecture (including model size), hardware, training compute, dataset construction, training method, or similar.” 3. Performance improvement (better marks in well-known…