GPT-4

Architecture

Architecture details for GPT-4 are not publicly documented. OpenAI’s GPT-4 Technical Report (March 2023) declines to discuss model architecture, training data, training compute, or parameter count. Subsequent statements from OpenAI have not changed this stance.

Per the closed-model policy, this knowledge base does not infer or report architectural claims for undocumented models. The fields below are confirmed public facts only:

• Release date: March 14, 2023.
• Context length: 8K base, 32K extended variant. Both confirmed by OpenAI’s official documentation.
• Open weights: No.
• Modality: Text + image input as of the public release.

Every other architectural slot — positional encoding, normalization placement, activation, attention variant, MoE structure — is recorded as null in this knowledge base’s schema, and the Compare matrix renders these as a dash.

Rumors, leaked details, and third-party reverse-engineering speculation are explicitly out of scope for this knowledge base. See the methodology page for the policy rationale.

Sources

• https://arxiv.org/abs/2303.08774
• https://cdn.openai.com/papers/gpt-4.pdf

@article{arxiv_2303_08774,
  title         = {GPT-4},
  author        = {OpenAI},
  year          = {2023},
  eprint        = {2303.08774},
  archivePrefix = {arXiv},
  url           = {https://arxiv.org/abs/2303.08774}
}

{
  "id": "arxiv_2303_08774",
  "type": "article-journal",
  "title": "GPT-4",
  "author": [
    {
      "literal": "OpenAI"
    }
  ],
  "issued": {
    "date-parts": [
      [
        2023
      ]
    ]
  },
  "URL": "https://arxiv.org/abs/2303.08774",
  "number": "2303.08774",
  "source": "arXiv"
}

TY  - JOUR
TI  - GPT-4
AU  - OpenAI
PY  - 2023
JO  - arXiv
AN  - arXiv:2303.08774
UR  - https://arxiv.org/abs/2303.08774
ER  -