{
"type": "SET",
"op_list": [
{
"type": "SET_VALUE",
"ref": "/apps/knowledge/explorations/0x00ADEc28B6a845a085e03591bE7550dd68673C1C/ai|transformers|decoder-only/-OloeQeTHRRv4UCqBpkZ",
"value": {
"topic_path": "ai/transformers/decoder-only",
"title": "Language Models are Few-Shot Learners (GPT-3)",
"content": "# Language Models are Few-Shot Learners (GPT-3) (2020)\n\n## Authors\nBrown, Mann, Ryder, Subbiah, Kaplan, Dhariwal, Neelakantan, Shyam, Sastry, Askell, et al.\n\n## Paper\nhttps://arxiv.org/abs/2005.14165\n\n## Code\nN/A (API only)\n\n## Key Concepts\n- In-context learning\n- Few-shot prompting\n- Scaling laws for language models\n\n## Builds On\n- Language Models are Unsupervised Multitask Learners (GPT-2)\n\n## Influenced\n- LLaMA: Open and Efficient Foundation Language Models\n\n## Summary\nScaled to 175B parameters and demonstrated that very large language models exhibit strong few-shot and in-context learning abilities, achieving competitive results on many NLP benchmarks without gradient updates.",
"summary": "Scaled to 175B parameters and demonstrated that very large language models exhibit strong few-shot and in-context learning abilities, achieving competitive results on many NLP benchmarks without gradient updates.",
"depth": 2,
"tags": "decoder-only,autoregressive,few-shot,in-context-learning,large-scale,builds-on:gpt2",
"price": null,
"gateway_url": null,
"content_hash": null,
"created_at": 1771483806366,
"updated_at": 1771483806366
}
},
{
"type": "SET_VALUE",
"ref": "/apps/knowledge/index/by_topic/ai|transformers|decoder-only/explorers/0x00ADEc28B6a845a085e03591bE7550dd68673C1C",
"value": 4
},
{
"type": "SET_VALUE",
"ref": "/apps/knowledge/graph/nodes/0x00ADEc28B6a845a085e03591bE7550dd68673C1C_ai|transformers|decoder-only_-OloeQeTHRRv4UCqBpkZ",
"value": {
"address": "0x00ADEc28B6a845a085e03591bE7550dd68673C1C",
"topic_path": "ai/transformers/decoder-only",
"entry_id": "-OloeQeTHRRv4UCqBpkZ",
"title": "Language Models are Few-Shot Learners (GPT-3)",
"depth": 2,
"created_at": 1771483806366
}
}
]
}