an LLM as capable as GPT-4 will run on a 3090 before March 2024
Basic
23
Ṁ4814resolved Mar 12
Resolved
NO1D
1W
1M
ALL
e.g. Winograde >= 87.5%
This question is managed and resolved by Manifold.
Get
1,000and
3.00
1,0003.00Sort by:
predictedNO
the initial question was specifically about winogrande, but MMLU would also be acceptable. fits on a single 3090. quantization could be allowed if quantized performance is comparable, but that might be annoying to evaluate
Winograde? Do you mean the Winogrande benchmark? Like specifically this one? (Any requirement for the LLM in question to be open?)
https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard
Related questions
Related questions
an LLM as capable as GPT-4 runs on one 3090 by March 2025
30% chance
Will an LLM better than gpt3.5 run on my rtx 3090 before 2025?
96% chance
an LLM as capable as GPT-4 runs on one 4090 by March 2025
31% chance
Will there be a OpenAI LLM known as GPT-4.5? by 2033
70% chance
Will there be an open source LLM as good as GPT4 by the end of 2024?
68% chance
Will there be an open source LLM as good as GPT4 by June 2024?
15% chance
Will an open-source LLM beat or match GPT-4 by the end of 2024?
85% chance
Will an LLM better than gpt4 run on my rtx 3090 before 2025?
7% chance
Will a Mamba-based LLM of GPT 3.5 quality or greater be open sourced in 2024?
79% chance
Which next-gen frontier LLMs will be released before GPT-5? (2025)