an LLM as capable as GPT-4 will run on a 3090 before March 2024
Basic
23
Ṁ4814resolved Mar 12
Resolved
NO1D
1W
1M
ALL
e.g. Winograde >= 87.5%
This question is managed and resolved by Manifold.
Get
1,000and
3.00
1,0003.00Sort by:
predictedNO
the initial question was specifically about winogrande, but MMLU would also be acceptable. fits on a single 3090. quantization could be allowed if quantized performance is comparable, but that might be annoying to evaluate
Winograde? Do you mean the Winogrande benchmark? Like specifically this one? (Any requirement for the LLM in question to be open?)
https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard
Related questions
Related questions
China will make a LLM approximately as good or better than GPT4 before 2025
89% chance
Size of smallest open-source LLM marching GPT 3.5's performance in 2025? (GB)
-
Will xAI develop a more capable LLM than GPT-5 before 2026
68% chance
When will an open-source LLM be released with a better performance than GPT-4?
GPT-4 performance and compute efficiency from a simple architecture before 2026
19% chance