What organization will have the highest ELO score in the LMSYS Org Chatbot Arena Leaderboard at the end of Dec, 2024?
➕
Plus
72
Ṁ28k
Jan 1
Alphabet launches Gemini Pro 1.5.
Anthropic releases Claude 3.
+5%
on
OpenAI releases GPT-4o
Anthropic releases Claude 3.5 Sonnet
Meta releases Llama 3.1 405B
xAI releases Grok 2
OpenAI releases o1-preview
55%
OpenAI
41%
Alphabet (Google)

I'm referring to this Chatbot Arena Leaderboard.

I'm planning on resolving based on who has the highest ELO score. This is because ELO scores were all that existed when I created this question.

Related:

#AI
#️ Technology
#OpenAI
#LLMs
#Google
#Chatbot Arena Leaderboard
#ELO Ratings
Get
Ṁ1,000
and
S3.00
Sort by:

They changed the column name from "ELO Score" to "Arena Score".

View original context
bought Ṁ100 YES

Gemini is back on top:

bought Ṁ250 YES

The latest Gemini model has jumped to the top of the leaderboard!

Scott Alexander mentioned this question in Mantic Monday 9/16/24 on Astral Codex Ten.

What other dates should I add to the graph?

@HankyUSA To start:

May 13, 2024: OpenAI releases GPT-4o

June 20, 2024: Anthropic releases Claude 3.5 Sonnet

July 23, 2024: Meta releases Llama 3.1 405B

August 13, 2024: xAI releases Grok 2

@HankyUSA September 12: OpenAI releases o1-preview

They changed the column name from "ELO Score" to "Arena Score".

TIL about Chatbot arena 👍

Related questions

© Manifold Markets, Inc.•Terms + Mana-only Terms•Privacy•Rules