Once a model achieves superhuman performance on a competitive programming benchmark, will it be less than 5 years before there are "entry level" AI programmers in industry use? | Manifold

Once a model achieves superhuman performance on a competitive programming benchmark, will it be less than 5 years before there are "entry level" AI programmers in industry use?

Plus

12

Ṁ447

2050

92%

chance

1D

1W

1M

ALL

"Entry level" is deliberately fuzzy: in 2022 terms this would look like an AI (or AIs) that is assigned an issue, checks out code, makes edits, and submits a PR (that is accepted). Rough criteria: the AI acts with little oversight, performs similar (coding) work to entry-level coders at the time, the issue/task assignment is not *significantly* specialized for an AI (e.g. no full technical specs if the same wouldn't be given to a human coder) AI being used in this way in significant open source projects counts as "industry use". If there are technical demos of such AIs but none of them are actually being used question resolves as no. No requirement that it be a single model. A group of specialized models working together counts. If superhuman performance is not achieved by market end, resolves N/A.

This question is managed and resolved by Manifold.

#Technical AI Timelines

Get

1,000

and

3.00

Sort by:

a more interesting question would be the other way around

@dp looking at trend lines, unlikely

The average human can’t code. I’d say we’re already at super-human.

Related questions

Will an AI achieve >85% performance on the FrontierMath benchmark before 2028?

Will there be entry-level AI coders by 2026?

Will models be able to do the work of an AI researcher/engineer before 2027?

Will an AI model achieve superhuman ELO on Codeforces by the 31 December 2025?

Will a new lab create a top-performing AI frontier model before 2028?

Benchmark Gap #3: Once a model achieves superhuman performance on a competitive programming benchmark, will it be less than 2 years before there are "entry level" AI programmers in industry use?

AI for AI 1: By when will there be an AI that can do "intern-level" ML engineering?

Will an AI achieve >85% performance on the FrontierMath benchmark before 2027?

Will an AI score 1st place on International Math Olympiad (IMO) 2025?

Benchmark Gap #5: Once a single AI model solves >= 95% of miniF2F, MATH, and MMLU STEM, will it be less than two years before AI models are used as entry-level data science / data analysis / statistics workers?

Related questions

Will an AI achieve >85% performance on the FrontierMath benchmark before 2028?

Benchmark Gap #3: Once a model achieves superhuman performance on a competitive programming benchmark, will it be less than 2 years before there are "entry level" AI programmers in industry use?

Will there be entry-level AI coders by 2026?

AI for AI 1: By when will there be an AI that can do "intern-level" ML engineering?

Will models be able to do the work of an AI researcher/engineer before 2027?

Will an AI achieve >85% performance on the FrontierMath benchmark before 2027?

Will an AI model achieve superhuman ELO on Codeforces by the 31 December 2025?

Will an AI score 1st place on International Math Olympiad (IMO) 2025?

Will a new lab create a top-performing AI frontier model before 2028?

Benchmark Gap #5: Once a single AI model solves >= 95% of miniF2F, MATH, and MMLU STEM, will it be less than two years before AI models are used as entry-level data science / data analysis / statistics workers?

© Manifold Markets, Inc.•Terms + Mana-only Terms•Privacy•Rules