Will transformers still be the dominant DL architecture in 2026?
Plus
29
Ṁ4155Jan 2
91%
chance
1D
1W
1M
ALL
Resolves true if I judge, based on the common opinion among deep learning researchers, that transformers remain the most popular architecture in deep learning research at the start of 2026. If the answer is not clear, resolves true if at least 50% of arXiv papers from 2025 on A.I. mention transformers, otherwise resolves false.
This question is managed and resolved by Manifold.
Get
1,000and
3.00
1,0003.00Sort by:
Apparently there is already a very similar market!
https://manifold.markets/LeoGao/will-transformer-based-architecture
Related questions
Related questions
Will a big transformer LM compose these facts without chain of thought by 2026?
29% chance
Will there be over 10,000 Optimus robots working at Tesla before 2027?
15% chance
Will Transformer based architectures still be SOTA for language modelling by 2026?
97% chance
By the start of 2026, will I still think that transformers are the main architecture for tasks related to natural language processing?
90% chance
Will Googles Titans architecture replace transformers?
14% chance
Will it become possible to use transformer action AIs to DDOS anyone you want by 2025?
19% chance
Will there be over 1000 Optimus robots working at Tesla before 2026?
3% chance
Will a big transformer LM compose these facts without chain of thought by 2026? (harder question version)
32% chance
Will geometric deep learning turn out to be as influential an idea as transformers?
14% chance
By EOY 2025, will the model with the lowest perplexity on Common Crawl will not be based on transformers?
5% chance