DEV Community

Kaggle Benchmarking Challenge

This is the official tag for submissions and announcements related to the Kaggle Benchmarking Challenge.

Posts

👋 Sign in for the ability to sort posts by relevant, latest, or top.
Georgian Language Benchmark: Two Biggest AI Labs Clash in a Language That Doesn't Play by Anyone's Rules

Kaggle Benchmarking Challenge Submission

Georgian Language Benchmark: Two Biggest AI Labs Clash in a Language That Doesn't Play by Anyone's Rules

34
Picked as gem Comments 13
20 min read
Where Did My Data Go? Benchmarking LLMs as Data Pipeline Detectives

Kaggle Benchmarking Challenge Submission

Where Did My Data Go? Benchmarking LLMs as Data Pipeline Detectives

7
Comments 2
7 min read
LegacyShop: Can an AI maintain a real codebase? (Kaggle Benchmark)

Kaggle Benchmarking Challenge Submission

LegacyShop: Can an AI maintain a real codebase? (Kaggle Benchmark)

6
Comments
7 min read
Do LLMs Fall for Bad Advice? Testing Strategic Resilience in 840 Rounds of Turn-Based Games

Kaggle Benchmarking Challenge Submission

Do LLMs Fall for Bad Advice? Testing Strategic Resilience in 840 Rounds of Turn-Based Games

Comments
8 min read
One Model Scored 0%, Another 97%—Their Failures Were Completely Different

Kaggle Benchmarking Challenge Submission

One Model Scored 0%, Another 97%—Their Failures Were Completely Different

Comments 1
6 min read
Does AI get worse with more documents? Open-source vs paid models, tested.

Kaggle Benchmarking Challenge Submission

Does AI get worse with more documents? Open-source vs paid models, tested.

Comments 1
7 min read
My stock scanner's AI was a momentum echo. Are today's models?

Kaggle Benchmarking Challenge Submission

My stock scanner's AI was a momentum echo. Are today's models?

Comments 1
28 min read
DataBugBench: Benchmarking LLMs on Silent Python Data Science Bugs

Kaggle Benchmarking Challenge Submission

DataBugBench: Benchmarking LLMs on Silent Python Data Science Bugs

Comments 1
2 min read
I Built a Benchmark That Grades AI Code Reviewers on Planted Defects

Kaggle Benchmarking Challenge Submission

I Built a Benchmark That Grades AI Code Reviewers on Planted Defects

Comments
10 min read
Your AI Agent Has a Burn Rate — So I Benchmarked the Cost of a Correct Answer

Kaggle Benchmarking Challenge Submission

Your AI Agent Has a Burn Rate — So I Benchmarked the Cost of a Correct Answer

1
Comments 2
4 min read
Can Modern VLMs Actually Reason Through Spatial Grid Puzzles?

Kaggle Benchmarking Challenge Submission

Can Modern VLMs Actually Reason Through Spatial Grid Puzzles?

Comments 1
3 min read
Day 11: Kaggle Escalation Benchmark: Rank the floor, not the average.

Day 11: Kaggle Escalation Benchmark: Rank the floor, not the average.

Comments 1
7 min read
An AI optimization made llama2.c finish sooner and start streaming later

Kaggle Benchmarking Challenge Submission

An AI optimization made llama2.c finish sooner and start streaming later

Comments 3
9 min read
Engineering Discipline Benchmark

Kaggle Benchmarking Challenge Submission

Engineering Discipline Benchmark

Comments 1
4 min read
Stay In Your Lane: 10 LLMs understood the request. Half still tried to referee the game.

Kaggle Benchmarking Challenge Submission

Stay In Your Lane: 10 LLMs understood the request. Half still tried to referee the game.

Comments 1
6 min read
👋 Sign in for the ability to sort posts by relevant, latest, or top.