DEV Community

Kaggle Benchmarking Challenge

This is the official tag for submissions and announcements related to the Kaggle Benchmarking Challenge.

Posts

👋 Sign in for the ability to sort posts by relevant, latest, or top.
An AI optimization made llama2.c finish sooner and start streaming later

Kaggle Benchmarking Challenge Submission

An AI optimization made llama2.c finish sooner and start streaming later

Comments 3
9 min read
Engineering Discipline Benchmark

Kaggle Benchmarking Challenge Submission

Engineering Discipline Benchmark

Comments 1
4 min read
Stay In Your Lane: 10 LLMs understood the request. Half still tried to referee the game.

Kaggle Benchmarking Challenge Submission

Stay In Your Lane: 10 LLMs understood the request. Half still tried to referee the game.

Comments 1
6 min read
Fake note? Seems real to me. How a nurse's note talks AI out of the ER

Kaggle Benchmarking Challenge Submission

Fake note? Seems real to me. How a nurse's note talks AI out of the ER

Comments
5 min read
Can LLMs read robots.txt? Easily. Can they write one? Only one of nine got every policy right.

Kaggle Benchmarking Challenge Submission

Can LLMs read robots.txt? Easily. Can they write one? Only one of nine got every policy right.

Comments 1
6 min read
I Asked 14 AI Models "Who Are You?" Google's Own Gemma Signed Its Code as GPT-4o

Kaggle Benchmarking Challenge Submission

I Asked 14 AI Models "Who Are You?" Google's Own Gemma Signed Its Code as GPT-4o

Comments
7 min read
Models shrug off "Are you sure?" They fold when you assert a wrong answer.

Kaggle Benchmarking Challenge Submission

Models shrug off "Are you sure?" They fold when you assert a wrong answer.

1
Comments
11 min read
Dấu or Die: Can LLMs put the accents back on Vietnamese?

Dấu or Die: Can LLMs put the accents back on Vietnamese?

Comments 1
4 min read
Agent Recovery on Kaggle: A Submission Attempt with Separate Research Results

Agent Recovery on Kaggle: A Submission Attempt with Separate Research Results

1
Comments
4 min read
Can AI close the books? An FP&A reasoning benchmark

Kaggle Benchmarking Challenge Submission

Can AI close the books? An FP&A reasoning benchmark

Comments 2
6 min read
ScopeCheck: audit the benchmark before trusting its leaderboard

Kaggle Benchmarking Challenge Submission

ScopeCheck: audit the benchmark before trusting its leaderboard

Comments
6 min read
My Benchmark's First Leaderboard Measured My Grader, Not the Models

Kaggle Benchmarking Challenge Submission

My Benchmark's First Leaderboard Measured My Grader, Not the Models

Comments 1
5 min read
The LLM Evalution and Performance Frontier: Finding the Best AI Model for Every Budget

Kaggle Benchmarking Challenge Submission

The LLM Evalution and Performance Frontier: Finding the Best AI Model for Every Budget

Comments
4 min read
The Runtime IS the Benchmark: Endurance Metrics for Local Agents

The Runtime IS the Benchmark: Endurance Metrics for Local Agents

1
Comments 1
2 min read
Benchmarking AI for Code Optimization: Which LLM Actually Writes the Most Efficient C/Rust Code?

Kaggle Benchmarking Challenge Submission

Benchmarking AI for Code Optimization: Which LLM Actually Writes the Most Efficient C/Rust Code?

Comments
2 min read
👋 Sign in for the ability to sort posts by relevant, latest, or top.