DEV Community

#benchmark

Posts

👋 Sign in for the ability to sort posts by relevant, latest, or top.
GSM8K on Hugging Face: 4 of the Top 12 Rows Show a Sibling Checkpoint's Score, and 20 of 28 Rows Are Unmerged PRs

GSM8K on Hugging Face: 4 of the Top 12 Rows Show a Sibling Checkpoint's Score, and 20 of 28 Rows Are Unmerged PRs

Comments
14 min read
Two independent audits of Terminal Bench 4: 41 of 65, or 30 of 66?

Two independent audits of Terminal Bench 4: 41 of 65, or 30 of 66?

Comments
6 min read
Which Document Extraction API Can You Actually Trust?

Which Document Extraction API Can You Actually Trust?

Comments
11 min read
Pinning NPU cores on RK3588 buys you 5% — and costs the big model 10%

Pinning NPU cores on RK3588 buys you 5% — and costs the big model 10%

Comments
2 min read
Unsiloed Achieves #1 Rank on olmOCR-Bench

Unsiloed Achieves #1 Rank on olmOCR-Bench

Comments
9 min read
How LLM Evaluation Actually Works: Inside the LFORLA Team Recruitment Benchmark

How LLM Evaluation Actually Works: Inside the LFORLA Team Recruitment Benchmark

Comments
4 min read
같은 모델을 다시 채점하자 0.21%가 달라졌습니다: 자기개선 고리의 관문을 세우며 잰 채점 잡음의 바닥

같은 모델을 다시 채점하자 0.21%가 달라졌습니다: 자기개선 고리의 관문을 세우며 잰 채점 잡음의 바닥

Comments
3 min read
How we score an election forecast (and what the score does not measure)

How we score an election forecast (and what the score does not measure)

Comments
4 min read
10 RKNN models benchmarked on RK3588 — and the fastest one is cheating onto the CPU

10 RKNN models benchmarked on RK3588 — and the fastest one is cheating onto the CPU

Comments
4 min read
RK3588 INT8, measured: 1.96 on YOLOv8n, 1.4 on YOLO11n — plus OCR joins the bench

RK3588 INT8, measured: 1.96 on YOLOv8n, 1.4 on YOLO11n — plus OCR joins the bench

Comments
2 min read
We Tested 82 Residential Proxy Providers Across 142,310 Real-World Requests: October 2026 Report

We Tested 82 Residential Proxy Providers Across 142,310 Real-World Requests: October 2026 Report

Comments
6 min read
NVIDIA Jetson Orin Nano vs Raspberry Pi 5: Benchmarks, Architecture & Real-World Decision Guide

NVIDIA Jetson Orin Nano vs Raspberry Pi 5: Benchmarks, Architecture & Real-World Decision Guide

Comments
3 min read
Humanity's Last Exam on Hugging Face: At Least 23 of the Top 24 Rows Use Tools, and the Board Has No Column for It

Humanity's Last Exam on Hugging Face: At Least 23 of the Top 24 Rows Use Tools, and the Board Has No Column for It

Comments
15 min read
가중치 원소 0.005%만 달라도 점수가 1.4%p 움직였습니다: 생성 채점으로 모델을 비교하다 저희 보고를 철회한 과정

가중치 원소 0.005%만 달라도 점수가 1.4%p 움직였습니다: 생성 채점으로 모델을 비교하다 저희 보고를 철회한 과정

Comments
3 min read
SWE-Bench Pro Has Two Versions: What the Hugging Face Leaderboard's 47 Rows Mix Together

SWE-Bench Pro Has Two Versions: What the Hugging Face Leaderboard's 47 Rows Mix Together

Comments
14 min read
👋 Sign in for the ability to sort posts by relevant, latest, or top.