DEV Community

Wayne profile picture

Wayne

MLOps Engineer. Interested in platform tooling, rust and go.

Measuring LLM Prefix Caching: The Cache Hit Rate Metric

Measuring LLM Prefix Caching: The Cache Hit Rate Metric

Comments
6 min read
llmperf Is Archived: Alternatives for LLM Benchmarking

llmperf Is Archived: Alternatives for LLM Benchmarking

Comments
3 min read
Switching to Secondary Is Faster

Switching to Secondary Is Faster

Comments
2 min read
Ansible at Home

Ansible at Home

Comments
3 min read
Making Compression a Habit with zstd

Making Compression a Habit with zstd

Comments
3 min read
Using hf tokenizers in Rust

Using hf tokenizers in Rust

Comments
2 min read
Setting Up Docker CI for Rust with cargo-dist

Setting Up Docker CI for Rust with cargo-dist

Comments
3 min read
Learnings of the Poor

Learnings of the Poor

Comments
3 min read
Benchmarking LLM Inference: TTFT, ITL & Throughput

Benchmarking LLM Inference: TTFT, ITL & Throughput

Comments
4 min read
loading...