DEV Community

Patrick Hughes profile picture

Patrick Hughes

404 bio not found

Joined Joined on  github website
VRAM Fit Is Not Runtime Support
pat9000 profile

VRAM Fit Is Not Runtime Support

#localllm #5090reports #ollama #modelselection
Comments
4 min read

Want to connect with Patrick Hughes?

Create an account to connect with Patrick Hughes. You can also sign in below to proceed if you already have an account.

Create Account
Already have an account? Sign in
Why Local LLM Benchmarks Need Power Data
pat9000 profile

Why Local LLM Benchmarks Need Power Data

#localllm #gpubenchmarks #ollama #5090reports
Comments
4 min read
My 5090 benchmark was missing the field I needed most
pat9000 profile

My 5090 benchmark was missing the field I needed most

#localllm #llmbenchmarks #rtx5090 #ollama
Comments
4 min read
Search Old Results Before Publishing an LLM Test
pat9000 profile

Search Old Results Before Publishing an LLM Test

#localllm #modeltesting #ollama #rtx5090
Comments
5 min read
Build Local LLM Eval Data From Real Failures
pat9000 profile

Build Local LLM Eval Data From Real Failures

#localllm #modelevaluation #codingagents #ownedhardware
Comments
5 min read
How I Keep LLM Results Valid After a Driver Update
pat9000 profile

How I Keep LLM Results Valid After a Driver Update

#localllm #llmbenchmarks #rtx5090 #nvidiadriver
Comments
4 min read
How I Budget VRAM for Shared Local AI Workloads
pat9000 profile

How I Budget VRAM for Shared Local AI Workloads

#localllm #vram #modelsizing #rtx5090
Comments
5 min read
Why I Benchmark Local LLM Input and Output Separately
pat9000 profile

Why I Benchmark Local LLM Input and Output Separately

#localllm #benchmarking #rtx5090 #ollama
Comments
5 min read
Why I Test 3 Workloads Before Sizing a Local LLM
pat9000 profile

Why I Test 3 Workloads Before Sizing a Local LLM

#localllm #rtx5090 #modelsizing #ollama
Comments
5 min read
Incident response needs a local model you already trust
pat9000 profile

Incident response needs a local model you already trust

#aisecurity #incidentresponse #localllm #openweights
Comments
6 min read
Local open-model agents just became a product category
pat9000 profile

Local open-model agents just became a product category

#localllm #openweights #aiagents #lmstudio
Comments
6 min read
Your local LLM benchmark is probably lying to you
pat9000 profile

Your local LLM benchmark is probably lying to you

#localllm #evals #llmbenchmarks #aiagents
Comments
5 min read
Test Retrieval Before Your Local LLM Writes
pat9000 profile

Test Retrieval Before Your Local LLM Writes

#localllm #retrieval #rtx5090 #5090reports
Comments
4 min read
Why I Did Not Promote My Smaller Local Model
pat9000 profile

Why I Did Not Promote My Smaller Local Model

#localllm #modelevaluation #rtx5090 #5090reports
Comments
4 min read
Build an AI Research Workbench on Your Own GPU
pat9000 profile

Build an AI Research Workbench on Your Own GPU

#localllm #rtx5090 #5090reports #localai
Comments
5 min read
Ollama num_batch: 256 Was My RTX 5090 Sweet Spot
pat9000 profile

Ollama num_batch: 256 Was My RTX 5090 Sweet Spot

#localai #ollama #localllm #rtx5090
Comments
4 min read
A 7 GB 27B Model Lost to My 17 GB Default
pat9000 profile

A 7 GB 27B Model Lost to My 17 GB Default

#localai #localllm #gguf #modelselection
1
Comments
5 min read
My Agents Have to Prove What They Did
pat9000 profile

My Agents Have to Prove What They Did

#aiagents #agentinfrastructure #showwork #localai
Comments 1
4 min read
Your Agent's Audit Trail Cannot Be Retrofitted
pat9000 profile

Your Agent's Audit Trail Cannot Be Retrofitted

#aiagents #agentverification #showwork #euaiact
Comments
5 min read
Ollama Raised $65M. What Builders Get
pat9000 profile

Ollama Raised $65M. What Builders Get

#localai #localllm #ollama #ownedhardware
1
Comments
5 min read
Why production AI is moving to open weights
pat9000 profile

Why production AI is moving to open weights

#localllm #openmodels #rtx5090 #aiinfrastructure
Comments
4 min read
Devlog 2026-07-13: local drive git corruption stalls the q
pat9000 profile

Devlog 2026-07-13: local drive git corruption stalls the q

#devlog #daily #bmdhodl
Comments
3 min read
My 8B Model Failed a 400-Word Task
pat9000 profile

My 8B Model Failed a 400-Word Task

#localllm #modelselection #ollama #rtx5090
Comments
5 min read
Q4km vs Q5km: Q4_K_M vs Q5_K_M
pat9000 profile

Q4km vs Q5km: Q4_K_M vs Q5_K_M

#localllm #gguf #quantization #llamacpp
Comments
3 min read
I Rebuilt 5,383 Embeddings After a Dimension Change
pat9000 profile

I Rebuilt 5,383 Embeddings After a Dimension Change

#localllm #embeddings #vectorsearch #ollama
Comments
5 min read
I Raised the QA Bar on Blog Infographics
pat9000 profile

I Raised the QA Bar on Blog Infographics

#localllm #5090reports #blog #matplotlib
Comments
4 min read
Pin Your Context Window or Pay the Reload Tax
pat9000 profile

Pin Your Context Window or Pay the Reload Tax

#localllm #ollama #numctx #localaiagents
Comments
5 min read
Preview Retrieval Before Your Local LLM Runs
pat9000 profile

Preview Retrieval Before Your Local LLM Runs

#localllm #retrieval #localaiagents #privateai
Comments
5 min read
Pin Your Local LLM Context Size Before You Build a Router
pat9000 profile

Pin Your Local LLM Context Size Before You Build a Router

#localllm #modelrouting #ollama #rtx5090
Comments
4 min read
When Claude hits a weekly limit, your agent fleet still needs a third CLI
pat9000 profile

When Claude hits a weekly limit, your agent fleet still needs a third CLI

#localllm #aiagents #gemini #agentops
Comments
4 min read
I built a self-improving code model on one RTX 5090. Here is what actually worked.
pat9000 profile

I built a self-improving code model on one RTX 5090. Here is what actually worked.

#localllm #aiagents #finetuning #rtx5090
Comments
5 min read
Will That Local Model Fit? Do the VRAM Math First
pat9000 profile

Will That Local Model Fit? Do the VRAM Math First

#localllm #vram #quantization #llamacpp
Comments
5 min read
Local LLMs Need a Timeout Before They Need a Bigger Model
pat9000 profile

Local LLMs Need a Timeout Before They Need a Bigger Model

#localai #ollama #5090reports #aiagents
Comments
5 min read
Your local LLM is not a worse Claude. It is a different tool.
pat9000 profile

Your local LLM is not a worse Claude. It is a different tool.

#localllm #openweights #aiagents #agentguard
Comments
5 min read
How I Gate a Local Coding Model Before I Trust It
pat9000 profile

How I Gate a Local Coding Model Before I Trust It

#localai #5090reports #ollama #codingagents
Comments
5 min read
A verifier loop beats a faster local model
pat9000 profile

A verifier loop beats a faster local model

#localai #localllm #5090reports #agentguard
Comments
4 min read
How I Make Local Model Runs Fail Safely On A 5090
pat9000 profile

How I Make Local Model Runs Fail Safely On A 5090

#localai #rtx5090 #qlora #localllm
Comments
5 min read
How to Make a Local QLoRA Starter Fail Safely
pat9000 profile

How to Make a Local QLoRA Starter Fail Safely

#localai #qlora #rtx5090 #finetuning
Comments
5 min read
Use Owner Gates and AgentGuard to Keep AI Agents Moving
pat9000 profile

Use Owner Gates and AgentGuard to Keep AI Agents Moving

#aiagents #agentops #asyncworkflows #onepersoncompany
Comments
5 min read
How to Run Local LLM Verifier Loops on Owned Hardware
pat9000 profile

How to Run Local LLM Verifier Loops on Owned Hardware

#localllm #aiagents #verifierloops #llamacpp
Comments
5 min read
AI Agent Memory: What Actually Works in 2026
pat9000 profile

AI Agent Memory: What Actually Works in 2026

#aiagents #memory #agentops #onepersoncompany
Comments
4 min read
What Anthropic's MITRE ATT&CK report means for solo AI builders
pat9000 profile

What Anthropic's MITRE ATT&CK report means for solo AI builders

#aisecurity #agents #anthropic #agentguard
Comments
4 min read
AI Agent Memory in 2026: How It Works and When to Use It
pat9000 profile

AI Agent Memory in 2026: How It Works and When to Use It

#aiagents #memory #localllms #agentarchitecture
Comments 1
2 min read
Your AI Agent Says "Done." Make It Prove It.
pat9000 profile

Your AI Agent Says "Done." Make It Prove It.

#aiagents #agentops #verification #onepersoncompany
2
Comments 2
4 min read
Give Your AI Agents an Append-Only Event Log
pat9000 profile

Give Your AI Agents an Append-Only Event Log

#aiagents #observability #eventsourcing #onepersoncompany
1
Comments
4 min read
A self-healing system can't heal an empty queue
pat9000 profile

A self-healing system can't heal an empty queue

#aiagents #automation #monitoring #selfhealing
Comments
4 min read
Missing AI agent cost data is not zero
pat9000 profile

Missing AI agent cost data is not zero

#aiagents #costcontrol #observability #spendtracking
Comments 1
4 min read
Anthropic Writes 80% of Its Code with Claude
pat9000 profile

Anthropic Writes 80% of Its Code with Claude

#ai #solobuilder #coding
Comments
2 min read
What Salesforce's 20,000 AI Agent Deployments Teach a Solo Builder
pat9000 profile

What Salesforce's 20,000 AI Agent Deployments Teach a Solo Builder

#aiagents #agentdeployment #agentreliability #agentguard
Comments 2
4 min read
57-71% of AI agents leak data between users. Here's what to do.
pat9000 profile

57-71% of AI agents leak data between users. Here's what to do.

#aiagents #security #agentmemory #agentguard
Comments
3 min read
VRAM Calculator: Estimate Local LLM Requirements
pat9000 profile

VRAM Calculator: Estimate Local LLM Requirements

#localllm #hardware #vram #llama3
Comments
1 min read
Anthropic's IPO and the 40% Cost-Savings Gap: Why Your Spend Cap Matters More Now
pat9000 profile

Anthropic's IPO and the 40% Cost-Savings Gap: Why Your Spend Cap Matters More Now

#aiagents #costcontrol #anthropic #agentguard
Comments
4 min read
When JPMorgan's AI bill goes up, who controls it?
pat9000 profile

When JPMorgan's AI bill goes up, who controls it?

#aiagents #enterpriseai #costcontrol #agentguard
Comments
4 min read
57-71% of AI Agents Leak Data Between Users. Here's the Fix.
pat9000 profile

57-71% of AI Agents Leak Data Between Users. Here's the Fix.

#aiagents #security #agentmemory #agentguard
Comments
4 min read
AI Coding Assistant Pricing in 2026: Copilot vs Cursor vs Claude Code
pat9000 profile

AI Coding Assistant Pricing in 2026: Copilot vs Cursor vs Claude Code

#aicoding #pricing #developertools #costcontrol
Comments
3 min read
How to Close the AI Agent Cost Gap at the Call Site
pat9000 profile

How to Close the AI Agent Cost Gap at the Call Site

#aiagents #costcontrol #agentguard #python
Comments
4 min read
Agentic coding moved my bottleneck to code review
pat9000 profile

Agentic coding moved my bottleneck to code review

#agenticcoding #aiagents #solodev #codereview
Comments
3 min read
How to Pick a GGUF Quant Level for Your VRAM Budget
pat9000 profile

How to Pick a GGUF Quant Level for Your VRAM Budget

#localllm #gguf #quantization #gpu
Comments
4 min read
Stop Telling People You Have 11 AI Agents
pat9000 profile

Stop Telling People You Have 11 AI Agents

#aiagents #onepersonops #agentcost #agentguard
Comments
4 min read
GGUF Quantization and VRAM: How to Pick Q4, Q5, or Q8 for Your GPU (2026)
pat9000 profile

GGUF Quantization and VRAM: How to Pick Q4, Q5, or Q8 for Your GPU (2026)

#localllm #gguf #quantization #llamacpp
Comments
4 min read
loading...