DEV Community

#pytorch

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
Gemma 4 in Rust on TorchTPU: A Native TPU Rig With PyO3 and MCP

Gemma 4 in Rust on TorchTPU: A Native TPU Rig With PyO3 and MCP

7
Comments 1
11 min read
Gemma 4 in Rust on TorchTPU: Hands On With Colab

Gemma 4 in Rust on TorchTPU: Hands On With Colab

7
Comments
9 min read
Weight Decay 0.05: Catastrophe in Adam, Optimum in AdamW

Weight Decay 0.05: Catastrophe in Adam, Optimum in AdamW

Comments
4 min read
Distillation didn't help our small model until we took the labels away

Distillation didn't help our small model until we took the labels away

Comments
3 min read
Running Captum on Cloud TPUs with TorchTPU: a work log

Running Captum on Cloud TPUs with TorchTPU: a work log

Comments
19 min read
An ExecuTorch .pte has no pickle. Its risk is every size and offset

An ExecuTorch .pte has no pickle. Its risk is every size and offset

Comments
4 min read
TorchTitan's October update is out. I fixed 2 bugs in its quick-start script

TorchTitan's October update is out. I fixed 2 bugs in its quick-start script

Comments
6 min read
torch.compile vs eager for training a 468M Llama-style model on four GPUs: step time, memory and compile cost

torch.compile vs eager for training a 468M Llama-style model on four GPUs: step time, memory and compile cost

Comments
5 min read
Model soups failed until we fixed one line: our 26M grammar tagger from 11% to 1.9% false fixes

Model soups failed until we fixed one line: our 26M grammar tagger from 11% to 1.9% false fixes

Comments
3 min read
Full fine-tune vs LoRA vs QLoRA on one L40S: Qwen2.5-1.5B, memory, speed and held-out loss, measured

Full fine-tune vs LoRA vs QLoRA on one L40S: Qwen2.5-1.5B, memory, speed and held-out loss, measured

Comments
6 min read
PyTorch Custom Dataset and DataLoader: __getitem__, __len__, collate_fn, and num_workers

PyTorch Custom Dataset and DataLoader: __getitem__, __len__, collate_fn, and num_workers

Comments
9 min read
How PyTorch Became the Socket Every AI Chip Plugs Into

How PyTorch Became the Socket Every AI Chip Plugs Into

5
Comments
4 min read
LoRA on a 16 GB card: what fits and what does not

LoRA on a 16 GB card: what fits and what does not

Comments
5 min read
Blackwell quantisation on my own card

Blackwell quantisation on my own card

Comments
5 min read
Two PyTorch ops that stopped a CUDA text model on an Apple GPU

Two PyTorch ops that stopped a CUDA text model on an Apple GPU

Comments
5 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.