Skip to content
Navigation menu
Search
Powered by Algolia
Search
Log in
Create account
DEV Community
Close
#
moestream
Follow
Hide
Posts
Left menu
👋
Sign in
for the ability to sort posts by
relevant
,
latest
, or
top
.
Right menu
Running a 26B MoE on an 8 GB Jetson by streaming experts from SSD
Anish Shrestha
Anish Shrestha
Anish Shrestha
Follow
Aug 1
Running a 26B MoE on an 8 GB Jetson by streaming experts from SSD
#
moestream
#
llamacpp
#
mixtureofexperts
#
jetsonorin
Comments
Add Comment
6 min read
👋
Sign in
for the ability to sort posts by
relevant
,
latest
, or
top
.
We're a place where coders share, stay up-to-date and grow their careers.
Log in
Create account
