Janas: Run LLMs larger than RAM by streaming experts from SSD

Article URL: https://github.com/prabanta-dev/janas Comments URL: https://news.ycombinator.com/item?id=50063717 Points: 12 # Comments: 3