How fast is LlamaStash? Overhead, throughput, and a fair comparison with Ollama and LM Studio
Technorage
A reproducible benchmark of LlamaStash against raw llama-server, Ollama, and LM Studio on AMD APU, Apple Silicon, and NVIDIA
Technorage
A reproducible benchmark of LlamaStash against raw llama-server, Ollama, and LM Studio on AMD APU, Apple Silicon, and NVIDIA
Technorage
A fast TUI, CLI, daemon, and OpenAI-compatible proxy for running local LLMs via llama.cpp, in one Rust binary
Chad Austin
Or: The Most Expensive Linked List I’ve Ever Written Some of you already know the contents of this post, especially if you’ve written embedded or unsafe code in Rust. But I didn’t, so I thought it was useful to write down my experience as accurately as I can. Without further ado… Last year, I...
Chad Austin
Reference counting is cheap and easy. An integer starts at one, increments on every new reference, and whoever decrements it to zero is responsible for deallocation. If references are shared across threads, increments and decrements must be atomic. Decades ago, I wrote an audio library that...
Technorage
Rust tooling is taking over the terminal. Use these awesome tools to supercharge your Linux/macOS/Windows terminal.
Technorage
Building a concurrent web server in Rust, Go, JS, TS, .NET, and Java to compare concurrency performance
Technorage
Being a polyglot developer, there would be some language you like over others and here are mine.
Technorage
My second impression of Rust, after building a real-life use case with it and my thoughts on why it is a great general-purpose language for the future.
Technorage
Building a concurrent web server in Rust to compare concurrency performance with Go, JS, TS, Kotlin, and Java
Technorage
Let us take a closer look at how Rust manages memory.
Technorage
Let's test drive GraalVM with a program that uses many languages together. Why? Because it's fun!
Technorage
Functional programming concepts in Rust for beginners.
Technorage
This is what I thought about Rust while learning it. From a pragmatic perspective.