Salvatore Sanfilippo, the creator of Redis, just dropped a masterclass for the local AI community. ds4 is a native ultra-optimized local inference engine for DeepSeek V4 Flash on Apple Silicon using Metal. Treats your SSD as a first-class citizen for the KV cache, streaming live conversation context to disk instead of hogging Unified Memory. Switch chat sessions or restart the server and it instantly resumes exact context without reprocessing thousands of prompt tokens.

https://github.com/antirez/ds4

#github #opensource