Building Conifer, an open-source local inference runtime (free + open source)

Team of 5 from Princeton, and we got funding to build a local inference engine for Apple Silicon - rust, hand written kernels - and we're at the point where working with ~100 people will expose bugs/what people want tool-wise. All of this is free open source - will remain so. We're ahead of llama/mlx for small models working on similar performance for larger in the long run. Where this is going: the engine we're building s a fully local agent that can do real work on your own files, apps, has permissions with OS kernel enforcement.