Local conversational AI

I thought this was going to be easy. I searched reddit, google and even tried to find a solution with LLMs. I saw a few nice things: unmute.sh seems promising, there are webgpu implementations that look impressive, i tried with Sillytavern Ollama and Koboldcpp. All of those solutions suck for various reasons. I remember when sesame ai was released and how I thought we are soon going to have this locally. That was quite some time ago. So I'm coming to you for help.