How does the new abliteration tool Apostate compare with others? - Abliterlitics
r/LocalLLaMA
•
Machine Learning
Open Source AI
AI Research
AI Tools
Why Qwen 2.5 7B? Apostate is a new abliteration tool by heterodoxin. He asked me to benchmark it. Qwen 2.5 7B was recommended by heterodoxin as it's the most tested model for Apostate. I abliterated the model with Heretic v1.3.0 and Apostate. The models are available on huggingface. The tool itself is inspired by Heretic, after reviewing the code it is clearly original work by someone who understands the ML and maths involved. The author of Heretic, p-e-w also confirmed this when Apostate was shared in the Heretic discord.