The Wahl-O-Mat (https://wahl-o-mat.de/) is a quiz-based website that asks user to select it they agree or disagree with various statements and then matches how similarly parties running in elections answer compared to the user. Additionally for each statement a party can give its justification for why they agree or disagree with a statement.
I used this questionnaire from the Wahl-O-Mat and the parties' justifications for their Wahl-O-Mat answer to estimate which party various large language models would prefer.
Maybe not surprising: Most models are slightly left of the political center. In Berlin, the preferred party are DIE GRÜNEN (moderate left wing party). In Mecklenburg-Vorpommmern and Sachsen-Anhalt it looks slightly different, but not much.
One surprise is that Grok models answer the Wahl-O-Mat in a way that aligns with the FDP, AfD, and CDU (moderately right to far right parties). However, when Grok models judge the (party blinded) justifications, they fall slightly left of the political center, not far from all the other models. The most left-wing model (going by justifications) in Berlin is mistral-medium-3-5, the most right-wing is gemini-3.7-flash.
On the website you can look into all the reasons models gave why they liked or disliked a particular justification of a party, and also a bunch of other stats. And the methodological details. (Sorry for mobile users, this website is not really made for small screens)
Disclaimer: This project was largely vibe coded, but the analysis methods and write up are mostly by myself (because unfortunately for many things LLMs are still very stupid).
Another disclaimer: This is NOT a resource to find out who to vote for. The LLM responses may make sense in some case, but may also be misinformed or include hallucinations (in sometimes non-obvious ways)!
The Wahl-O-Mat (https://wahl-o-mat.de/) is a quiz-based website that asks user to select it they agree or disagree with various statements and then matches how similarly parties running in elections answer compared to the user. Additionally for each statement a party can give its justification for why they agree or disagree with a statement.
I used this questionnaire from the Wahl-O-Mat and the parties' justifications for their Wahl-O-Mat answer to estimate which party various large language models would prefer.
Maybe not surprising: Most models are slightly left of the political center. In Berlin, the preferred party are DIE GRÜNEN (moderate left wing party). In Mecklenburg-Vorpommmern and Sachsen-Anhalt it looks slightly different, but not much.
One surprise is that Grok models answer the Wahl-O-Mat in a way that aligns with the FDP, AfD, and CDU (moderately right to far right parties). However, when Grok models judge the (party blinded) justifications, they fall slightly left of the political center, not far from all the other models. The most left-wing model (going by justifications) in Berlin is mistral-medium-3-5, the most right-wing is gemini-3.7-flash.
On the website you can look into all the reasons models gave why they liked or disliked a particular justification of a party, and also a bunch of other stats. And the methodological details. (Sorry for mobile users, this website is not really made for small screens)
Disclaimer: This project was largely vibe coded, but the analysis methods and write up are mostly by myself (because unfortunately for many things LLMs are still very stupid). Another disclaimer: This is NOT a resource to find out who to vote for. The LLM responses may make sense in some case, but may also be misinformed or include hallucinations (in sometimes non-obvious ways)!