Understanding how we evaluate reasoning quality in public discourse
We evaluate: Logical reasoning quality, argument structure, evidence usage, and fallacy detection
We do NOT evaluate: Policy positions, political ideology, or whether we agree with the content
Every speech is broken down into "truth blocks" - atomic units of reasoning that represent individual claims or arguments. This allows us to:
Our AI system detects common logical fallacies including:
Note: Fallacies are identified based on established principles of informal logic and argumentation theory.
We calculate fallacy rate as:
Fallacy Rate = (Total Fallacies / Word Count) × 1000
This standardized metric allows fair comparison across speeches of different lengths:
We are committed to balanced coverage across the political spectrum:
Important: High or low fallacy rates don't indicate whether policies are correct - only whether arguments are logically sound.
We evaluate the logical reasoning quality in public speeches, including fallacy detection, argument structure, and evidence usage. We do NOT evaluate policy positions or political ideology.
Our AI system analyzes speeches by breaking them into 'truth blocks' - individual claims or arguments. Each block is evaluated for logical fallacies, reasoning quality, and evidence support using advanced language models trained on argumentation theory.
No. We evaluate reasoning quality, not political positions. We aim for balanced representation across the political spectrum and display our coverage statistics transparently on the figures list page.
Truth blocks are atomic units of reasoning - individual claims or arguments extracted from speeches. By breaking speeches into smaller units, we can evaluate each claim independently and provide more granular feedback.
AI evaluation is a tool, not a final judgment. While our system is sophisticated, it can make mistakes. We encourage users to read the original speeches and form their own conclusions. The AI analysis is meant to highlight potential issues for further investigation.
Yes! Every speech detail page shows the full transcript, all truth blocks, and detailed fallacy analysis. We believe in complete transparency about our evaluation process.
Our system is based on established principles of informal logic and argumentation theory. We use widely recognized fallacy taxonomies and detection methods. The methodology is documented and can be reviewed by anyone.
Currently, the system is managed by administrators who curate speeches and ensure balanced coverage. In the future, we may add community features. For now, you can provide feedback through our contact form.