# SVM-MPQA (FinancialPhraseBank) Benchmark Scores & Performance

> SVM-MPQA (FinancialPhraseBank) has published results in 2 original benchmark tables. The evaluated configuration, source metrics, and precision remain visible below. These results do not produce a general model score or rank.

Canonical page: https://benchlm.ai/models/native-financialphrasebank-svm-mpqa

Last updated: 2026-10-01

General benchmark catalog last updated: October 1, 2026. This profile’s source review has its own date above.

## Model Details

| Property | Value |
|----------|-------|
| Creator | Malo et al. |
| Source Type | Research system |
| Reasoning Type | Unspecified |
| Context Window | Not established by evaluation |
| Official model card | [Benchmark-owner results and configuration](https://arxiv.org/abs/1307.5336) |
| Overall Score | Not computed (source protocol results only) |
| Overall Rank | Unranked |

## Family & Coverage

- Family: SVM-MPQA (FinancialPhraseBank)
- Variant: benchmark-system
- Benchmarks covered: 0 of 645
- Coverage note: Original benchmark result tables appear below; these metrics are separate from weighted benchmark slots.

## Original benchmark results

[All model results (JSON)](/api/data/benchmarks?model=native-financialphrasebank-svm-mpqa) · [Numeric metrics (CSV)](/api/data/benchmarks?model=native-financialphrasebank-svm-mpqa&format=csv)

### Class metrics at 100% and >75% agreement

The original study reports ten-fold cross-validation at four annotator-agreement thresholds. Its class-specific accuracy, precision, recall, and F1 are ratios from 0 to 1. These are not overall sentiment accuracy or Perplexity’s sampled panel. No unified modern leaderboard is published in the reviewed benchmark-owner sources.

All metrics are 0–1 ratios. SVM-MPQA is the paper’s baseline marked with footnote a.

Good Debt or Bad Debt: Detecting Semantic Orientations in Economic Texts — Pekka Malo and colleagues. Numeric results transcribed and reformatted; evaluation notes and model links added by BenchLM. Published numeric precision is retained.

[Published source](https://arxiv.org/abs/1307.5336) · [Full FinancialPhraseBank results](/benchmarks/financialphrasebank)

| Agreement | Class | Metric | SVM-MPQA |
| --- | --- | --- | --- |
| 100% | Positive | Accuracy | 0.746 |
| 100% | Positive | Recall | 0.060 |
| 100% | Positive | Precision | 0.466 |
| 100% | Positive | F1-score | 0.106 |
| 100% | Neutral | Accuracy | 0.652 |
| 100% | Neutral | Recall | 0.963 |
| 100% | Neutral | Precision | 0.645 |
| 100% | Neutral | F1-score | 0.773 |
| 100% | Negative | Accuracy | 0.870 |
| 100% | Negative | Recall | 0.205 |
| 100% | Negative | Precision | 0.534 |
| 100% | Negative | F1-score | 0.296 |
| >75% | Positive | Accuracy | 0.744 |
| >75% | Positive | Recall | 0.077 |
| >75% | Positive | Precision | 0.511 |
| >75% | Positive | F1-score | 0.133 |
| >75% | Neutral | Accuracy | 0.657 |
| >75% | Neutral | Recall | 0.973 |
| >75% | Neutral | Precision | 0.650 |
| >75% | Neutral | F1-score | 0.779 |
| >75% | Negative | Accuracy | 0.886 |
| >75% | Negative | Recall | 0.162 |
| >75% | Negative | Precision | 0.630 |
| >75% | Negative | F1-score | 0.258 |

### Class metrics at >66% and >50% agreement

The original study reports ten-fold cross-validation at four annotator-agreement thresholds. Its class-specific accuracy, precision, recall, and F1 are ratios from 0 to 1. These are not overall sentiment accuracy or Perplexity’s sampled panel. No unified modern leaderboard is published in the reviewed benchmark-owner sources.

All metrics are 0–1 ratios. SVM-MPQA is the paper’s baseline marked with footnote a.

Good Debt or Bad Debt: Detecting Semantic Orientations in Economic Texts — Pekka Malo and colleagues. Numeric results transcribed and reformatted; evaluation notes and model links added by BenchLM. Published numeric precision is retained.

[Published source](https://arxiv.org/abs/1307.5336) · [Full FinancialPhraseBank results](/benchmarks/financialphrasebank)

| Agreement | Class | Metric | SVM-MPQA |
| --- | --- | --- | --- |
| >66% | Positive | Accuracy | 0.722 |
| >66% | Positive | Recall | 0.076 |
| >66% | Positive | Precision | 0.494 |
| >66% | Positive | F1-score | 0.132 |
| >66% | Neutral | Accuracy | 0.632 |
| >66% | Neutral | Recall | 0.966 |
| >66% | Neutral | Precision | 0.626 |
| >66% | Neutral | F1-score | 0.759 |
| >66% | Negative | Accuracy | 0.883 |
| >66% | Negative | Recall | 0.142 |
| >66% | Negative | Precision | 0.584 |
| >66% | Negative | F1-score | 0.228 |
| >50% | Positive | Accuracy | 0.716 |
| >50% | Positive | Recall | 0.068 |
| >50% | Positive | Precision | 0.465 |
| >50% | Positive | F1-score | 0.119 |
| >50% | Neutral | Accuracy | 0.623 |
| >50% | Neutral | Recall | 0.965 |
| >50% | Neutral | Precision | 0.616 |
| >50% | Neutral | F1-score | 0.752 |
| >50% | Negative | Accuracy | 0.880 |
| >50% | Negative | Recall | 0.134 |
| >50% | Negative | Precision | 0.574 |
| >50% | Negative | F1-score | 0.217 |

## Other Malo et al. Models

- [LPS (FinancialPhraseBank)](/models/native-financialphrasebank-lps) - Score: not computed
- [R-LPS (FinancialPhraseBank)](/models/native-financialphrasebank-r-lps) - Score: not computed
- [W-Loughran (FinancialPhraseBank)](/models/native-financialphrasebank-w-loughran) - Score: not computed
- [W-MPQA (FinancialPhraseBank)](/models/native-financialphrasebank-w-mpqa) - Score: not computed