Context Beats Magnitude: Why Embedding Sentences Outperforms Raw Numbers in Anomaly Detection

Wed, 01 Apr 2026 08:00:00 +0000

54.20. That’s what the transaction amount field contains. Embed that string and the model learns something about the number 54.20: that it sits near 54.19 and 54.21, that it’s a plausible price for groceries or a restaurant meal. It doesn’t learn anything about where the money went or when. This post uses a deliberately reductive fraud-shaped example to make a narrower point: formatting structured fields as a sentence gives the embedder more context than a raw scalar ever can.

Fraud-Detection on Thoughts and code

Context Beats Magnitude: Why Embedding Sentences Outperforms Raw Numbers in Anomaly Detection