Score Runtime-defined Options Without Generating Response Text

Python tool for scoring runtime-defined semantic decisions with open models. It reads option probabilities directly from model logits, with calibration and direct, cached, and parallel scoring modes; includes PyTorch, MLX, llama.cpp, and browser demos.

AI Tools | Python · semantic decisions · direct logits