Benchmark Decision-model Throughput And Cache Effectiveness

SOLO reorders rows and fields in structured datasets to increase prefix-cache reuse when sending per-row semantic decisions to an LLM. It includes a table/JSON execution client, layout diagnostics, benchmarks, and vLLM decision-model adapters.

AI Tools | Python · LLM inference optimization · prefix caching