· MD

C15 — Introducing the MLPerf End-to-End RAG Inference Benchmark

Paraphrased finding

RAG benchmark measures ingestion in documents/second and QnA in tasks/second; its first version is Offline, with all requests available together.

Limits

Offline throughput is not online user experience or tail-latency evidence.