SOURCE-LINKED INTELLIGENCE

llama2-70b-99.9 — Server — XE7745_RTXPRO4500_32GBx8_TRT

MLCommons MLPerf · observation · Publication date unknown

3012.33 Tokens/s; MLPerf v6.1, closed.

Read original source ↗ Open in workspace

recordType

benchmark

region

Global

value

3012.33

unit

Tokens/s

dimensions

{"division":"closed","location":"./closed/Dell/results/XE7745_RTXPRO4500_32GBx8_TRT/llama2-70b-99.9/Server/performance/run_1","metric":"Performance_Result","model":"llama2-70b-99.9","precision":"fp4","release":"v6.1","scenario":"Server","submissionId":null,"submitter":"Dell","suite":"datacenter","system":"XE7745_RTXPRO4500_32GBx8_TRT","unit":"Tokens/s"}