SOURCE-LINKED INTELLIGENCE

llama2-70b-99.9 — Offline — MiTAC_G4520G6_RTX_PRO_6000_PCIE_96GBx8_TRT

MLCommons MLPerf · observation · Publication date unknown

30034.2 Tokens/s; MLPerf v6.1, closed.

Read original source ↗ Open in workspace

recordType

benchmark

region

Global

value

30034.2

unit

Tokens/s

dimensions

{"division":"closed","location":"./closed/MiTAC/results/MiTAC_G4520G6_RTX_PRO_6000_PCIE_96GBx8_TRT/llama2-70b-99.9/Offline/performance/run_1","metric":"Performance_Result","model":"llama2-70b-99.9","precision":"fp4","release":"v6.1","scenario":"Offline","submissionId":null,"submitter":"MiTAC","suite":"datacenter","system":"MiTAC_G4520G6_RTX_PRO_6000_PCIE_96GBx8_TRT","unit":"Tokens/s"}