SOURCE-LINKED INTELLIGENCE

llama2-70b-99.9 — Server — Cisco_UCS_H200x8_MI350Xx8_G200_2x2_TOR

MLCommons MLPerf · observation · Publication date unknown

95104.6 Tokens/s; MLPerf v6.1, closed.

Read original source ↗ Open in workspace

recordType

benchmark

region

Global

value

95104.6

unit

Tokens/s

dimensions

{"division":"closed","location":"./closed/Cisco/results/Cisco_UCS_H200x8_MI350Xx8_G200_2x2_TOR/llama2-70b-99.9/Server/performance/run_1","metric":"Performance_Result","model":"llama2-70b-99.9","precision":"fp8,fp4","release":"v6.1","scenario":"Server","submissionId":null,"submitter":"Cisco","suite":"datacenter","system":"Cisco_UCS_H200x8_MI350Xx8_G200_2x2_TOR","unit":"Tokens/s"}