SOURCE-LINKED INTELLIGENCE

llama3.1-8b — Server — HPE_XD685_MI355X_288GBx8_vLLM

MLCommons MLPerf · observation · Publication date unknown

148118 Tokens/s; MLPerf v6.1, closed.

Read original source ↗ Open in workspace

recordType

benchmark

region

Global

value

148118

unit

Tokens/s

dimensions

{"division":"closed","location":"./closed/HPE/results/HPE_XD685_MI355X_288GBx8_vLLM/llama3.1-8b/Server/performance/run_1","metric":"Performance_Result","model":"llama3.1-8b","precision":"fp8","release":"v6.1","scenario":"Server","submissionId":null,"submitter":"HPE","suite":"datacenter","system":"HPE_XD685_MI355X_288GBx8_vLLM","unit":"Tokens/s"}