SOURCE-LINKED INTELLIGENCE

llama3.1-8b-edge — Offline — HPE_PROLIANT_DL345_GEN12_RTX_PRO_4500_PCIE_32GBx4_TRT_open

MLCommons MLPerf · observation · Publication date unknown

9557.69 Tokens/s; MLPerf v6.1, open.

Read original source ↗ Open in workspace

recordType

benchmark

region

Global

value

9557.69

unit

Tokens/s

dimensions

{"division":"open","location":"./open/HPE/results/HPE_PROLIANT_DL345_GEN12_RTX_PRO_4500_PCIE_32GBx4_TRT_open/llama3.1-8b-edge/Offline/performance/run_1","metric":"Performance_Result","model":"llama3.1-8b-edge","precision":"fp4","release":"v6.1","scenario":"Offline","submissionId":null,"submitter":"HPE","suite":"edge","system":"HPE_PROLIANT_DL345_GEN12_RTX_PRO_4500_PCIE_32GBx4_TRT_open","unit":"Tokens/s"}