deepseek-r1 v6.0 · Offline · closed
NVIDIA GB300 NVL72 (72x GB300-288GB_aarch64, TensorRT)NVIDIA
NVIDIA GB300 fp4 2,494,310 deepseek-r1 v6.0 · Offline · closed
Nebius GB300 NVL72 (72x GB300-288GB_aarch64, TensorRT)Nebius
NVIDIA GB300 fp4 673,936 deepseek-r1 v6.0 · Offline · closed
NVIDIA GB300 NVL72 (72x GB300-288GB_aarch64, TensorRT)NVIDIA
NVIDIA GB300 fp4 647,076 deepseek-r1 v6.0 · Offline · closed
NVIDIA GB200 NVL72 (72x GB200-186GB_aarch64, TensorRT)NVIDIA
NVIDIA GB200 fp4 486,141 deepseek-r1 v6.0 · Offline · closed
CoreWeave GB200 NVL72 (64x GB200-186GB_aarch64, TensorRT)CoreWeave
NVIDIA GB200 fp4 468,665 deepseek-r1 v6.0 · Offline · closed
NVIDIA GB200 NVL72 (72x GB200-186GB_aarch64, TensorRT)Google
NVIDIA GB200 fp4 307,874 deepseek-r1 v6.0 · Offline · closed
CoreWeave GB300 NVL72 (8x GB300-288GB_aarch64, TensorRT)CoreWeave
NVIDIA GB300 fp4 78,564 deepseek-r1 v6.0 · Offline · closed
Nebius GB300 NVL72 (4x GB300-288GB_aarch64, TensorRT)Nebius
NVIDIA GB300 fp4 76,346.6 deepseek-r1 v6.0 · Offline · closed
NVIDIA DGX B300 (8x B300-SXM-270GB, TensorRT)NVIDIA
NVIDIA B300-SXM-270GB fp4 70,325.7 deepseek-r1 v6.0 · Offline · closed
G894-SD3-AAX7GigaComputing
NVIDIA B300-SXM-270GB fp4 69,617.4 deepseek-r1 v6.0 · Offline · closed
Nebius B300 n1 (8x B300-SXM-270GB, TensorRT)Nebius
NVIDIA B300-SXM-270GB fp4 69,318.9 deepseek-r1 v6.0 · Offline · closed
QuantaGrid D75H-10U (8x B300-SXM-270GB, TensorRT)Quanta_Cloud_Technology
NVIDIA B300-SXM-270GB fp4 69,263.2 deepseek-r1 v6.0 · Offline · closed
Cisco UCS C880A M8 (8x NVIDIA B300-SXM-270GB, TensorRT)Cisco
NVIDIA B300-SXM-270GB fp4 69,251.4 deepseek-r1 v6.0 · Offline · closed
PowerEdge XE9780 (8x B300-SXM-270GB, TensorRT)Dell
NVIDIA B300-SXM-270GB fp4 69,021.2 deepseek-r1 v6.0 · Offline · closed
PowerEdge XE9780L (8x B300-SXM-270GB, TensorRT)Dell
NVIDIA B300-SXM-270GB fp4 66,287.9 deepseek-r1 v6.0 · Offline · closed
Nebius B200 n1 (8x B200-SXM-180GB, TensorRT)Nebius
NVIDIA B200-SXM-180GB fp4 58,581.6 deepseek-r1 v6.0 · Offline · closed
PowerEdge XE9780 (8x B200-SXM-180GB, TensorRT)Dell
NVIDIA B200-SXM-180GB fp4 58,235.4 deepseek-r1 v6.0 · Offline · closed
NVIDIA DGX B200 (8x B200-SXM-180GB, TensorRT)Google
NVIDIA B200-SXM-180GB fp4 57,116.9 gpt-oss-120b v6.0 · Offline · closed
Nebius GB300 NVL72 (72x GB300-288GB_aarch64, TensorRT)Nebius
NVIDIA GB300 fp4 1,046,150 gpt-oss-120b v6.0 · Offline · closed
NVIDIA GB300 NVL72 (72x GB300-288GB_aarch64, TensorRT)NVIDIA
NVIDIA GB300 fp4 1,042,980 gpt-oss-120b v6.0 · Offline · closed
AMD MI355X Custom ClusterAMD
AMD Instinct MI355X 288GB HBM3e (x94) fp4 1,031,070 gpt-oss-120b v6.0 · Offline · closed
CoreWeave GB300 NVL72 (64x GB300-288GB_aarch64, TensorRT)CoreWeave
NVIDIA GB300 fp4 910,468 gpt-oss-120b v6.0 · Offline · closed
NVIDIA GB200 NVL72 (72x GB200-186GB_aarch64, TensorRT)NVIDIA
NVIDIA GB200 fp4 879,542 gpt-oss-120b v6.0 · Offline · closed
CoreWeave GB200 NVL72 (64x GB200-186GB_aarch64, TensorRT)CoreWeave
NVIDIA GB200 fp4 774,539 gpt-oss-120b v6.0 · Offline · closed
Cisco UCS C880A M8 (8x NVIDIA B300-SXM-270GB, TensorRT)Cisco
NVIDIA B300-SXM-270GB fp4 111,496 gpt-oss-120b v6.0 · Offline · closed
XA NB3I-E12ASUSTeK
NVIDIA B300-SXM-270GB fp4 110,077 gpt-oss-120b v6.0 · Offline · closed
ThinkSystem SR680a V4 (8x B300-SXM-270GB, TensorRT)Lenovo
NVIDIA B300-SXM-270GB fp4 109,141 gpt-oss-120b v6.0 · Offline · closed
G894-SD3-AAX7GigaComputing
NVIDIA B300-SXM-270GB fp4 107,696 gpt-oss-120b v6.0 · Offline · closed
Nebius B300 n1 (8x B300-SXM-270GB, TensorRT)Nebius
NVIDIA B300-SXM-270GB fp4 106,885 gpt-oss-120b v6.0 · Offline · closed
NVIDIA DGX B300 (8x B300-SXM-270GB, TensorRT)NVIDIA
NVIDIA B300-SXM-270GB fp4 103,961 gpt-oss-120b v6.0 · Offline · closed
smci355-ccs-aus-m09-17 (AS -4126GS-NMR-LCC)AMD
AMD Instinct MI355X 288GB HBM3e fp4 95,004 gpt-oss-120b v6.0 · Offline · closed
LLM-D v0.5.0,Openshift 4.20.12,NVIDIA 8xB200-SXM-180GBRedHat
NVIDIA B200-SXM-180GB mxfp4 93,070.7 gpt-oss-120b v6.0 · Offline · closed
G893-ZX1-AAX4GigaComputing
AMD Instinct MI355X 288GB HBM3e fp4 92,332.2 gpt-oss-120b v6.0 · Offline · closed
HPE ProLiant Compute XD685 (8x AMD Instinct MI355X 288GB, vLLM)HPE
AMD Instinct MI355X 288GB HBM3e fp4 91,846.6 gpt-oss-120b v6.0 · Offline · closed
BM.GPU.MI355X.8ORACLE
AMD Instinct MI355X 288GB HBM3e fp4 91,706.3 gpt-oss-120b v6.0 · Offline · closed
PowerEdge XE9785L (8x MI355X)Dell
AMD Instinct MI355X 288GB HBM3e fp4 91,395.5 gpt-oss-120b v6.0 · Offline · closed
Nebius B200 n1 (8x B200-SXM-180GB, TensorRT)Nebius
NVIDIA B200-SXM-180GB fp4 85,921.2 gpt-oss-120b v6.0 · Offline · closed
NVIDIA GB300 NVL72 (4x GB300-288GB_aarch64, TensorRT)Lambda_SIT
NVIDIA GB300 fp4 60,220.4 gpt-oss-120b v6.0 · Offline · closed
LLM-D v0.5.0,OpenShift 4.21,IBM cloud gx3d-160x1792x8h200,NVIDIA 8xH200-SXM-141GBRedHat
NVIDIA H200-SXM-141GB mxfp4 28,680 gpt-oss-120b v6.0 · Offline · closed
HPE ProLiant Compute DL380a Gen12 (10x NVIDIA RTX PRO 6000 Blackwell Server Edition, TensorRT)HPE
NVIDIA RTX PRO 6000 Blackwell Server Edition fp4 19,040.8 gpt-oss-120b v6.0 · Offline · closed
Nebius GB300 NVL72 (4x GB300-288GB_aarch64, TensorRT)Nebius
NVIDIA GB300 fp4 15,371.7 gpt-oss-120b v6.0 · Offline · closed
HPE ProLiant Compute DL380a Gen12 (8x NVIDIA RTX PRO 6000 Blackwell Server Edition, TensorRT)HPE
NVIDIA RTX PRO 6000 Blackwell Server Edition fp4 15,189.9 gpt-oss-120b v6.0 · Offline · closed
HPE ProLiant DL385 Gen11 (4x NVIDIA RTX PRO 6000 Blackwell Server Edition-450W, TensorRT)HPE
NVIDIA RTX PRO 6000 Blackwell Server Edition fp4 7,297.05 gpt-oss-120b v6.0 · Offline · closed
1-node-4x-BMG-Pro-B60-DualIntel
MS-Intel Arc Pro B60 Dual 48G Turbo MXFP4 1,601.91 gpt-oss-120b v6.0 · Offline · closed
1-node-4x-BMG-B70Intel
Intel(R) Arc Pro(R) B70 MXFP4 1,536.9 gpt-oss-120b v6.0 · Offline · closed
1-node-4x-BMG-B60Intel
Intel(R) Arc Pro(R) B60 MXFP4 841.038 llama2-70b-99 v6.0 · Offline · closed
NVIDIA GB300 NVL72 (72x GB300-288GB_aarch64, TensorRT)NVIDIA
NVIDIA GB300 fp4 1,126,850 llama2-70b-99 v6.0 · Offline · closed
AMD MI355X Custom ClusterAMD
AMD Instinct MI355X 288GB HBM3e (x87) fp4 1,042,110 llama2-70b-99 v6.0 · Offline · closed
NVIDIA GB200 NVL72 (72x GB200-186GB_aarch64, TensorRT)NVIDIA
NVIDIA GB200 fp4 888,054 llama2-70b-99 v6.0 · Offline · closed
Cisco UCS 16xMI350XCisco
AMD Instinct MI350X 288GB HBM3e fp4 159,932 llama2-70b-99 v6.0 · Offline · closed
Dell_MangoBoost Heterogeneous Cluster (8x MI300X + 8x MI325X + 8x MI355X, LLMBoost)Dell_MangoBoost
AMD Instinct MI300X 192GB HBM3 (x8) and AMD Instinct MI325X 256GB HBM3e (x8) and AMD Instinct MI355X 288GB HBM3e (x8) fp8 151,843 llama2-70b-99 v6.0 · Offline · closed
Cisco UCS C880A M8 (8x NVIDIA B300-SXM-270GB, TensorRT)Cisco
NVIDIA B300-SXM-270GB fp4 115,730 llama2-70b-99 v6.0 · Offline · closed
NVIDIA DGX B300 (8x B300-SXM-270GB, TensorRT)NVIDIA
NVIDIA B300-SXM-270GB fp4 112,954 llama2-70b-99 v6.0 · Offline · closed
XA NB3I-E12ASUSTeK
NVIDIA B300-SXM-270GB fp4 109,625 llama2-70b-99 v6.0 · Offline · closed
G894-SD3-AAX7GigaComputing
NVIDIA B300-SXM-270GB fp4 109,343 llama2-70b-99 v6.0 · Offline · closed
PowerEdge XE9780L (8x B300-SXM-270GB, TensorRT)Dell
NVIDIA B300-SXM-270GB fp4 108,669 llama2-70b-99 v6.0 · Offline · closed
HPE ProLiant Compute XD685 (8x NVIDIA B200 180GB, TensorRT)HPE
NVIDIA B200-SXM-180GB fp4 103,954 llama2-70b-99 v6.0 · Offline · closed
smci355-ccs-aus-m09-17 (AS -4126GS-NMR-LCC)AMD
AMD Instinct MI355X 288GB HBM3e fp4 103,480 llama2-70b-99 v6.0 · Offline · closed
SYS-822GS-NBRT (8x B200-SXM-180GB, TensorRT)Supermicro
NVIDIA B200-SXM-180GB fp4 101,595 llama2-70b-99 v6.0 · Offline · closed
QuantaGrid D74A-7USupermicro
AMD Instinct MI355X 288GB HBM3e fp4 100,754 llama2-70b-99 v6.0 · Offline · closed
G893-ZX1-AAX4GigaComputing
AMD Instinct MI355X 288GB HBM3e fp4 100,310 llama2-70b-99 v6.0 · Offline · closed
HPE ProLiant Compute XD685 (8x AMD Instinct MI355X 288GB, vLLM)HPE
AMD Instinct MI355X 288GB HBM3e fp4 100,019 llama2-70b-99 v6.0 · Offline · closed
PowerEdge XE9785L (8x MI355X)Dell
AMD Instinct MI355X 288GB HBM3e fp4 100,008 llama2-70b-99 v6.0 · Offline · closed
BM.GPU.MI355X.8ORACLE
AMD Instinct MI355X 288GB HBM3e fp4 99,874.3 llama2-70b-99 v6.0 · Offline · closed
PowerEdge XE9785Dell_MangoBoost
AMD Instinct MI355X 288GB HBM3e fp8 97,535.1 llama2-70b-99 v6.0 · Offline · closed
PowerEdge XE9785 (MI355X Power Cap 1000W)Dell_MangoBoost
AMD Instinct MI355X 288GB HBM3e (Power Cap 1000 W) fp8 81,870.5 llama2-70b-99 v6.0 · Offline · closed
AS-8126GS-TNMR,vLLMSupermicro_RedHat
AMD Instinct MI350X 288GB HBM3e fp4 80,478.1 llama2-70b-99 v6.0 · Offline · closed
G8825Z5MiTAC
AMD Instinct MI350X 288GB HBM3e fp4 78,988.6 llama2-70b-99 v6.0 · Offline · closed
Cisco UCS 8xMI350XCisco
AMD Instinct MI350X 288GB HBM3e fp4 78,936.7 llama2-70b-99 v6.0 · Offline · closed
HPE ProLiant Compute DL380a Gen12 (10x NVIDIA RTX PRO 6000 Blackwell Server Edition, TensorRT)HPE
NVIDIA RTX PRO 6000 Blackwell Server Edition fp4 36,710.8 llama2-70b-99 v6.0 · Offline · closed
MangoBoost Mi325X (8x MI325X, LLMBoost)MangoBoost
AMD Instinct MI325X 256GB HBM3e fp8 33,880.4 llama2-70b-99 v6.0 · Offline · closed
PowerEdge XE7740 (8x H200-NVL-141GB, TensorRT)Dell
NVIDIA H200-NVL-141GB fp8 32,004 llama2-70b-99 v6.0 · Offline · closed
HPE ProLiant Compute DL380a Gen12 (8x NVIDIA RTX PRO 6000 Blackwell Server Edition, TensorRT)HPE
NVIDIA RTX PRO 6000 Blackwell Server Edition fp4 29,908.4 llama2-70b-99 v6.0 · Offline · closed
ESC8000A_E13P_RTX_PRO_6000_PCIE_96GBx8ASUSTeK
NVIDIA RTX PRO 6000 Blackwell Server Edition fp4 27,812.9 llama2-70b-99 v6.0 · Offline · closed
ESC8000_E12P_RTX_PRO_6000_PCIE_96GBx8ASUSTeK
NVIDIA RTX PRO 6000 Blackwell Server Edition fp4 27,730.1 llama2-70b-99 v6.0 · Offline · closed
MangoBoost Mi300X (8x MI300X, LLMBoost)MangoBoost
AMD Instinct MI300X 192GB HBM3 fp8 27,598.7 llama2-70b-99 v6.0 · Offline · closed
PowerEdge XE9680 (8x MI300X)Dell
AMD Instinct MI300X 192GB HBM3 fp8 27,072.5 llama2-70b-99 v6.0 · Offline · closed
PowerEdge XE7740 (8x RTXPro6000-PCIe-96GB, TensorRT)Dell
NVIDIA RTX PRO 6000 Blackwell Server Edition fp4 27,034.8 llama2-70b-99 v6.0 · Offline · closed
ThinkSystem SR675i V3 (8x NVIDIA RTX PRO 6000 Blackwell Server Edition, TensorRT)Lenovo
NVIDIA RTX PRO 6000 Blackwell Server Edition fp4 26,889.6 llama2-70b-99 v6.0 · Offline · closed
PowerEdge XE7745 (8x RTXPro6000-PCIe-96GB, TensorRT)Dell
NVIDIA RTX PRO 6000 Blackwell Server Edition fp4 26,829.8 llama2-70b-99 v6.0 · Offline · closed
Cisco UCS X215c M8 - X580P PCIe Node (4x RTXPro6000-PCIe-96GB, TensorRT)Cisco
NVIDIA RTX PRO 6000 Blackwell Server Edition fp4 13,529.8 llama2-70b-99 v6.0 · Offline · closed
HPE ProLiant DL385 Gen11 (4x NVIDIA RTX PRO 6000 Blackwell Server Edition-450W, TensorRT)HPE
NVIDIA RTX PRO 6000 Blackwell Server Edition fp4 13,361.9 llama2-70b-99 v6.0 · Offline · closed
HPE ProLiant DL385 Gen11 (2x NVIDIA RTX PRO 6000 Blackwell Server Edition-600W, TensorRT)HPE
NVIDIA RTX PRO 6000 Blackwell Server Edition fp4 6,901.9 llama2-70b-99 v6.0 · Offline · closed
HPE ProLiant DL385 Gen11 (2x NVIDIA RTX PRO 6000 Blackwell Server Edition-600W, TensorRT)HPE
NVIDIA RTX PRO 6000 Blackwell Server Edition fp4 6,862.3 llama2-70b-99 v6.0 · Offline · closed
1-node-4x-BMG-Pro-B60-DualIntel
MS-Intel Arc Pro B60 Dual 48G Turbo INT8 3,270.66 llama2-70b-99 v6.0 · Offline · closed
1-node-4x-BMG-B70Intel
Intel(R) Arc Pro(R) B70 INT8 2,459.18 llama2-70b-99 v6.0 · Offline · closed
1-node-4x-BMG-B60Intel
Intel(R) Arc Pro(R) B60 INT8 1,697.66 llama2-70b-99.9 v6.0 · Offline · closed
NVIDIA GB300 NVL72 (72x GB300-288GB_aarch64, TensorRT)NVIDIA
NVIDIA GB300 fp4 1,126,850 llama2-70b-99.9 v6.0 · Offline · closed
AMD MI355X Custom ClusterAMD
AMD Instinct MI355X 288GB HBM3e (x87) fp4 1,042,110 llama2-70b-99.9 v6.0 · Offline · closed
NVIDIA GB200 NVL72 (72x GB200-186GB_aarch64, TensorRT)NVIDIA
NVIDIA GB200 fp4 888,054 llama2-70b-99.9 v6.0 · Offline · closed
Dell_MangoBoost Heterogeneous Cluster (8x MI300X + 8x MI325X + 8x MI355X, LLMBoost)Dell_MangoBoost
AMD Instinct MI300X 192GB HBM3 (x8) and AMD Instinct MI325X 256GB HBM3e (x8) and AMD Instinct MI355X 288GB HBM3e (x8) fp8 151,843 llama2-70b-99.9 v6.0 · Offline · closed
NVIDIA DGX B300 (8x B300-SXM-270GB, TensorRT)NVIDIA
NVIDIA B300-SXM-270GB fp4 112,954 llama2-70b-99.9 v6.0 · Offline · closed
G894-SD3-AAX7GigaComputing
NVIDIA B300-SXM-270GB fp4 109,343 llama2-70b-99.9 v6.0 · Offline · closed
PowerEdge XE9780L (8x B300-SXM-270GB, TensorRT)Dell
NVIDIA B300-SXM-270GB fp4 108,669 llama2-70b-99.9 v6.0 · Offline · closed
HPE ProLiant Compute XD685 (8x NVIDIA B200 180GB, TensorRT)HPE
NVIDIA B200-SXM-180GB fp4 104,572 llama2-70b-99.9 v6.0 · Offline · closed
smci355-ccs-aus-m09-17 (AS -4126GS-NMR-LCC)AMD
AMD Instinct MI355X 288GB HBM3e fp4 103,480 llama2-70b-99.9 v6.0 · Offline · closed
SYS-822GS-NBRT (8x B200-SXM-180GB, TensorRT)Supermicro
NVIDIA B200-SXM-180GB fp4 101,526 llama2-70b-99.9 v6.0 · Offline · closed
QuantaGrid D74A-7USupermicro
AMD Instinct MI355X 288GB HBM3e fp4 100,754 llama2-70b-99.9 v6.0 · Offline · closed
G893-ZX1-AAX4GigaComputing
AMD Instinct MI355X 288GB HBM3e fp4 100,310 llama2-70b-99.9 v6.0 · Offline · closed
HPE ProLiant Compute XD685 (8x AMD Instinct MI355X 288GB, vLLM)HPE
AMD Instinct MI355X 288GB HBM3e fp4 100,019 llama2-70b-99.9 v6.0 · Offline · closed
PowerEdge XE9785L (8x MI355X)Dell
AMD Instinct MI355X 288GB HBM3e fp4 100,008 llama2-70b-99.9 v6.0 · Offline · closed
BM.GPU.MI355X.8ORACLE
AMD Instinct MI355X 288GB HBM3e fp4 99,874.3 llama2-70b-99.9 v6.0 · Offline · closed
PowerEdge XE9785Dell_MangoBoost
AMD Instinct MI355X 288GB HBM3e fp8 97,535.1 llama2-70b-99.9 v6.0 · Offline · closed
PowerEdge XE9785 (MI355X Power Cap 1000W)Dell_MangoBoost
AMD Instinct MI355X 288GB HBM3e (Power Cap 1000 W) fp8 81,870.5 llama2-70b-99.9 v6.0 · Offline · closed
G8825Z5MiTAC
AMD Instinct MI350X 288GB HBM3e fp4 78,988.6 llama2-70b-99.9 v6.0 · Offline · closed
HPE ProLiant Compute DL380a Gen12 (10x NVIDIA RTX PRO 6000 Blackwell Server Edition, TensorRT)HPE
NVIDIA RTX PRO 6000 Blackwell Server Edition fp4 36,704.2 llama2-70b-99.9 v6.0 · Offline · closed
MangoBoost Mi325X (8x MI325X, LLMBoost)MangoBoost
AMD Instinct MI325X 256GB HBM3e fp8 33,880.4 llama2-70b-99.9 v6.0 · Offline · closed
PowerEdge XE7740 (8x H200-NVL-141GB, TensorRT)Dell
NVIDIA H200-NVL-141GB fp8 32,004 llama2-70b-99.9 v6.0 · Offline · closed
HPE ProLiant Compute DL380a Gen12 (8x NVIDIA RTX PRO 6000 Blackwell Server Edition, TensorRT)HPE
NVIDIA RTX PRO 6000 Blackwell Server Edition fp4 29,900.1 llama2-70b-99.9 v6.0 · Offline · closed
MangoBoost Mi300X (8x MI300X, LLMBoost)MangoBoost
AMD Instinct MI300X 192GB HBM3 fp8 27,598.7 llama2-70b-99.9 v6.0 · Offline · closed
PowerEdge XE9680 (8x MI300X)Dell
AMD Instinct MI300X 192GB HBM3 fp8 27,072.5 llama2-70b-99.9 v6.0 · Offline · closed
PowerEdge XE7740 (8x RTXPro6000-PCIe-96GB, TensorRT)Dell
NVIDIA RTX PRO 6000 Blackwell Server Edition fp4 27,034.8 llama2-70b-99.9 v6.0 · Offline · closed
ThinkSystem SR675i V3 (8x NVIDIA RTX PRO 6000 Blackwell Server Edition, TensorRT)Lenovo
NVIDIA RTX PRO 6000 Blackwell Server Edition fp4 26,889.6 llama2-70b-99.9 v6.0 · Offline · closed
PowerEdge XE7745 (8x RTXPro6000-PCIe-96GB, TensorRT)Dell
NVIDIA RTX PRO 6000 Blackwell Server Edition fp4 26,829.8 llama2-70b-99.9 v6.0 · Offline · closed
HPE ProLiant DL385 Gen11 (4x NVIDIA RTX PRO 6000 Blackwell Server Edition-450W, TensorRT)HPE
NVIDIA RTX PRO 6000 Blackwell Server Edition fp4 13,200.3 llama2-70b-99.9 v6.0 · Offline · closed
HPE ProLiant DL385 Gen11 (2x NVIDIA RTX PRO 6000 Blackwell Server Edition-600W, TensorRT)HPE
NVIDIA RTX PRO 6000 Blackwell Server Edition fp4 6,893.36 llama2-70b-99.9 v6.0 · Offline · closed
1-node-4x-BMG-Pro-B60-DualIntel
MS-Intel Arc Pro B60 Dual 48G Turbo INT8 3,270.66 llama2-70b-99.9 v6.0 · Offline · closed
1-node-4x-BMG-B70Intel
Intel(R) Arc Pro(R) B70 INT8 2,459.18 llama2-70b-99.9 v6.0 · Offline · closed
1-node-4x-BMG-B60Intel
Intel(R) Arc Pro(R) B60 INT8 1,697.66 llama3.1-405b v6.0 · Offline · closed
NVIDIA GB300 NVL72 (72x GB300-288GB_aarch64, TensorRT)NVIDIA
NVIDIA GB300 fp4 19,511.7 llama3.1-405b v6.0 · Offline · closed
NVIDIA GB200 NVL72 (72x GB200-186GB_aarch64, TensorRT)NVIDIA
NVIDIA GB200 fp4 15,461.5 llama3.1-405b v6.0 · Offline · closed
Cisco UCS C880A M8 (8x NVIDIA B300-SXM-270GB, TensorRT)Cisco
NVIDIA B300-SXM-270GB fp4 1,971.11 llama3.1-405b v6.0 · Offline · closed
QuantaGrid D75H-10U (8x B300-SXM-270GB, TensorRT)Quanta_Cloud_Technology
NVIDIA B300-SXM-270GB fp4 1,953.77 llama3.1-405b v6.0 · Offline · closed
NVIDIA DGX B300 (8x B300-SXM-270GB, TensorRT)NVIDIA
NVIDIA B300-SXM-270GB fp4 1,951.6 llama3.1-405b v6.0 · Offline · closed
G894-SD3-AAX7GigaComputing
NVIDIA B300-SXM-270GB fp4 1,947.91 llama3.1-405b v6.0 · Offline · closed
NVIDIA DGX B200 (8x B200-SXM-180GB, TensorRT)Google
NVIDIA B200-SXM-180GB fp4 1,350.24 llama3.1-8b v6.0 · Offline · closed
XA NB3I-E12ASUSTeK
NVIDIA B300-SXM-270GB fp4 166,745 llama3.1-8b v6.0 · Offline · closed
NVIDIA DGX B300 (8x B300-SXM-270GB, TensorRT)NVIDIA
NVIDIA B300-SXM-270GB fp4 165,432 llama3.1-8b v6.0 · Offline · closed
NVIDIA DGX B200 (8x B200-SXM-180GB, TensorRT)Lambda_SIT
NVIDIA B200-SXM-180GB fp4 160,403 llama3.1-8b v6.0 · Offline · closed
HPE ProLiant Compute XD685 (8x NVIDIA B200 180GB, TensorRT)HPE
NVIDIA B200-SXM-180GB fp4 152,625 llama3.1-8b v6.0 · Offline · closed
G894-SD3-AAX7GigaComputing
NVIDIA B300-SXM-270GB fp4 150,707 llama3.1-8b v6.0 · Offline · closed
HPE ProLiant Compute DL380a Gen12 (10x NVIDIA RTX PRO 6000 Blackwell Server Edition, TensorRT)HPE
NVIDIA RTX PRO 6000 Blackwell Server Edition fp4 60,679.9 llama3.1-8b v6.0 · Offline · closed
PowerEdge XE7740 (8x H200-NVL-141GB, TensorRT)Dell
NVIDIA H200-NVL-141GB fp8 53,193.6 llama3.1-8b v6.0 · Offline · closed
HPE ProLiant Compute DL380a Gen12 (8x NVIDIA RTX PRO 6000 Blackwell Server Edition, TensorRT)HPE
NVIDIA RTX PRO 6000 Blackwell Server Edition fp4 49,580.2 llama3.1-8b v6.0 · Offline · closed
PowerEdge XE7745 (8x RTXPro6000-PCIe-96GB, TensorRT)Dell
NVIDIA RTX PRO 6000 Blackwell Server Edition fp4 49,036.1 llama3.1-8b v6.0 · Offline · closed
ESC8000A_E13P_RTX_PRO_6000_PCIE_96GBx8ASUSTeK
NVIDIA RTX PRO 6000 Blackwell Server Edition fp4 48,791 llama3.1-8b v6.0 · Offline · closed
ESC8000_E12P_RTX_PRO_6000_PCIE_96GBx8ASUSTeK
NVIDIA RTX PRO 6000 Blackwell Server Edition fp4 48,613.8 llama3.1-8b v6.0 · Offline · closed
Cisco UCS X210 M8 - X580P PCIe Node (4x H200-NVL-141GB, TensorRT)Cisco
NVIDIA H200-NVL-141GB fp8 24,216.6 llama3.1-8b v6.0 · Offline · closed
Cisco UCS X215c M8 - X580P PCIe Node (4x RTXPro6000-PCIe-96GB, TensorRT)Cisco
NVIDIA RTX PRO 6000 Blackwell Server Edition fp4 24,013.5 llama3.1-8b v6.0 · Offline · closed
HPE ProLiant DL385 Gen11 (4x NVIDIA RTX PRO 6000 Blackwell Server Edition-450W, TensorRT)HPE
NVIDIA RTX PRO 6000 Blackwell Server Edition fp4 23,556.7 llama3.1-8b v6.0 · Offline · closed
HPE ProLiant DL385 Gen11 (4x NVIDIA RTX PRO 6000 Blackwell Server Edition-450W, TensorRT)HPE
NVIDIA RTX PRO 6000 Blackwell Server Edition fp4 23,265.7 llama3.1-8b v6.0 · Offline · closed
HPE ProLiant DL385 Gen11 (2x NVIDIA RTX PRO 6000 Blackwell Server Edition-600W, TensorRT)HPE
NVIDIA RTX PRO 6000 Blackwell Server Edition fp4 12,495.2 llama3.1-8b v6.0 · Offline · closed
HPE ProLiant DL385 Gen11 (2x NVIDIA RTX PRO 6000 Blackwell Server Edition-600W, TensorRT)HPE
NVIDIA RTX PRO 6000 Blackwell Server Edition fp4 12,433.3 llama3.1-8b v6.0 · Offline · closed
HPE ProLiant Compute DL380 Gen12 (5x NVIDIA RTX PRO 4500 Blackwell, TensorRT)HPE
NVIDIA RTX PRO 4500 Blackwell fp4 11,665 llama3.1-8b v6.0 · Offline · closed
1-node-4x-BMG-Pro-B60-DualIntel
MS-Intel Arc Pro B60 Dual 48G Turbo INT8 6,762.3 llama3.1-8b v6.0 · Offline · closed
1-node-4x-BMG-B70Intel
Intel(R) Arc Pro(R) B70 INT8 4,617.4 llama3.1-8b v6.0 · Offline · closed
1-node-4x-BMG-B60Intel
Intel(R) Arc Pro(R) B60 INT8 3,347.43 llama3.1-8b v6.0 · Offline · closed
HPE ProLiant DL145 Gen11 (1x NVIDIA RTX PRO 4500 Blackwell, TensorRT)HPE
NVIDIA RTX PRO 4500 Blackwell fp4 2,340.75 llama3.1-8b v6.0 · Offline · closed
1-node-4x-BMG-B50Intel
Intel(R) Arc Pro(R) B50 INT8 1,721.84 llama3.1-8b v6.0 · Offline · closed
1-node-2S-GNR_128CIntel
INT8 1,229.56 llama3.1-8b v6.0 · Offline · closed
1-node-2S-GNR_128CSupermicro
INT8 1,185.98 llama3.1-8b v6.0 · Offline · closed
1-node-2S-GNR_86CDell
INT8 807.675 llama3.1-8b v6.0 · Offline · closed
C240M8-1-node-2S-GNR_86CCisco
INT8 806.105 llama3.1-8b v6.0 · Offline · closed
1-node-2S-GNR_86CQuanta_Cloud_Technology
INT8 777.671 llama3.1-8b v6.0 · Offline · closed
1-node-2S-GNR_86CLenovo
INT8 775.982 mixtral-8x7b v6.0 · Offline · closed
HPE ProLiant Compute XD685 (8x NVIDIA B200 180GB, TensorRT)HPE
NVIDIA B200-SXM-180GB fp4 126,468 mixtral-8x7b v6.0 · Offline · closed
HPE ProLiant Compute DL380a Gen12 (10x NVIDIA RTX PRO 6000 Blackwell Server Edition, TensorRT)HPE
NVIDIA RTX PRO 6000 Blackwell Server Edition fp8 41,242.4 mixtral-8x7b v6.0 · Offline · closed
HPE ProLiant Compute DL380a Gen12 (8x NVIDIA RTX PRO 6000 Blackwell Server Edition, TensorRT)HPE
NVIDIA RTX PRO 6000 Blackwell Server Edition fp8 33,637.3 mixtral-8x7b v6.0 · Offline · closed
HPE ProLiant DL385 Gen11 (4x NVIDIA RTX PRO 6000 Blackwell Server Edition-450W, TensorRT)HPE
NVIDIA RTX PRO 6000 Blackwell Server Edition fp8 14,828.3 mixtral-8x7b v6.0 · Offline · closed
HPE ProLiant DL385 Gen11 (2x NVIDIA RTX PRO 6000 Blackwell Server Edition-600W, TensorRT)HPE
NVIDIA RTX PRO 6000 Blackwell Server Edition fp8 8,198.25