diff --git a/PyTorch/LanguageModeling/BERT/triton/README.md b/PyTorch/LanguageModeling/BERT/triton/README.md index 119b92592..1474fdc4f 100644 --- a/PyTorch/LanguageModeling/BERT/triton/README.md +++ b/PyTorch/LanguageModeling/BERT/triton/README.md @@ -102,7 +102,7 @@ To make the machine wait until the server is initialized, and the model is ready ## Performance -The numbers below are averages, measured on Triton, with [static batching](https://docs.nvidia.com/deeplearning/sdk/tensorrt-inference-server-guide/docs/model_configuration.html#scheduling-and-batching). +The numbers below are averages, measured on Triton on V100 32G GPU, with [static batching](https://docs.nvidia.com/deeplearning/sdk/tensorrt-inference-server-guide/docs/model_configuration.html#scheduling-and-batching). | Format | GPUs | Batch size | Sequence length | Throughput - FP32(sequences/sec) | Throughput - mixed precision(sequences/sec) | Throughput speedup (mixed precision/FP32) | |--------|------|------------|-----------------|----------------------------------|---------------------------------------------|--------------------------------------------|