Model Latency and Throughput

Latency Across Batch Sizes

Throughput Across Batch Sizes