beginner/serving_tutorial

Run in Google Colab

Colab

Download Notebook

Notebook

View on GitHub

GitHub

Serve PyTorch models at scale with Ray Serve

Author: Ricardo Decal

This tutorial shows how to deploy a PyTorch model using Ray Serve with production-ready features.

What you will learn

• How to create a production-ready PyTorch model deployment that can scale to thousands of nodes and GPUs

• How to configure an HTTP endpoint for the deployment using FastAPI

• Enable dynamic request batching for higher throughput

• Configure autoscaling and per-replica CPU/GPU resource allocation

• Load test the service with concurrent requests and monitor it with the Ray dashboard

• How Ray Serve deployments can self-heal from failures

• Ray Serve’s advanced features like model multiplexing and model composition.

Prerequisites

• PyTorch v2.9+ and torchvision

• Ray Serve (ray[serve]) v2.52.1+

• A GPU is recommended for higher throughput but is not required

Ray Serve is a scalable framework for serving machine learning models in production. It’s built on top of Ray, which is a unified framework for scaling AI and Python applications that simplifies the complexities of distributed computing. Ray is also open source and part of the PyTorch Foundation.

Setup

To install the dependencies, run:

pip install "ray[serve]" torch torchvision

Start by importing the required libraries:

import asyncio
import time
from typing import Any

from fastapi import FastAPI
from pydantic import BaseModel
import aiohttp
import numpy as np
import torch
import torch.nn as nn
from ray import serve
from torchvision.transforms import v2

Define a PyTorch model

Define a simple convolutional neural network for the MNIST digit classification dataset:

class MNISTNet(nn.Module):
    def __init__(self):
        super().__init__()
        self.conv1 = nn.Conv2d(1, 32, 3, 1)
        self.dropout1 = nn.Dropout(0.25)
        self.conv2 = nn.Conv2d(32, 64, 3, 1)
        self.fc1 = nn.Linear(9216, 128)
        self.dropout2 = nn.Dropout(0.5)
        self.fc2 = nn.Linear(128, 10)

    def forward(self, x):
        x = self.conv1(x)
        x = nn.functional.relu(x)
        x = self.conv2(x)
        x = nn.functional.relu(x)
        x = nn.functional.max_pool2d(x, 2)
        x = self.dropout1(x)
        x = torch.flatten(x, 1)
        x = self.fc1(x)
        x = nn.functional.relu(x)
        x = self.dropout2(x)
        x = self.fc2(x)
        return nn.functional.log_softmax(x, dim=1)

Define the Ray Serve deployment

To deploy this model with Ray Serve, wrap the model in a Python class and decorate it with @serve.deployment.

Processing requests in batches is more efficient than processing requests one by one, especially when using GPUs. Ray Serve provides built-in support for dynamic request batching, where individual incoming requests are opportunistically batched. Enable dynamic batching using the @serve.batch decorator as shown in the following code:

app = FastAPI()

class ImageRequest(BaseModel):  # Used for request validation and generating API documentation
    image: list[list[float]] | list[list[list[float]]]  # 2D or 3D array

@serve.deployment
@serve.ingress(app)
class MNISTClassifier:
    def __init__(self):
        self.device = torch.device("cuda" if torch.cuda.is_available() else "cpu")
        self.model = MNISTNet().to(self.device)
        # Define the transformation pipeline for the input images.
        self.transform = v2.Compose([
            v2.ToImage(),
            v2.ToDtype(torch.float32, scale=True),
            # Mean and standard deviation of the MNIST training subset.
            v2.Normalize(mean=[0.1307], std=[0.3013]),
        ])

        self.model.eval()

    # batch_wait_timeout_s is the maximum time to wait for a full batch,
    # trading off latency for throughput.
    @serve.batch(max_batch_size=128, batch_wait_timeout_s=0.1)
    async def predict_batch(self, images: list[np.ndarray]) -> list[dict[str, Any]]:
        # Stack all images into a single tensor.
        batch_tensor = torch.cat([
            self.transform(img).unsqueeze(0)
            for img in images
        ]).to(self.device).float()

        # Single forward pass on the entire batch at once.
        with torch.no_grad():
            logits = self.model(batch_tensor)
            predictions = torch.argmax(logits, dim=1).cpu().numpy()

        # Unbatch the results and preserve their original order.
        return [
            {
                "predicted_label": int(pred),
                "logits": logit.cpu().numpy().tolist()
            }
            for pred, logit in zip(predictions, logits)
        ]

    @app.post("/")
    async def handle_request(self, request: ImageRequest):
        """Handle an incoming HTTP request using FastAPI.

        Inputs are automatically validated using the Pydantic model.
        """
        # Process the single request.
        image_array = np.array(request.image)

        # Ray Serve's @serve.batch automatically batches requests.
        result = await self.predict_batch(image_array)

        return result

This is a FastAPI app, which extends Ray Serve with features like automatic request validation with Pydantic, auto-generated OpenAPI-style API documentation, and more.

Configure autoscaling and resource allocation

In production, traffic can vary significantly. Ray Serve’s autoscaling feature automatically adjusts the number of replicas based on traffic load, ensuring you have enough capacity during peaks while saving resources during quiet periods. Ray Serve scales to very large deployments with thousands of nodes and replicas.

You can also specify resource allocation per replica, such as the number of CPUs or GPUs. Ray Serve handles the orchestration of these resources across your cluster. Ray also supports fractional GPUs, allowing multiple replicas to share a single GPU when models are small enough to fit in memory together.

The following is a sample configuration with autoscaling and resource allocation:

num_cpus_per_replica = 1
num_gpus_per_replica = 1  # Set to 0 to run the model on CPUs instead of GPUs.
mnist_app = MNISTClassifier.options(
    autoscaling_config={
        "target_ongoing_requests": 50,  # Target 50 ongoing requests per replica.
        "min_replicas": 1,              # Keep at least 1 replica alive.
        "max_replicas": 80,             # Scale up to 80 replicas to maintain target_ongoing_requests.
        "upscale_delay_s": 5,           # Wait 5s before scaling up.
        "downscale_delay_s": 30,        # Wait 30s before scaling down.
    },
    # Max invocations to handle_request per replica to process simultaneously.
    # Requests exceeding this limit are queued by the router until capacity is available.
    max_ongoing_requests=200,
    # Max queue size for requests that exceed max_ongoing_requests.
    # If the queue is full, future requests are backpressured with errors until space is available.
    # -1 means the queue can grow until cluster memory is exhausted.
    max_queued_requests=-1,
    # Set the resources per replica.
    ray_actor_options={"num_cpus": num_cpus_per_replica, "num_gpus": num_gpus_per_replica}
).bind()

The app is ready to deploy. Suppose you ran this on a cluster of 10 machines, each with 4 GPUs. With num_gpus=0.5, Ray schedules 2 replicas per GPU, giving you 80 replicas across the cluster. This configuration permits the deployment to elastically scale up to 80 replicas as needed to handle traffic spikes and scale back down to 1 replica when traffic subsides.

Test the endpoint with concurrent requests

To deploy the app, use the serve.run function:

# Start the Ray Serve application.
handle = serve.run(mnist_app, name="mnist_classifier")

2026-04-17 16:02:12,393 WARNING services.py:2168 -- WARNING: The object store is using /tmp instead of /dev/shm because /dev/shm has only 2147471360 bytes available. This will harm performance! You may be able to free up space by deleting files in /dev/shm. If you are inside a Docker container, you can increase /dev/shm size by passing '--shm-size=10.24gb' to 'docker run' (or add it to the run_options list in a Ray cluster config). Make sure to set this to more than 30% of available RAM.
2026-04-17 16:02:14,567 INFO worker.py:2004 -- Started a local Ray instance. View the dashboard at 127.0.0.1:8265
/usr/local/lib/python3.10/dist-packages/ray/_private/worker.py:2052: FutureWarning: Tip: In future versions of Ray, Ray will no longer override accelerator visible devices env var if num_gpus=0 or num_gpus=None (default). To enable this behavior and turn off this error message, set RAY_ACCEL_ENV_VAR_OVERRIDE_ON_ZERO=0
  warnings.warn(
INFO 2026-04-17 16:02:17,034 serve 3836 -- Started Serve in namespace "serve".
(ProxyActor pid=4640) INFO 2026-04-17 16:02:16,963 proxy 172.17.0.2 -- Proxy starting on node fc46574f34e7ed8ccec864962fedaf0b4a9f66b3f64243e1b0b9f45d (HTTP port: 8000).
(ProxyActor pid=4640) INFO 2026-04-17 16:02:17,031 proxy 172.17.0.2 -- Got updated endpoints: {}.
(ServeController pid=4652) INFO 2026-04-17 16:02:17,087 controller 4652 -- Registering autoscaling state for deployment Deployment(name='MNISTClassifier', app='mnist_classifier')
(ServeController pid=4652) INFO 2026-04-17 16:02:17,088 controller 4652 -- Deploying new version of Deployment(name='MNISTClassifier', app='mnist_classifier') (initial target replicas: 1).
(ProxyActor pid=4640) INFO 2026-04-17 16:02:17,092 proxy 172.17.0.2 -- Got updated endpoints: {Deployment(name='MNISTClassifier', app='mnist_classifier'): EndpointInfo(route='/', app_is_cross_language=False, route_patterns=None)}.
(ProxyActor pid=4640) INFO 2026-04-17 16:02:17,098 proxy 172.17.0.2 -- Started <ray.serve._private.router.SharedRouterLongPollClient object at 0x7f4bf0aebca0>.
(ServeController pid=4652) INFO 2026-04-17 16:02:17,191 controller 4652 -- Adding 1 replica to Deployment(name='MNISTClassifier', app='mnist_classifier').
(ProxyActor pid=4640) INFO 2026-04-17 16:02:21,018 proxy 172.17.0.2 -- Got updated endpoints: {Deployment(name='MNISTClassifier', app='mnist_classifier'): EndpointInfo(route='/', app_is_cross_language=False, route_patterns=[RoutePattern(methods=['POST'], path='/'), RoutePattern(methods=['GET', 'HEAD'], path='/docs'), RoutePattern(methods=['GET', 'HEAD'], path='/docs/oauth2-redirect'), RoutePattern(methods=['GET', 'HEAD'], path='/openapi.json'), RoutePattern(methods=['GET', 'HEAD'], path='/redoc')])}.
INFO 2026-04-17 16:02:21,154 serve 3836 -- Application 'mnist_classifier' is ready at http://127.0.0.1:8000/.

You will see output similar to:

Started Serve in namespace "serve".
Registering autoscaling state for deployment Deployment(name='MNISTClassifier', app='mnist_classifier')
Deploying new version of Deployment(name='MNISTClassifier', app='mnist_classifier') (initial target replicas: 1).
Proxy starting on node ... (HTTP port: 8000).
Got updated endpoints: {}.
Got updated endpoints: {Deployment(name='MNISTClassifier', app='mnist_classifier'): EndpointInfo(route='/', app_is_cross_language=False, route_patterns=None)}.
Started <ray.serve._private.router.SharedRouterLongPollClient object at 0x73a53c52c250>.
Adding 1 replica to Deployment(name='MNISTClassifier', app='mnist_classifier').
Got updated endpoints: {Deployment(name='MNISTClassifier', app='mnist_classifier'): EndpointInfo(route='/', app_is_cross_language=False, route_patterns=['/', '/docs', '/docs/oauth2-redirect', '/openapi.json', '/redoc'])}.
Application 'mnist_classifier' is ready at http://127.0.0.1:8000/.

The app is now listening for requests on port 8000.

To test the deployment, you can send many requests concurrently using aiohttp. The following code demonstrates how to send 1000 concurrent requests to the app:

async def send_single_request(session, url, data):
    async with session.post(url, json=data) as response:
        return await response.json()

async def send_concurrent_requests(num_requests):
    image = np.random.rand(28, 28).tolist()

    print(f"Sending {num_requests} concurrent requests...")
    async with aiohttp.ClientSession() as session:
        tasks = [
            send_single_request(session, url="http://localhost:8000/", data={"image": image})
            for _ in range(num_requests)
        ]
        responses = await asyncio.gather(*tasks)

    return responses

# Run the concurrent requests.
start_time = time.time()
responses = asyncio.run(send_concurrent_requests(1000))
elapsed = time.time() - start_time

print(f"Processed {len(responses)} requests in {elapsed:.2f} seconds")
print(f"Throughput: {len(responses)/elapsed:.2f} requests/second")

Sending 1000 concurrent requests...
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:22,378 mnist_classifier_MNISTClassifier p0nprcvx d400f882-7039-41b9-b21b-168be7333200 -- POST / 200 531.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:22,380 mnist_classifier_MNISTClassifier p0nprcvx c6388f54-847d-4a7d-89b0-38d1f01d4ae7 -- POST / 200 522.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:22,382 mnist_classifier_MNISTClassifier p0nprcvx 3bca3daf-a684-4890-a321-b63718a4c257 -- POST / 200 523.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:22,383 mnist_classifier_MNISTClassifier p0nprcvx f03a9515-b37b-4235-9615-d5b376eaac97 -- POST / 200 523.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:22,384 mnist_classifier_MNISTClassifier p0nprcvx dcd5ec87-364e-4bec-b26d-acc63245d4ba -- POST / 200 524.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:22,386 mnist_classifier_MNISTClassifier p0nprcvx 2220c6fe-15ce-4947-a600-ebc2fc93edb4 -- POST / 200 525.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:22,387 mnist_classifier_MNISTClassifier p0nprcvx b6890d3d-fe38-4d4c-b924-49673c1f6138 -- POST / 200 525.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:22,388 mnist_classifier_MNISTClassifier p0nprcvx bce9a161-14d3-4b3a-b448-65e17da116ba -- POST / 200 524.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:22,390 mnist_classifier_MNISTClassifier p0nprcvx ce2af6f0-9765-41fc-b052-397054be7703 -- POST / 200 526.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:22,390 mnist_classifier_MNISTClassifier p0nprcvx 9c811936-7ffe-4c34-b862-be3a67336630 -- POST / 200 525.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:22,391 mnist_classifier_MNISTClassifier p0nprcvx b8b55157-d6ec-4a88-a357-9238b4f0d8b7 -- POST / 200 524.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:22,392 mnist_classifier_MNISTClassifier p0nprcvx cf5fd92b-62a2-4eb1-a5c4-fa5d6b802c1c -- POST / 200 524.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:22,392 mnist_classifier_MNISTClassifier p0nprcvx 57e6cca5-901e-4fac-9cf8-2931d7bebe75 -- POST / 200 522.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:22,393 mnist_classifier_MNISTClassifier p0nprcvx 52d6bc32-fbce-4854-8364-568b7ee24df4 -- POST / 200 520.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:22,393 mnist_classifier_MNISTClassifier p0nprcvx 0ce8d51a-4a68-43e5-9c6b-d051d0826706 -- POST / 200 520.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:22,396 mnist_classifier_MNISTClassifier p0nprcvx af3f5ba4-f169-4bd0-b51f-2cb583b6a126 -- POST / 200 522.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:22,396 mnist_classifier_MNISTClassifier p0nprcvx c91b304b-5762-46f0-9587-96c7480b8c59 -- POST / 200 521.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:22,396 mnist_classifier_MNISTClassifier p0nprcvx 80ffe4b0-c677-45bc-9334-ec6200555e4d -- POST / 200 521.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:22,398 mnist_classifier_MNISTClassifier p0nprcvx 2f42e69c-96fc-4dd4-b649-80b7094127e5 -- POST / 200 522.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:22,530 mnist_classifier_MNISTClassifier p0nprcvx 51545253-862c-46b5-8163-b6555a4aaf5c -- POST / 200 653.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:22,531 mnist_classifier_MNISTClassifier p0nprcvx 3e8d1bc4-1e90-4a3b-a79e-f865cdbccc4c -- POST / 200 652.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:22,531 mnist_classifier_MNISTClassifier p0nprcvx 78ba5253-eb17-49d4-8510-c6622d41355b -- POST / 200 651.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:22,532 mnist_classifier_MNISTClassifier p0nprcvx 52862535-a0ab-49ec-8cbb-58f8a5653885 -- POST / 200 650.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:22,532 mnist_classifier_MNISTClassifier p0nprcvx 8ec5c323-d716-459f-8c42-22cc6c1a8d5f -- POST / 200 651.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:22,533 mnist_classifier_MNISTClassifier p0nprcvx c567155c-8fbc-4b2d-893d-64f0bb431a57 -- POST / 200 650.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:22,533 mnist_classifier_MNISTClassifier p0nprcvx a6b34665-39d8-4975-b7eb-179cc0b49a36 -- POST / 200 648.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:22,534 mnist_classifier_MNISTClassifier p0nprcvx ae0fd072-4787-49dd-b28c-8242113b7bfd -- POST / 200 646.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:22,535 mnist_classifier_MNISTClassifier p0nprcvx 4710351c-dfc6-4e83-8773-e128ab970267 -- POST / 200 646.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:22,535 mnist_classifier_MNISTClassifier p0nprcvx 92e456b4-7148-41d1-9c6d-cfbced3a285a -- POST / 200 646.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:22,536 mnist_classifier_MNISTClassifier p0nprcvx 184617ec-702b-4ee2-b256-31c7724789e5 -- POST / 200 646.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:22,536 mnist_classifier_MNISTClassifier p0nprcvx 56394cb3-d04a-4f09-89f5-2b5a006392e2 -- POST / 200 644.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:22,536 mnist_classifier_MNISTClassifier p0nprcvx 7817faf3-df7f-4d1c-b899-200542a9b738 -- POST / 200 645.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:22,537 mnist_classifier_MNISTClassifier p0nprcvx a05f0dfa-bd89-48de-8ffb-8faa9495ded7 -- POST / 200 642.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:22,537 mnist_classifier_MNISTClassifier p0nprcvx 7f533a51-499f-4812-9f51-7b015564e653 -- POST / 200 642.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:22,539 mnist_classifier_MNISTClassifier p0nprcvx f2b75a70-d94f-4fbe-b009-51ec4a5f4ee6 -- POST / 200 641.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:22,539 mnist_classifier_MNISTClassifier p0nprcvx c82620d8-4d0a-4627-be1f-485b87a53a63 -- POST / 200 641.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:22,540 mnist_classifier_MNISTClassifier p0nprcvx ff91b46e-52c6-4b06-8bc8-55b4d8a0fcac -- POST / 200 642.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:22,540 mnist_classifier_MNISTClassifier p0nprcvx d9a06c69-921d-40ac-adc0-56f7b8bbad4a -- POST / 200 641.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:22,540 mnist_classifier_MNISTClassifier p0nprcvx b350e7f3-56b7-4aa1-81e4-073ed1617181 -- POST / 200 638.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:22,541 mnist_classifier_MNISTClassifier p0nprcvx 7d50ae71-fb87-4f42-a54f-26b5c3ef655f -- POST / 200 638.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:22,541 mnist_classifier_MNISTClassifier p0nprcvx 101425de-0aab-4695-a5ea-f289464609c4 -- POST / 200 638.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:22,542 mnist_classifier_MNISTClassifier p0nprcvx f9b20a6a-b142-4262-8229-4dd8c7403553 -- POST / 200 638.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:22,543 mnist_classifier_MNISTClassifier p0nprcvx 3334f699-7fbc-4686-b7ba-258e05f9f407 -- POST / 200 637.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:22,545 mnist_classifier_MNISTClassifier p0nprcvx ae10b242-09f2-478f-9b55-1ce81c026742 -- POST / 200 638.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:22,545 mnist_classifier_MNISTClassifier p0nprcvx 8ae25385-bb2c-48dc-9314-0157c450c29a -- POST / 200 631.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:22,545 mnist_classifier_MNISTClassifier p0nprcvx 7d1b83ed-acb6-409f-aae1-df4c85743b06 -- POST / 200 638.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:22,545 mnist_classifier_MNISTClassifier p0nprcvx d0ec5174-85de-4b7e-a561-377782be413f -- POST / 200 639.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:22,546 mnist_classifier_MNISTClassifier p0nprcvx e8be4195-b785-4463-9f44-9f1ec015a0c3 -- POST / 200 637.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:22,546 mnist_classifier_MNISTClassifier p0nprcvx 5f68b29e-91fe-4934-b945-d7e4ae6857e4 -- POST / 200 634.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:22,546 mnist_classifier_MNISTClassifier p0nprcvx d4f2f972-155c-42c4-9a41-3858d03e89e5 -- POST / 200 506.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:22,547 mnist_classifier_MNISTClassifier p0nprcvx 41e88038-4917-4899-8a54-af356d482a3b -- POST / 200 504.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:22,547 mnist_classifier_MNISTClassifier p0nprcvx e452e516-c41e-48bf-8536-670ff72cf360 -- POST / 200 503.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:22,547 mnist_classifier_MNISTClassifier p0nprcvx ee6f3c29-1849-4c6a-9ce9-71484fa3c6be -- POST / 200 502.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:22,547 mnist_classifier_MNISTClassifier p0nprcvx 153edcdc-bfce-4113-8677-f5e19df4e9a3 -- POST / 200 503.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:22,548 mnist_classifier_MNISTClassifier p0nprcvx 037ec319-b048-4f70-ba14-d9f518bd4e4c -- POST / 200 500.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:22,548 mnist_classifier_MNISTClassifier p0nprcvx 5fe29875-99b5-4628-a153-f239eebd927d -- POST / 200 499.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:22,548 mnist_classifier_MNISTClassifier p0nprcvx fdc50b0b-8888-42d2-8449-269baf92d375 -- POST / 200 495.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:22,550 mnist_classifier_MNISTClassifier p0nprcvx 4c9fb74d-4ea4-49e4-b143-9becd2c60d9b -- POST / 200 496.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:22,550 mnist_classifier_MNISTClassifier p0nprcvx 4f85d948-5953-43af-b255-34476cae56e6 -- POST / 200 496.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:22,550 mnist_classifier_MNISTClassifier p0nprcvx 7d8ed30b-41b3-4cee-9002-5c33d41bfaa7 -- POST / 200 494.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:22,552 mnist_classifier_MNISTClassifier p0nprcvx dd8836fc-6053-4bde-92a8-1a99eef03999 -- POST / 200 495.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:22,553 mnist_classifier_MNISTClassifier p0nprcvx ca967fc3-0485-43c4-9a74-b031f57a8f4b -- POST / 200 496.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:22,555 mnist_classifier_MNISTClassifier p0nprcvx 613f3180-df75-4d22-a563-13df4c9de8bf -- POST / 200 497.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:22,555 mnist_classifier_MNISTClassifier p0nprcvx 4476f8d0-41be-4411-84c1-4a14019cc3ed -- POST / 200 496.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:22,556 mnist_classifier_MNISTClassifier p0nprcvx 5828b409-2976-4a28-af2f-08d4290de3c3 -- POST / 200 496.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:22,556 mnist_classifier_MNISTClassifier p0nprcvx bd55774a-e65e-46d0-a8b5-7df2dc50bd5d -- POST / 200 495.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:22,557 mnist_classifier_MNISTClassifier p0nprcvx dc8af086-d01a-41f4-9571-f0ed40d6e82f -- POST / 200 494.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:22,557 mnist_classifier_MNISTClassifier p0nprcvx 9e5d4c3a-1751-4ac9-bae5-9d65c7acae13 -- POST / 200 493.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:22,557 mnist_classifier_MNISTClassifier p0nprcvx 0eb31dfd-6782-48b5-a6d9-29451c92ea2c -- POST / 200 493.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:22,558 mnist_classifier_MNISTClassifier p0nprcvx 6e8f8040-b843-402a-a675-60187bb420b9 -- POST / 200 492.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:22,558 mnist_classifier_MNISTClassifier p0nprcvx 57fa45b0-967b-4232-8e3d-133d9f59f388 -- POST / 200 492.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:22,559 mnist_classifier_MNISTClassifier p0nprcvx b954d543-5777-4298-b401-f4589b9250a7 -- POST / 200 491.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:22,559 mnist_classifier_MNISTClassifier p0nprcvx 88d7e31b-183d-459f-86ae-ddfbbdd2e9ad -- POST / 200 491.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:22,559 mnist_classifier_MNISTClassifier p0nprcvx 6ae01734-4567-454a-bdf2-087ab731f9da -- POST / 200 491.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:22,560 mnist_classifier_MNISTClassifier p0nprcvx 9d68ab3d-28b3-4302-98ed-8cb9b21e91f9 -- POST / 200 490.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:22,560 mnist_classifier_MNISTClassifier p0nprcvx 7230109f-5474-4c0c-8e5c-ba96846429d0 -- POST / 200 490.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:22,560 mnist_classifier_MNISTClassifier p0nprcvx 5ba519a2-8b66-42c4-8ed4-836544105c67 -- POST / 200 490.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:22,560 mnist_classifier_MNISTClassifier p0nprcvx 4b7215b4-ab40-4ec0-a205-cf9f3878321b -- POST / 200 489.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:22,561 mnist_classifier_MNISTClassifier p0nprcvx 360926fc-59b5-42c7-9407-b74a9d456c67 -- POST / 200 488.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:22,561 mnist_classifier_MNISTClassifier p0nprcvx c2094e43-ac03-41a9-9043-f4bb1855d503 -- POST / 200 488.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:22,561 mnist_classifier_MNISTClassifier p0nprcvx f8ace7f7-2523-42be-915b-dcc614bedd4d -- POST / 200 486.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:22,561 mnist_classifier_MNISTClassifier p0nprcvx 0b929ffb-0b63-4c57-a97c-e8c1bb4cc4f6 -- POST / 200 484.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:22,562 mnist_classifier_MNISTClassifier p0nprcvx 00642271-bc48-4cc9-bbee-6de1f08f5664 -- POST / 200 487.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:22,562 mnist_classifier_MNISTClassifier p0nprcvx b33538f6-9df0-4514-b8fe-e6107727bec1 -- POST / 200 484.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:22,562 mnist_classifier_MNISTClassifier p0nprcvx 1096477a-d58c-4ca0-91ac-022f6ef8559c -- POST / 200 486.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:22,562 mnist_classifier_MNISTClassifier p0nprcvx 2c7c143e-85e6-4617-99fc-5187ef7a1e4a -- POST / 200 485.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:22,630 mnist_classifier_MNISTClassifier p0nprcvx 71982dd7-68cb-411c-a993-cd24ac2d9b33 -- POST / 200 552.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:22,642 mnist_classifier_MNISTClassifier p0nprcvx 57ab9680-0672-4030-b9d3-1a4f0736ea69 -- POST / 200 564.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:22,645 mnist_classifier_MNISTClassifier p0nprcvx 10cc3eb7-bf7d-420b-9e57-6c44d205e2c9 -- POST / 200 566.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:22,645 mnist_classifier_MNISTClassifier p0nprcvx 32c6c3c5-6d78-4c42-a93b-43a852f39215 -- POST / 200 566.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:22,646 mnist_classifier_MNISTClassifier p0nprcvx 3cec052e-a429-461f-8375-b2148db6314f -- POST / 200 565.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:22,646 mnist_classifier_MNISTClassifier p0nprcvx eefc902c-8a20-4995-afcf-165d37dfa42f -- POST / 200 564.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:22,646 mnist_classifier_MNISTClassifier p0nprcvx d1bd766d-44be-4e55-bb8b-b98bfbed7fce -- POST / 200 564.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:22,649 mnist_classifier_MNISTClassifier p0nprcvx f78549f2-412d-450e-a13a-45825c49f819 -- POST / 200 566.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:22,649 mnist_classifier_MNISTClassifier p0nprcvx 054a09b1-e23a-44d4-93de-3fa6b0852a47 -- POST / 200 566.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:22,649 mnist_classifier_MNISTClassifier p0nprcvx 0bd29959-a699-4726-8713-44e917aa4486 -- POST / 200 565.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:22,650 mnist_classifier_MNISTClassifier p0nprcvx aeb75c1b-d757-41c7-b31a-07fdda8fdf72 -- POST / 200 565.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:22,651 mnist_classifier_MNISTClassifier p0nprcvx 3bac25cd-5f75-4905-9af0-1c9c8997a2c9 -- POST / 200 566.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:22,652 mnist_classifier_MNISTClassifier p0nprcvx 40d36176-eeed-47a8-afc7-328ee8e2cb77 -- POST / 200 565.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:22,652 mnist_classifier_MNISTClassifier p0nprcvx 7c5d7ee0-af66-4ea8-aed7-faa64df86896 -- POST / 200 565.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:22,652 mnist_classifier_MNISTClassifier p0nprcvx cea6e2f2-f4c5-427e-9dc7-9fd8ba13145e -- POST / 200 257.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:22,652 mnist_classifier_MNISTClassifier p0nprcvx bea3d891-6260-4698-9c3d-bbccd216691c -- POST / 200 257.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:22,652 mnist_classifier_MNISTClassifier p0nprcvx 6df81f49-f61f-45fb-acdf-2d6e416d1098 -- POST / 200 257.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:22,653 mnist_classifier_MNISTClassifier p0nprcvx 324867ff-36c1-4f2c-a3e3-c2b47cc1d4b8 -- POST / 200 257.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:22,653 mnist_classifier_MNISTClassifier p0nprcvx bac35d85-8bb6-4e3e-af3b-cb1b3c3a7636 -- POST / 200 257.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:22,653 mnist_classifier_MNISTClassifier p0nprcvx 068b4d2b-344d-4e71-a70d-299f5e54bce8 -- POST / 200 251.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:22,653 mnist_classifier_MNISTClassifier p0nprcvx 07b43238-3031-4628-8b87-343e3c5e7fe5 -- POST / 200 250.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:22,653 mnist_classifier_MNISTClassifier p0nprcvx 0d67d836-edab-4cc7-ab53-dce6a3a576af -- POST / 200 247.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:22,653 mnist_classifier_MNISTClassifier p0nprcvx 60cec3fc-d721-42b1-adba-f9f89f8989a8 -- POST / 200 246.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:22,654 mnist_classifier_MNISTClassifier p0nprcvx 57adf373-d431-4e69-85ba-4ad093276adb -- POST / 200 244.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:22,654 mnist_classifier_MNISTClassifier p0nprcvx a937c6f2-301e-442b-8259-b332a5a3ff06 -- POST / 200 243.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:22,654 mnist_classifier_MNISTClassifier p0nprcvx 721f8278-127e-4519-ba12-18dddedca22b -- POST / 200 243.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:22,654 mnist_classifier_MNISTClassifier p0nprcvx 7b777289-2f5b-4be2-89ba-1e3b3ddba119 -- POST / 200 243.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:22,654 mnist_classifier_MNISTClassifier p0nprcvx 759e7c85-ee47-42f6-8b3b-01942ae40033 -- POST / 200 241.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:22,654 mnist_classifier_MNISTClassifier p0nprcvx a3fde438-1de5-450c-a9d6-a8954acc0829 -- POST / 200 241.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:22,654 mnist_classifier_MNISTClassifier p0nprcvx 56416091-14db-4d96-bace-03b6e74e6035 -- POST / 200 238.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:22,655 mnist_classifier_MNISTClassifier p0nprcvx 0e153548-aa87-42b1-9b13-82601fda1dc8 -- POST / 200 235.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:22,655 mnist_classifier_MNISTClassifier p0nprcvx 17b26827-96c6-4c82-9279-fdd58405691c -- POST / 200 234.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:22,655 mnist_classifier_MNISTClassifier p0nprcvx d2732a73-94c3-4cae-89b0-f6f822714005 -- POST / 200 233.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:22,770 mnist_classifier_MNISTClassifier p0nprcvx 7aee0700-7409-4dcf-8ee1-f58ee08c69cb -- POST / 200 214.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:22,773 mnist_classifier_MNISTClassifier p0nprcvx d5e8a2b7-f8b8-44de-a49c-7e95108bcd66 -- POST / 200 208.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:22,773 mnist_classifier_MNISTClassifier p0nprcvx 6d4fa991-aa78-44a1-838d-ddf830562ff9 -- POST / 200 208.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:22,773 mnist_classifier_MNISTClassifier p0nprcvx 50a85598-c0af-4a7d-9902-6b5b173c328f -- POST / 200 204.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:22,774 mnist_classifier_MNISTClassifier p0nprcvx 28eeeeb1-6eab-41ad-ab21-09fbb47b3574 -- POST / 200 206.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:22,780 mnist_classifier_MNISTClassifier p0nprcvx 892a5ba1-8a12-47b3-a35e-8ec6da776726 -- POST / 200 209.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:22,781 mnist_classifier_MNISTClassifier p0nprcvx 0391019b-6c40-4859-985a-2b686876d7eb -- POST / 200 211.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:22,782 mnist_classifier_MNISTClassifier p0nprcvx 46aaaefe-b21b-4bf0-b43c-ddaff1b416eb -- POST / 200 210.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:22,782 mnist_classifier_MNISTClassifier p0nprcvx 3bece30f-0b22-4ad9-98e5-7d0a5fb19f86 -- POST / 200 210.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:22,789 mnist_classifier_MNISTClassifier p0nprcvx 6e390ace-8d13-42b3-959a-696885c1128e -- POST / 200 216.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:22,790 mnist_classifier_MNISTClassifier p0nprcvx 47aea68f-c916-445e-a5d0-1d6b23a48192 -- POST / 200 217.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:22,791 mnist_classifier_MNISTClassifier p0nprcvx f89678c8-67dc-42e8-b797-995c28e77763 -- POST / 200 218.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:22,792 mnist_classifier_MNISTClassifier p0nprcvx 49a14729-4ea4-4563-bfd2-b079ad45b156 -- POST / 200 215.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:22,923 mnist_classifier_MNISTClassifier p0nprcvx 61088265-b54b-4894-b975-8710b89574c5 -- POST / 200 344.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:22,927 mnist_classifier_MNISTClassifier p0nprcvx b8fbb31e-f625-420c-8194-a4343c034928 -- POST / 200 342.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:22,927 mnist_classifier_MNISTClassifier p0nprcvx 67a15caf-98ed-4890-a577-2469ea1682ed -- POST / 200 341.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:22,928 mnist_classifier_MNISTClassifier p0nprcvx dad55344-cd40-4a82-8d8e-c358e75500eb -- POST / 200 340.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:22,928 mnist_classifier_MNISTClassifier p0nprcvx f944a25a-3835-4bd1-80ce-ae8792ee21b1 -- POST / 200 339.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:22,929 mnist_classifier_MNISTClassifier p0nprcvx a88eedff-0b0c-473b-89ca-3228e19dad02 -- POST / 200 339.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:22,929 mnist_classifier_MNISTClassifier p0nprcvx ee60467b-6d0d-43bf-8bbf-06a097e35870 -- POST / 200 337.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:22,929 mnist_classifier_MNISTClassifier p0nprcvx f44e8313-2f4a-4b58-85c5-2ae695dd3f45 -- POST / 200 336.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:22,930 mnist_classifier_MNISTClassifier p0nprcvx 602640ff-e915-43ca-9071-2fbfc55c255e -- POST / 200 332.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:22,930 mnist_classifier_MNISTClassifier p0nprcvx 9aa696d8-1217-40ef-8526-4a3f80861aed -- POST / 200 326.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:22,931 mnist_classifier_MNISTClassifier p0nprcvx 94b300c4-9e74-4314-a87f-b21cd3b2b0a9 -- POST / 200 325.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:22,931 mnist_classifier_MNISTClassifier p0nprcvx 42a9dac6-dfd8-4cff-b524-202c7335ebb0 -- POST / 200 324.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:22,932 mnist_classifier_MNISTClassifier p0nprcvx 09d5652e-0c3c-4835-bb22-4d0cf85bffc7 -- POST / 200 320.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:22,932 mnist_classifier_MNISTClassifier p0nprcvx 948fa274-6384-4ac2-a52f-242a9d67edd4 -- POST / 200 319.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:22,932 mnist_classifier_MNISTClassifier p0nprcvx 8a9ca431-72f5-4add-8776-bb0e3218cdf4 -- POST / 200 317.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:22,932 mnist_classifier_MNISTClassifier p0nprcvx 0de40d48-a7f2-4dcb-b0ae-5c07cb604f9f -- POST / 200 316.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:22,932 mnist_classifier_MNISTClassifier p0nprcvx 1e41e37d-2ff0-4041-9399-1be374fbff68 -- POST / 200 305.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:22,933 mnist_classifier_MNISTClassifier p0nprcvx e0862895-3cbd-490f-8469-05288b5dbb14 -- POST / 200 303.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:22,934 mnist_classifier_MNISTClassifier p0nprcvx 8c0d446e-2c95-48b3-a95c-c3bf8ee66875 -- POST / 200 277.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:22,934 mnist_classifier_MNISTClassifier p0nprcvx e5d151bd-4ee4-4e83-aa6e-4c2fe77e2a6a -- POST / 200 277.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:22,938 mnist_classifier_MNISTClassifier p0nprcvx e1927cac-59db-4272-93bb-d84520fd407a -- POST / 200 277.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:22,939 mnist_classifier_MNISTClassifier p0nprcvx 293205b2-b203-4232-83b9-af65501934dd -- POST / 200 277.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:22,940 mnist_classifier_MNISTClassifier p0nprcvx 5cfacb0d-835e-4cc6-b798-c521f0d194e7 -- POST / 200 279.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:22,941 mnist_classifier_MNISTClassifier p0nprcvx 2985e3d0-2294-4d5a-8d3f-074e35ec6c5f -- POST / 200 279.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:22,941 mnist_classifier_MNISTClassifier p0nprcvx bb43d84a-4d5d-4b1d-a973-d08195bd9a37 -- POST / 200 269.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:22,942 mnist_classifier_MNISTClassifier p0nprcvx cb8b5cc3-092b-42b1-b120-cf88ce153f00 -- POST / 200 272.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:22,943 mnist_classifier_MNISTClassifier p0nprcvx 9fef8e23-6c3a-46c7-88e9-b19ad328bb85 -- POST / 200 273.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:22,944 mnist_classifier_MNISTClassifier p0nprcvx 8aebdbbd-bd47-4773-bc9d-7b94196508d2 -- POST / 200 273.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:22,944 mnist_classifier_MNISTClassifier p0nprcvx 903634fa-f1e9-45b2-ba51-2d8d9bb3079f -- POST / 200 273.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:22,945 mnist_classifier_MNISTClassifier p0nprcvx 33bf24cf-8903-40ec-883d-c714b9b87b23 -- POST / 200 274.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:22,946 mnist_classifier_MNISTClassifier p0nprcvx 2d3d0ed0-082d-4b9e-adc3-5e20f9802d0c -- POST / 200 273.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:22,953 mnist_classifier_MNISTClassifier p0nprcvx 7785fcdb-3f43-4e14-afb2-1986b1ab74e4 -- POST / 200 278.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:22,953 mnist_classifier_MNISTClassifier p0nprcvx d256e591-6919-49ab-b1c3-3b83dda06750 -- POST / 200 278.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:22,953 mnist_classifier_MNISTClassifier p0nprcvx c9e4e12b-ba27-42be-bd9c-446c7d003278 -- POST / 200 273.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:22,955 mnist_classifier_MNISTClassifier p0nprcvx 12072bf2-4508-4dfb-b758-336ec8204540 -- POST / 200 277.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:22,957 mnist_classifier_MNISTClassifier p0nprcvx de07ebaf-06d6-46be-9c22-abc5aa730e8c -- POST / 200 276.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:22,957 mnist_classifier_MNISTClassifier p0nprcvx 1c6a986c-6bf3-46d4-8621-9cf7e1d92c2b -- POST / 200 279.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:22,957 mnist_classifier_MNISTClassifier p0nprcvx 7f4b6611-98cd-4635-b1b8-fdb8a397e196 -- POST / 200 278.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:22,958 mnist_classifier_MNISTClassifier p0nprcvx ee00cd36-dba5-4592-a282-59358fc34bef -- POST / 200 278.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:22,959 mnist_classifier_MNISTClassifier p0nprcvx 800cedfb-c40e-413c-a02d-214272b19d11 -- POST / 200 278.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:22,959 mnist_classifier_MNISTClassifier p0nprcvx 9d78676e-dd3e-4c07-93b6-28f3334554d3 -- POST / 200 277.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:22,959 mnist_classifier_MNISTClassifier p0nprcvx 34a43f24-4c56-4063-aea4-d81d3be5842d -- POST / 200 276.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:22,960 mnist_classifier_MNISTClassifier p0nprcvx cbc8ff0e-c1f9-4fa4-886f-7389d6c93801 -- POST / 200 276.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:22,960 mnist_classifier_MNISTClassifier p0nprcvx 1e007f1d-6938-465f-beec-083b268d36d6 -- POST / 200 277.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:22,960 mnist_classifier_MNISTClassifier p0nprcvx 0ee29b88-5908-4067-ab47-0300c9381a06 -- POST / 200 275.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:22,960 mnist_classifier_MNISTClassifier p0nprcvx 3a27d4ca-8fb6-4b34-ae20-46df66a1c172 -- POST / 200 272.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:22,960 mnist_classifier_MNISTClassifier p0nprcvx 7e4612c3-3294-4723-8750-226f35669cfe -- POST / 200 272.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:22,960 mnist_classifier_MNISTClassifier p0nprcvx f39c1822-bea3-480d-a88a-22d45797337f -- POST / 200 270.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:22,961 mnist_classifier_MNISTClassifier p0nprcvx 0576dfd6-535d-467c-9e68-1ad35556d2a5 -- POST / 200 268.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:22,961 mnist_classifier_MNISTClassifier p0nprcvx b4420626-93c7-475d-bd4a-adef68a15a9f -- POST / 200 268.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:22,961 mnist_classifier_MNISTClassifier p0nprcvx 0b29edff-2f4b-47f7-9691-c857cc6fd835 -- POST / 200 268.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:22,961 mnist_classifier_MNISTClassifier p0nprcvx d5923396-f9ab-49b0-8415-ebb9542dd0c1 -- POST / 200 267.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:22,961 mnist_classifier_MNISTClassifier p0nprcvx 73aba271-2e5b-4482-9811-99f7fbd880f6 -- POST / 200 268.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:22,961 mnist_classifier_MNISTClassifier p0nprcvx 76ee69a8-66d1-4f27-9114-eea13a96f7ae -- POST / 200 268.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:22,961 mnist_classifier_MNISTClassifier p0nprcvx d8f704b2-93a7-4151-8a4d-f32b8ab49393 -- POST / 200 240.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:22,962 mnist_classifier_MNISTClassifier p0nprcvx 95c77ae8-a821-40ca-bbbc-875007cda465 -- POST / 200 240.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:22,962 mnist_classifier_MNISTClassifier p0nprcvx 05af85b0-671a-482e-9ef3-e8bd72ed13cb -- POST / 200 239.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:22,962 mnist_classifier_MNISTClassifier p0nprcvx 5e525aa1-d8e0-4e6a-b5d1-98f6ac32143a -- POST / 200 238.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:22,962 mnist_classifier_MNISTClassifier p0nprcvx b916c7c6-40c4-4123-a3f5-844c74828d54 -- POST / 200 238.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,192 mnist_classifier_MNISTClassifier p0nprcvx 693bf811-9da1-46e8-ab0b-31345a12402c -- POST / 200 452.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,193 mnist_classifier_MNISTClassifier p0nprcvx dad4bf2c-64ae-45be-8c0b-36adcf8b31c4 -- POST / 200 450.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,193 mnist_classifier_MNISTClassifier p0nprcvx a9c99c9d-1a3a-40ec-9cb2-ba871d7f84d3 -- POST / 200 452.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,195 mnist_classifier_MNISTClassifier p0nprcvx 5cdc00f8-e9d0-4347-bb04-7901bdf975c5 -- POST / 200 451.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,196 mnist_classifier_MNISTClassifier p0nprcvx 178d94ce-c77c-4bec-943d-a5db33ece33a -- POST / 200 454.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,197 mnist_classifier_MNISTClassifier p0nprcvx 6d5c7bdd-80f9-4919-8d4b-b8b4ec68aa20 -- POST / 200 438.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,206 mnist_classifier_MNISTClassifier p0nprcvx 7fc83e10-223f-4e1d-b93d-9e41351aed4e -- POST / 200 445.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,208 mnist_classifier_MNISTClassifier p0nprcvx 2cca978a-0759-4672-9c74-18cee34f7317 -- POST / 200 443.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,210 mnist_classifier_MNISTClassifier p0nprcvx 18117092-4030-46ca-8724-514a0a7e5e39 -- POST / 200 447.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,210 mnist_classifier_MNISTClassifier p0nprcvx 22095579-48e2-49ea-ae24-ebddfaccf0ef -- POST / 200 444.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,210 mnist_classifier_MNISTClassifier p0nprcvx 9b08333b-ac32-4483-86be-daf843f83f48 -- POST / 200 447.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,211 mnist_classifier_MNISTClassifier p0nprcvx 6c4144f0-ced4-4f97-9165-32216ca05c45 -- POST / 200 445.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,211 mnist_classifier_MNISTClassifier p0nprcvx ba2e243e-491d-4c24-ba84-28d53a25a29b -- POST / 200 429.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,211 mnist_classifier_MNISTClassifier p0nprcvx e457855e-21ba-49a7-bd48-7a343376fa8d -- POST / 200 429.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,212 mnist_classifier_MNISTClassifier p0nprcvx 75691a93-c264-4895-9172-82c39121bca1 -- POST / 200 418.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,213 mnist_classifier_MNISTClassifier p0nprcvx 075f143c-92af-40b9-911c-873929a3b4a3 -- POST / 200 415.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,214 mnist_classifier_MNISTClassifier p0nprcvx b2df5af6-912d-4c6c-aaf4-f6a508771436 -- POST / 200 416.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,214 mnist_classifier_MNISTClassifier p0nprcvx 4677ef2f-11d7-4b5b-be80-ede06ab7ec94 -- POST / 200 416.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,214 mnist_classifier_MNISTClassifier p0nprcvx 4e660cab-0aa2-4c24-9985-7269c61b9f00 -- POST / 200 412.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,216 mnist_classifier_MNISTClassifier p0nprcvx 8765263e-3e2e-4911-8f1c-da5ad8f4ae7e -- POST / 200 412.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,216 mnist_classifier_MNISTClassifier p0nprcvx de2ed2ef-5328-4a6d-9a4e-4c32a6bccade -- POST / 200 409.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,216 mnist_classifier_MNISTClassifier p0nprcvx c6fa4d2d-7236-4329-9695-18799391bab7 -- POST / 200 409.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,217 mnist_classifier_MNISTClassifier p0nprcvx fa3456c9-70dc-42d0-acc2-2a468de3ac1b -- POST / 200 408.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,218 mnist_classifier_MNISTClassifier p0nprcvx f3d5ba7a-53d8-4a3a-a2b9-28d589cefc5e -- POST / 200 405.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,218 mnist_classifier_MNISTClassifier p0nprcvx b126b3ca-5418-454e-8134-93a0c212b6b0 -- POST / 200 406.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,219 mnist_classifier_MNISTClassifier p0nprcvx 4c8ddd57-2e98-4d41-8cff-012eceb2cc1b -- POST / 200 406.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,220 mnist_classifier_MNISTClassifier p0nprcvx 7a6769e0-9513-4c15-940a-a3668517685e -- POST / 200 407.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,223 mnist_classifier_MNISTClassifier p0nprcvx 867d8666-e70a-4831-9c98-4f9280b1e78c -- POST / 200 407.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,224 mnist_classifier_MNISTClassifier p0nprcvx 6e637813-f37e-4d24-8bb1-6a716c50fd35 -- POST / 200 410.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,225 mnist_classifier_MNISTClassifier p0nprcvx 39a2c0ef-eb5d-4b74-b03a-ab3867b72058 -- POST / 200 405.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,225 mnist_classifier_MNISTClassifier p0nprcvx 45dd99a3-0b82-471b-87de-193af9da1b39 -- POST / 200 410.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,225 mnist_classifier_MNISTClassifier p0nprcvx 5982dc3c-6dac-4ea2-b33d-c0b3ea5a1568 -- POST / 200 401.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,226 mnist_classifier_MNISTClassifier p0nprcvx 3623c159-6d52-4430-9d11-1e3f6ff8d643 -- POST / 200 399.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,226 mnist_classifier_MNISTClassifier p0nprcvx 3bbec985-5daa-4583-b985-ea215f09b80d -- POST / 200 399.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,226 mnist_classifier_MNISTClassifier p0nprcvx d92ab59c-613d-40dc-a6e0-132aa43010da -- POST / 200 398.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,227 mnist_classifier_MNISTClassifier p0nprcvx 6271f017-8656-4295-957a-ebe3678188c3 -- POST / 200 398.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,227 mnist_classifier_MNISTClassifier p0nprcvx 95e5c323-6ef8-4fd2-8551-9e910778727b -- POST / 200 398.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,227 mnist_classifier_MNISTClassifier p0nprcvx 54efd5ca-d0b1-4ec0-983d-e79a1c21ab05 -- POST / 200 398.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,227 mnist_classifier_MNISTClassifier p0nprcvx 5b9b2e5b-e5b4-4178-b15c-1b1b5a93a80e -- POST / 200 398.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,228 mnist_classifier_MNISTClassifier p0nprcvx 538837f7-73aa-44f6-b8fd-ed8219bf3249 -- POST / 200 397.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,230 mnist_classifier_MNISTClassifier p0nprcvx 3dfee273-3bc9-4ee8-b489-4f127780f601 -- POST / 200 399.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,231 mnist_classifier_MNISTClassifier p0nprcvx 052476d9-64b1-4bd0-a7e2-a0284053b196 -- POST / 200 293.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,231 mnist_classifier_MNISTClassifier p0nprcvx ff5f4e3f-4f9d-4e8b-82ae-3c5c37a5584b -- POST / 200 286.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,232 mnist_classifier_MNISTClassifier p0nprcvx 7811d633-dbb9-491d-bf81-a38baea6fcea -- POST / 200 286.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,232 mnist_classifier_MNISTClassifier p0nprcvx 926bb7e4-e3ff-4ca1-8663-b4e9c931bf61 -- POST / 200 278.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,233 mnist_classifier_MNISTClassifier p0nprcvx 52cc679f-169e-4f0e-9904-e72094030500 -- POST / 200 269.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,372 mnist_classifier_MNISTClassifier p0nprcvx a3c0ca30-6d73-471b-b85b-d2d95f7cd128 -- POST / 200 406.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,389 mnist_classifier_MNISTClassifier p0nprcvx 96e515e9-cdf5-4d96-b0a0-dcc7529d481e -- POST / 200 420.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,389 mnist_classifier_MNISTClassifier p0nprcvx d754cb22-b83a-4f53-9aca-f3272c86bd98 -- POST / 200 420.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,389 mnist_classifier_MNISTClassifier p0nprcvx 9b832e46-0d52-40d7-9c2b-2748ace4cfa0 -- POST / 200 420.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,390 mnist_classifier_MNISTClassifier p0nprcvx 2f46deaf-041e-456a-aa18-b6c95effadb0 -- POST / 200 420.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,391 mnist_classifier_MNISTClassifier p0nprcvx 1e3d3f2c-7d20-43b7-b0e5-d18c763b86ae -- POST / 200 420.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,392 mnist_classifier_MNISTClassifier p0nprcvx 02f0d267-00b8-4751-a33d-575044fd14f1 -- POST / 200 420.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,393 mnist_classifier_MNISTClassifier p0nprcvx d0981f32-f6d2-428c-99b9-2d25ca727cb3 -- POST / 200 420.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,393 mnist_classifier_MNISTClassifier p0nprcvx 8f6b51c5-a2d4-431f-9157-ff1a173580d3 -- POST / 200 419.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,396 mnist_classifier_MNISTClassifier p0nprcvx 080c3fd2-0985-4d64-b02a-7df761259471 -- POST / 200 422.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,397 mnist_classifier_MNISTClassifier p0nprcvx 415f4598-3f4e-4c03-b632-f58a2b14b842 -- POST / 200 420.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,397 mnist_classifier_MNISTClassifier p0nprcvx 4b3655e8-04d9-4e33-8299-9c4c8e7d6b9e -- POST / 200 422.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,397 mnist_classifier_MNISTClassifier p0nprcvx 90a05b95-3a25-4fc4-b765-b289069cd437 -- POST / 200 420.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,397 mnist_classifier_MNISTClassifier p0nprcvx 7cf845d4-7c37-498c-ad59-bcad659cacaa -- POST / 200 420.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,398 mnist_classifier_MNISTClassifier p0nprcvx 4a1a560c-fffc-40bc-b6b9-b67d3baed7aa -- POST / 200 418.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,398 mnist_classifier_MNISTClassifier p0nprcvx d24682a8-ea3e-4332-ad1b-dd0be0136d94 -- POST / 200 419.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,398 mnist_classifier_MNISTClassifier p0nprcvx 652f3323-ce70-4f27-a741-cb4d12e91677 -- POST / 200 417.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,398 mnist_classifier_MNISTClassifier p0nprcvx 9173069d-0114-4415-803d-342f95e7c027 -- POST / 200 414.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,399 mnist_classifier_MNISTClassifier p0nprcvx 7eacf004-7b27-4769-bb8e-17772017bec6 -- POST / 200 413.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,399 mnist_classifier_MNISTClassifier p0nprcvx 1aa3d86d-0ac7-4bee-bcbf-faad05afd32d -- POST / 200 408.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,399 mnist_classifier_MNISTClassifier p0nprcvx ec5a2466-6443-4c1d-9045-16b8d84fcc37 -- POST / 200 402.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,399 mnist_classifier_MNISTClassifier p0nprcvx 401272ba-46cc-4a7e-8952-9fb24a7b027b -- POST / 200 401.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,400 mnist_classifier_MNISTClassifier p0nprcvx e0112715-c785-4fb2-9bab-853f56d3afe1 -- POST / 200 265.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,400 mnist_classifier_MNISTClassifier p0nprcvx 179fd0dd-9809-4280-b525-26dafb46a0aa -- POST / 200 264.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,400 mnist_classifier_MNISTClassifier p0nprcvx 5687eabc-5d81-4403-af73-d94a6c20e775 -- POST / 200 264.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,400 mnist_classifier_MNISTClassifier p0nprcvx 13cd015b-45cc-4466-8dc0-b720a9aa3441 -- POST / 200 263.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,400 mnist_classifier_MNISTClassifier p0nprcvx c068f854-1c66-4608-b908-ae129c517137 -- POST / 200 262.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,401 mnist_classifier_MNISTClassifier p0nprcvx 424607fc-6f76-486a-bb9f-d20fcc0bb8b0 -- POST / 200 259.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,401 mnist_classifier_MNISTClassifier p0nprcvx 9c0e18c0-c75e-4caf-9a22-ecb81965f338 -- POST / 200 261.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,401 mnist_classifier_MNISTClassifier p0nprcvx 5bfbede6-bd7a-43f9-9a5c-15c64529b084 -- POST / 200 260.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,401 mnist_classifier_MNISTClassifier p0nprcvx 237f8d71-d91b-410c-807f-52a92a0202cd -- POST / 200 260.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,401 mnist_classifier_MNISTClassifier p0nprcvx 0f2ca3b1-3523-4a7b-82d6-01bfdc355dbe -- POST / 200 259.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,401 mnist_classifier_MNISTClassifier p0nprcvx d6d387a0-c064-44e2-b14a-c4ca006a9db1 -- POST / 200 259.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,401 mnist_classifier_MNISTClassifier p0nprcvx 6abc9717-aeba-460b-ade8-e70162d3f4cd -- POST / 200 249.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,402 mnist_classifier_MNISTClassifier p0nprcvx 86b3b24f-aaf8-4265-bf53-114fbeec452e -- POST / 200 250.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,403 mnist_classifier_MNISTClassifier p0nprcvx 721abc67-2326-4c9e-ae0a-7f6519e63399 -- POST / 200 260.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,404 mnist_classifier_MNISTClassifier p0nprcvx 9fe522e2-2f54-49e4-ac5c-109c9b6eba5d -- POST / 200 260.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,404 mnist_classifier_MNISTClassifier p0nprcvx 3e8f9912-d2c9-44fd-8d61-d864a6664b1a -- POST / 200 260.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,405 mnist_classifier_MNISTClassifier p0nprcvx 26533da1-5a7c-4636-83d1-b18a5afd884a -- POST / 200 261.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,406 mnist_classifier_MNISTClassifier p0nprcvx 45f4b6ce-6aca-40c6-b1cb-4ff6093243c3 -- POST / 200 261.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,406 mnist_classifier_MNISTClassifier p0nprcvx 6e9c9e17-8721-4f37-84fa-2fc04c744c9e -- POST / 200 260.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,406 mnist_classifier_MNISTClassifier p0nprcvx 69fe6c53-51ab-40ff-930d-94250c5189ff -- POST / 200 261.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,406 mnist_classifier_MNISTClassifier p0nprcvx 87465230-264e-4a60-b44e-baf7219a1b1b -- POST / 200 259.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,407 mnist_classifier_MNISTClassifier p0nprcvx 3f3100cd-f689-488a-91b0-ad385be83664 -- POST / 200 258.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,469 mnist_classifier_MNISTClassifier p0nprcvx 7528013c-9200-4975-815f-c87b3a0803f5 -- POST / 200 320.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,473 mnist_classifier_MNISTClassifier p0nprcvx a513b716-3304-4997-a0f9-8b9c1c95dc85 -- POST / 200 323.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,474 mnist_classifier_MNISTClassifier p0nprcvx a4329fbd-be4b-4860-876a-5fa790d9d30d -- POST / 200 324.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,475 mnist_classifier_MNISTClassifier p0nprcvx 2f4ef765-fc21-4c64-903a-83a21b06fad8 -- POST / 200 323.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,475 mnist_classifier_MNISTClassifier p0nprcvx 51bd170f-325e-43b8-80e9-3e47828787b6 -- POST / 200 320.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,475 mnist_classifier_MNISTClassifier p0nprcvx 208c97d6-702a-4668-9959-64ac26a55d31 -- POST / 200 321.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,475 mnist_classifier_MNISTClassifier p0nprcvx c73a87a3-87ae-4e5d-af1e-80266d3049ca -- POST / 200 320.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,476 mnist_classifier_MNISTClassifier p0nprcvx 9d48e59f-c5fd-4d8e-8bbd-4ccc604e6b7e -- POST / 200 320.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,476 mnist_classifier_MNISTClassifier p0nprcvx d8a6defd-5f82-4f58-b001-988d5b332514 -- POST / 200 320.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,476 mnist_classifier_MNISTClassifier p0nprcvx 8aefa302-85d8-4338-8073-240b8d12be99 -- POST / 200 320.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,477 mnist_classifier_MNISTClassifier p0nprcvx c6be0051-ef28-4c54-acda-f2c70ff41103 -- POST / 200 285.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,477 mnist_classifier_MNISTClassifier p0nprcvx 7568e586-f196-437f-a2b2-14ad1a2f4acf -- POST / 200 244.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,478 mnist_classifier_MNISTClassifier p0nprcvx 98546b73-536d-4041-b546-b66670d675df -- POST / 200 241.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,478 mnist_classifier_MNISTClassifier p0nprcvx a14a9834-ebbb-4fda-8b50-6f276496f0ab -- POST / 200 237.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,479 mnist_classifier_MNISTClassifier p0nprcvx 10d1d3a6-179b-4174-8d9e-9da4e321e7a2 -- POST / 200 237.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,479 mnist_classifier_MNISTClassifier p0nprcvx 14c33afb-5ac8-4478-a48d-8aa3c3b4ac4a -- POST / 200 236.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,479 mnist_classifier_MNISTClassifier p0nprcvx bb43be83-7865-42d1-baea-0920b2f55a24 -- POST / 200 234.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,479 mnist_classifier_MNISTClassifier p0nprcvx 1336e132-3448-4eb2-af3a-2aed3480ce32 -- POST / 200 234.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,480 mnist_classifier_MNISTClassifier p0nprcvx cc990f0c-51ac-460e-b5a9-3ac46f2f4b49 -- POST / 200 234.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,480 mnist_classifier_MNISTClassifier p0nprcvx 239038ec-54db-4b42-8003-5322af4e6a66 -- POST / 200 234.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,480 mnist_classifier_MNISTClassifier p0nprcvx d56c8541-ea58-4258-a582-02397c3f3239 -- POST / 200 234.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,481 mnist_classifier_MNISTClassifier p0nprcvx b25bb86f-9008-482e-8f72-b57ff3a28ab3 -- POST / 200 234.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,481 mnist_classifier_MNISTClassifier p0nprcvx e050bef1-f521-4707-a7f4-616b3b8f00f1 -- POST / 200 234.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,483 mnist_classifier_MNISTClassifier p0nprcvx b95bb7f1-681c-4a61-a561-5c593f7e6d6c -- POST / 200 234.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,484 mnist_classifier_MNISTClassifier p0nprcvx 8513d1c0-a622-4db4-9e61-b460d3522d86 -- POST / 200 235.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,489 mnist_classifier_MNISTClassifier p0nprcvx 1733a3ad-b578-4185-b3fd-02f40f6919e2 -- POST / 200 238.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,490 mnist_classifier_MNISTClassifier p0nprcvx aa9c9959-4e4f-4c50-ade8-21b7424dfd3e -- POST / 200 236.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,490 mnist_classifier_MNISTClassifier p0nprcvx 802eb077-b7ef-4f7e-8857-fded209591e6 -- POST / 200 236.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,492 mnist_classifier_MNISTClassifier p0nprcvx 3a86ae5d-53d9-4450-98e8-87c19e2720ce -- POST / 200 235.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,492 mnist_classifier_MNISTClassifier p0nprcvx ef853eca-4e59-41ab-aa2d-927d2793d3ef -- POST / 200 235.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,495 mnist_classifier_MNISTClassifier p0nprcvx 51561e7d-ca1a-4d9b-94d8-b23c2b843d5b -- POST / 200 236.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,501 mnist_classifier_MNISTClassifier p0nprcvx 361648cb-8e5b-4d57-854d-59c11ad136f5 -- POST / 200 240.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,502 mnist_classifier_MNISTClassifier p0nprcvx 2ba79e38-eb1a-4f6c-a347-428e4e98d52f -- POST / 200 240.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,502 mnist_classifier_MNISTClassifier p0nprcvx 02761df0-d17b-4231-addf-a9731535fa4a -- POST / 200 240.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,502 mnist_classifier_MNISTClassifier p0nprcvx fc30022e-98d5-4cdf-872a-f3d75141c113 -- POST / 200 239.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,503 mnist_classifier_MNISTClassifier p0nprcvx 491197b2-94b9-408d-90d9-a4404ab51d7c -- POST / 200 239.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,503 mnist_classifier_MNISTClassifier p0nprcvx 8cb30814-12f6-4fe2-8f86-3eb037d9c20f -- POST / 200 237.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,503 mnist_classifier_MNISTClassifier p0nprcvx cc25eda3-5c81-4436-ab3b-70dfcced9cd5 -- POST / 200 236.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,504 mnist_classifier_MNISTClassifier p0nprcvx c30cf7eb-ded3-41ca-9460-6387103e9b23 -- POST / 200 236.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,504 mnist_classifier_MNISTClassifier p0nprcvx 1e8cec26-102b-4ce2-bbb1-8bc01c7682f8 -- POST / 200 236.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,504 mnist_classifier_MNISTClassifier p0nprcvx 0a05de54-ccd6-41d9-92a9-553691c7e15c -- POST / 200 236.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,505 mnist_classifier_MNISTClassifier p0nprcvx 0f670a07-1513-4f9f-bb01-7edbe2d98dc3 -- POST / 200 236.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,505 mnist_classifier_MNISTClassifier p0nprcvx bb9be3a5-ba7d-4d7a-9ee0-a8ce39b7a2e0 -- POST / 200 233.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,507 mnist_classifier_MNISTClassifier p0nprcvx 864c7e87-c811-4388-9c1d-a0e9f88e034a -- POST / 200 234.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,508 mnist_classifier_MNISTClassifier p0nprcvx 54c66299-cccd-4a33-b266-ca1485db63e1 -- POST / 200 235.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,508 mnist_classifier_MNISTClassifier p0nprcvx c3509db3-9df0-4605-896d-b767f5728bc9 -- POST / 200 231.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,509 mnist_classifier_MNISTClassifier p0nprcvx daa801fb-ab74-48a9-ac11-363368658e55 -- POST / 200 231.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,511 mnist_classifier_MNISTClassifier p0nprcvx f3010ee4-3aeb-4557-849f-9454d0420c5e -- POST / 200 230.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,511 mnist_classifier_MNISTClassifier p0nprcvx 75b4d7a5-cf6d-4649-9606-158b372f9248 -- POST / 200 229.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,511 mnist_classifier_MNISTClassifier p0nprcvx ead3b41e-97e6-4e57-aa84-3b4bdf61fe1b -- POST / 200 229.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,512 mnist_classifier_MNISTClassifier p0nprcvx fe9e37c3-ac0e-4d1f-936f-c40c4322e6a0 -- POST / 200 221.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,512 mnist_classifier_MNISTClassifier p0nprcvx df6602cc-6c5f-4846-82a6-87274e4b7812 -- POST / 200 220.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,513 mnist_classifier_MNISTClassifier p0nprcvx b8d35bcd-2abb-4872-830a-80af32ba163c -- POST / 200 220.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,516 mnist_classifier_MNISTClassifier p0nprcvx aff8c356-2687-4371-9a29-3450af1c64b6 -- POST / 200 222.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,518 mnist_classifier_MNISTClassifier p0nprcvx f6849a28-6059-43e3-8c4b-ec8782b0504a -- POST / 200 222.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,520 mnist_classifier_MNISTClassifier p0nprcvx a7f88505-d90e-4f96-8780-55311aee8d70 -- POST / 200 223.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,609 mnist_classifier_MNISTClassifier p0nprcvx b22578bb-31d6-43d3-85e7-d89bb6e0e930 -- POST / 200 197.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,626 mnist_classifier_MNISTClassifier p0nprcvx c7ae3c73-1ab9-40ac-99b8-19e2cdf4ad84 -- POST / 200 214.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,626 mnist_classifier_MNISTClassifier p0nprcvx 7e1f8f30-231d-4b9a-bb69-fd68efcef90c -- POST / 200 272.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,626 mnist_classifier_MNISTClassifier p0nprcvx f2725bd3-6058-4807-a38b-dc4b4196f1a8 -- POST / 200 270.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,627 mnist_classifier_MNISTClassifier p0nprcvx 9a6b8c89-eff4-4019-8753-d8e5a414688d -- POST / 200 263.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,628 mnist_classifier_MNISTClassifier p0nprcvx 0a1efc18-e129-4a1e-a802-9db45bae66c5 -- POST / 200 220.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,628 mnist_classifier_MNISTClassifier p0nprcvx fd91468d-071f-48b3-b181-360c3d41e5d9 -- POST / 200 216.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,628 mnist_classifier_MNISTClassifier p0nprcvx a6f901ac-5d3f-42a2-a151-3c2301cf44f0 -- POST / 200 208.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,628 mnist_classifier_MNISTClassifier p0nprcvx dee2543e-de3b-4e72-a1c0-000c3a2fde48 -- POST / 200 206.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,628 mnist_classifier_MNISTClassifier p0nprcvx 00b047ca-6056-4875-8fdc-c7d101b619ab -- POST / 200 207.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,629 mnist_classifier_MNISTClassifier p0nprcvx 2bf99b62-b9f2-4688-aed4-4f2ba01fa8a9 -- POST / 200 217.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,629 mnist_classifier_MNISTClassifier p0nprcvx 5b576b0c-f276-4709-bb76-c25d57c3b979 -- POST / 200 217.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,629 mnist_classifier_MNISTClassifier p0nprcvx 1fe61b44-762c-46e1-a6aa-d1a81d975cce -- POST / 200 216.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,629 mnist_classifier_MNISTClassifier p0nprcvx c79d0453-9523-44b6-9e74-d564038abcac -- POST / 200 210.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,629 mnist_classifier_MNISTClassifier p0nprcvx 93792eea-9a6f-44b1-9e74-97031d2325cb -- POST / 200 206.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,629 mnist_classifier_MNISTClassifier p0nprcvx d635333a-38c9-407f-a7b9-dab5961ca3fe -- POST / 200 205.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,630 mnist_classifier_MNISTClassifier p0nprcvx fd1d3d08-cbf9-45ce-8b1b-7d72ef729335 -- POST / 200 204.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,630 mnist_classifier_MNISTClassifier p0nprcvx d0015ae9-96e5-4335-8e33-730fb2e41a0c -- POST / 200 204.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,630 mnist_classifier_MNISTClassifier p0nprcvx a1aed090-00da-4cb4-8902-ee33912fdec3 -- POST / 200 204.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,778 mnist_classifier_MNISTClassifier p0nprcvx 6459d346-eaf1-455b-998c-73d7571713c9 -- POST / 200 351.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,794 mnist_classifier_MNISTClassifier p0nprcvx 67ee36eb-2a01-43a3-bdbe-4e92bc7a87c9 -- POST / 200 365.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,795 mnist_classifier_MNISTClassifier p0nprcvx 615a5dc2-e2cd-4520-b1c5-6d78721dcc7f -- POST / 200 366.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,795 mnist_classifier_MNISTClassifier p0nprcvx 11b1c2df-3825-4468-ace1-b1b0fa72dada -- POST / 200 365.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,795 mnist_classifier_MNISTClassifier p0nprcvx 9dab7931-561b-4a8f-8100-2d6415ddae55 -- POST / 200 366.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,796 mnist_classifier_MNISTClassifier p0nprcvx 72c3c956-159f-438e-a136-4fc7dd24548f -- POST / 200 366.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,796 mnist_classifier_MNISTClassifier p0nprcvx 1f11763c-f40c-4e55-83d0-3c4ce9f908cb -- POST / 200 366.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,797 mnist_classifier_MNISTClassifier p0nprcvx 59c77309-34d4-4cb6-8192-862521688f03 -- POST / 200 365.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,797 mnist_classifier_MNISTClassifier p0nprcvx 818a9cbc-50b8-45c6-83ed-8983089d11a6 -- POST / 200 365.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,797 mnist_classifier_MNISTClassifier p0nprcvx 958102bb-bedb-4498-a8c9-cac7f06bcae7 -- POST / 200 364.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,798 mnist_classifier_MNISTClassifier p0nprcvx 37b9ec72-6b3b-43b9-9824-aac87fdf8a9c -- POST / 200 353.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,798 mnist_classifier_MNISTClassifier p0nprcvx e42c7b69-63e1-4f4a-b591-2db3f8094005 -- POST / 200 345.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,798 mnist_classifier_MNISTClassifier p0nprcvx 246c6b63-caff-499e-9c9a-bfd6799ff3ad -- POST / 200 344.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,799 mnist_classifier_MNISTClassifier p0nprcvx 6efa9ad9-b23d-44c0-b20a-cd46ce3f14ea -- POST / 200 306.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,799 mnist_classifier_MNISTClassifier p0nprcvx 37f38f9d-e5b7-41b9-842b-67311957e589 -- POST / 200 326.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,800 mnist_classifier_MNISTClassifier p0nprcvx dce0ae62-efce-4d9a-b711-061097482be2 -- POST / 200 308.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,800 mnist_classifier_MNISTClassifier p0nprcvx 6044ba6b-c926-4712-b7c4-02d8b970f0a9 -- POST / 200 334.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,800 mnist_classifier_MNISTClassifier p0nprcvx 758c3d50-e8ac-4775-b1a5-ac372f03d4dc -- POST / 200 333.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,801 mnist_classifier_MNISTClassifier p0nprcvx eb6fad74-3658-414e-af32-d0d06a1c9159 -- POST / 200 332.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,801 mnist_classifier_MNISTClassifier p0nprcvx ba1ea60b-7d5f-4e47-a404-edfd750f3b60 -- POST / 200 328.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,801 mnist_classifier_MNISTClassifier p0nprcvx 35a31f6c-96f0-4c34-932d-b97e2b914d16 -- POST / 200 306.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,802 mnist_classifier_MNISTClassifier p0nprcvx 4c3697a8-0363-4682-828f-343397a382da -- POST / 200 306.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,802 mnist_classifier_MNISTClassifier p0nprcvx 56b2de1c-a95d-4c86-aa67-0c6e17106218 -- POST / 200 300.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,803 mnist_classifier_MNISTClassifier p0nprcvx 4ba3a1ce-25d0-4753-a8eb-fcef67375d56 -- POST / 200 302.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,803 mnist_classifier_MNISTClassifier p0nprcvx f7630f7c-5340-4740-8155-01a2f81a42ff -- POST / 200 300.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,803 mnist_classifier_MNISTClassifier p0nprcvx 49c2d9b3-2535-4b4d-8650-2764035145ed -- POST / 200 254.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,803 mnist_classifier_MNISTClassifier p0nprcvx 022488e9-103e-4e7b-badb-d9dc5e7556e5 -- POST / 200 271.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,804 mnist_classifier_MNISTClassifier p0nprcvx 4f63e9aa-d8bd-4bf4-ad88-afdf0c33bf18 -- POST / 200 270.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,804 mnist_classifier_MNISTClassifier p0nprcvx 519cf4cf-dcd2-4894-a659-2cb6ac34e31a -- POST / 200 270.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,804 mnist_classifier_MNISTClassifier p0nprcvx 7e1ba2e7-03ca-42a4-b5d4-7752380c44b1 -- POST / 200 270.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,805 mnist_classifier_MNISTClassifier p0nprcvx a317bbf6-5485-4eb5-a162-2e200c67a192 -- POST / 200 269.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,805 mnist_classifier_MNISTClassifier p0nprcvx fe4bdfa8-a8f8-45db-bec2-44b421e93c7a -- POST / 200 268.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,805 mnist_classifier_MNISTClassifier p0nprcvx 80f2e9b7-46c7-42c3-8d0c-63d3a1179bba -- POST / 200 268.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,806 mnist_classifier_MNISTClassifier p0nprcvx e1d70e9a-06d0-4935-a8e6-da26b0d3d851 -- POST / 200 269.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,908 mnist_classifier_MNISTClassifier p0nprcvx 2c18afde-a07c-45ea-81d8-69f10c40b7e7 -- POST / 200 365.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,909 mnist_classifier_MNISTClassifier p0nprcvx 05a66f4f-0e10-4521-9ef2-a4823299a42d -- POST / 200 366.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,911 mnist_classifier_MNISTClassifier p0nprcvx fc8e3baf-632e-4937-81ec-93e081203232 -- POST / 200 368.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,911 mnist_classifier_MNISTClassifier p0nprcvx f74effbb-01b2-4fc5-a1ef-6d3a745b4dce -- POST / 200 364.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,913 mnist_classifier_MNISTClassifier p0nprcvx fde95224-79b5-4a95-a330-a302048d3620 -- POST / 200 365.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,914 mnist_classifier_MNISTClassifier p0nprcvx f5895fd2-57d8-4b60-8745-7b46c35bd105 -- POST / 200 366.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,916 mnist_classifier_MNISTClassifier p0nprcvx 8c0c11ad-641b-4703-b28b-e891a1bb92cc -- POST / 200 368.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,918 mnist_classifier_MNISTClassifier p0nprcvx ab8a5962-136f-478e-b611-49a5f8f1f8d9 -- POST / 200 370.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,919 mnist_classifier_MNISTClassifier p0nprcvx 4e6c9b5f-e6f5-4dcb-87f4-8b06ba64ebfd -- POST / 200 371.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,920 mnist_classifier_MNISTClassifier p0nprcvx f828ec9e-bf37-4e77-af9b-800a576d95e4 -- POST / 200 372.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,922 mnist_classifier_MNISTClassifier p0nprcvx 58a04c02-ebb8-4c83-bfe5-8f5bd0258c63 -- POST / 200 368.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,922 mnist_classifier_MNISTClassifier p0nprcvx 2c959c3c-c816-4aec-8608-80407c2e7f9a -- POST / 200 372.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,923 mnist_classifier_MNISTClassifier p0nprcvx b21947fa-0de9-42ef-b461-2ed0bd943665 -- POST / 200 371.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,924 mnist_classifier_MNISTClassifier p0nprcvx 819496af-8169-483a-a739-4d11ab850476 -- POST / 200 371.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,927 mnist_classifier_MNISTClassifier p0nprcvx 86d615c0-fffd-45f2-bd82-53848b20f974 -- POST / 200 370.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,927 mnist_classifier_MNISTClassifier p0nprcvx 8abccfa4-d5d5-40bb-97f0-619167a50814 -- POST / 200 369.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,928 mnist_classifier_MNISTClassifier p0nprcvx 3e85b7ee-9072-4a7f-90ac-8f952ad5e802 -- POST / 200 370.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,929 mnist_classifier_MNISTClassifier p0nprcvx ee5d0870-e523-4cb8-ad11-b0f57cf70a01 -- POST / 200 369.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,931 mnist_classifier_MNISTClassifier p0nprcvx e2fce847-e3bc-42a1-978d-baa75da9ba18 -- POST / 200 370.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,931 mnist_classifier_MNISTClassifier p0nprcvx 1e0a6a26-f045-4627-a257-494cdb002a66 -- POST / 200 363.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,932 mnist_classifier_MNISTClassifier p0nprcvx 709bd812-e1c9-4ea5-ac5f-96dc48195770 -- POST / 200 361.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,933 mnist_classifier_MNISTClassifier p0nprcvx cfcb5cda-5b59-4ea7-aa75-02e30d0bd57b -- POST / 200 357.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,934 mnist_classifier_MNISTClassifier p0nprcvx 7452e67d-be03-416f-bc91-43e53d5350a0 -- POST / 200 349.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,934 mnist_classifier_MNISTClassifier p0nprcvx b8b310bb-e37d-4647-943e-0f55fe79ff64 -- POST / 200 349.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,934 mnist_classifier_MNISTClassifier p0nprcvx 73744434-877d-47cf-99c0-8c49765b06a4 -- POST / 200 349.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,935 mnist_classifier_MNISTClassifier p0nprcvx ebf93618-1027-4e5d-bd19-ae40ff3d0f0d -- POST / 200 346.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,936 mnist_classifier_MNISTClassifier p0nprcvx ad53dd47-97b8-4eea-9ce6-e8000b1caea5 -- POST / 200 346.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,936 mnist_classifier_MNISTClassifier p0nprcvx 4e6764cc-7bfb-4cc0-9591-2e76712cabeb -- POST / 200 345.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,937 mnist_classifier_MNISTClassifier p0nprcvx 00b60646-1df3-4990-8e48-f11ebed5fa46 -- POST / 200 344.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,937 mnist_classifier_MNISTClassifier p0nprcvx dcfcc239-9716-41fb-b140-1765c3bff4e9 -- POST / 200 344.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,938 mnist_classifier_MNISTClassifier p0nprcvx 221b594d-c55d-42db-a664-5e3db9d79454 -- POST / 200 344.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,939 mnist_classifier_MNISTClassifier p0nprcvx 4d8cd4ce-169f-4c79-b09f-ffa57cbf9ad5 -- POST / 200 345.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,940 mnist_classifier_MNISTClassifier p0nprcvx e6bc8a80-243e-4efd-9286-24297081ba14 -- POST / 200 342.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,940 mnist_classifier_MNISTClassifier p0nprcvx f5476dea-484a-4321-9e51-bc587312f217 -- POST / 200 340.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,942 mnist_classifier_MNISTClassifier p0nprcvx ffb260b8-5841-4f41-9ae9-13ecd00254df -- POST / 200 308.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,942 mnist_classifier_MNISTClassifier p0nprcvx 47e556a8-c341-4788-bf12-23c64e21e666 -- POST / 200 308.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,943 mnist_classifier_MNISTClassifier p0nprcvx c8ba8daf-029c-479e-8b96-7e7e83d4dfe4 -- POST / 200 306.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,944 mnist_classifier_MNISTClassifier p0nprcvx a58d05c1-e3f4-465f-9876-c999f1149fa4 -- POST / 200 307.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,945 mnist_classifier_MNISTClassifier p0nprcvx 29c21918-8f0b-4e1f-87e4-eaee79511451 -- POST / 200 307.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,946 mnist_classifier_MNISTClassifier p0nprcvx 31353a0f-065a-4430-af90-e85f4b591ddc -- POST / 200 307.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,946 mnist_classifier_MNISTClassifier p0nprcvx f1c44d45-c101-4f66-9113-f077623bf644 -- POST / 200 308.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,947 mnist_classifier_MNISTClassifier p0nprcvx 5bfcb879-46f3-4e87-a275-d3765a02359d -- POST / 200 307.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,947 mnist_classifier_MNISTClassifier p0nprcvx ece13b98-1277-499e-82b9-2c6d4bf7f832 -- POST / 200 307.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,947 mnist_classifier_MNISTClassifier p0nprcvx b853a27b-5ec0-46c5-8f81-34fe9b1a1b21 -- POST / 200 307.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,948 mnist_classifier_MNISTClassifier p0nprcvx 7b164e39-d9a5-454d-8492-18b107f623d3 -- POST / 200 308.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,948 mnist_classifier_MNISTClassifier p0nprcvx 9832b978-b189-4612-875f-8f960d5542f2 -- POST / 200 308.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,949 mnist_classifier_MNISTClassifier p0nprcvx dd67033f-8a39-465a-a9b3-6f3de24fc4b6 -- POST / 200 309.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,950 mnist_classifier_MNISTClassifier p0nprcvx 45a21ccd-2b9c-4308-bd76-93254cd6fc21 -- POST / 200 283.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,953 mnist_classifier_MNISTClassifier p0nprcvx 094d0429-306f-4a84-adcd-3ae6a029fd71 -- POST / 200 281.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,955 mnist_classifier_MNISTClassifier p0nprcvx 4488ffb3-f0da-4324-a46a-523c753e1ea0 -- POST / 200 281.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,957 mnist_classifier_MNISTClassifier p0nprcvx d2ea2c4e-0f6c-4837-8a8a-568b69499d2b -- POST / 200 276.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,957 mnist_classifier_MNISTClassifier p0nprcvx cef84ea1-9e98-4795-8e06-4015257d3f37 -- POST / 200 276.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,957 mnist_classifier_MNISTClassifier p0nprcvx 353c16c6-3f67-49d8-a7e5-978f1e3e37f3 -- POST / 200 275.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,957 mnist_classifier_MNISTClassifier p0nprcvx 24bf26cd-f349-4b63-b8f6-5d4f9afe32e5 -- POST / 200 275.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,960 mnist_classifier_MNISTClassifier p0nprcvx 361dd62b-51fa-4e05-9776-d5f45a901021 -- POST / 200 276.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,961 mnist_classifier_MNISTClassifier p0nprcvx c39c4c97-53b3-4e38-b640-9e113b3853f7 -- POST / 200 274.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,962 mnist_classifier_MNISTClassifier p0nprcvx 207f236d-664d-4f63-9aa4-47ee465f3c16 -- POST / 200 274.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,962 mnist_classifier_MNISTClassifier p0nprcvx bf985d27-9668-4977-a737-02196761407e -- POST / 200 274.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,963 mnist_classifier_MNISTClassifier p0nprcvx 7cf6f782-5f54-456c-bdbe-00e508c9bedd -- POST / 200 271.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,963 mnist_classifier_MNISTClassifier p0nprcvx 990a3e36-7f53-4f5f-9ecf-90426e0556ff -- POST / 200 268.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,963 mnist_classifier_MNISTClassifier p0nprcvx c0d8c1fd-cd5c-42e6-9596-2d07cb885e34 -- POST / 200 268.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,963 mnist_classifier_MNISTClassifier p0nprcvx df730ec2-227b-4639-bf77-755e44d6a179 -- POST / 200 268.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,963 mnist_classifier_MNISTClassifier p0nprcvx 81a19b8f-2784-4ba7-af74-a4ca3ff51c4d -- POST / 200 268.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,964 mnist_classifier_MNISTClassifier p0nprcvx 740cc348-9b92-4039-810b-f4c60e2403d6 -- POST / 200 268.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,964 mnist_classifier_MNISTClassifier p0nprcvx a3dba302-f5af-4432-b946-cabc6c59b246 -- POST / 200 268.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,964 mnist_classifier_MNISTClassifier p0nprcvx 3867087c-3be4-4c69-bed9-1694412b7439 -- POST / 200 266.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,965 mnist_classifier_MNISTClassifier p0nprcvx ea9eaa44-6e7f-43ba-a6c4-8e05ff1d05b7 -- POST / 200 208.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,965 mnist_classifier_MNISTClassifier p0nprcvx 859dcc30-3371-4ce3-a0e4-75c1253403ae -- POST / 200 201.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,965 mnist_classifier_MNISTClassifier p0nprcvx 02df4163-2ad8-47e9-8a85-aaec1d8154f3 -- POST / 200 199.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,965 mnist_classifier_MNISTClassifier p0nprcvx b54d980c-5cb9-4458-83be-6d4571635721 -- POST / 200 200.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,966 mnist_classifier_MNISTClassifier p0nprcvx 26053a08-5b51-4b77-bd5a-0e126b06cd10 -- POST / 200 197.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,966 mnist_classifier_MNISTClassifier p0nprcvx 8d59e0a6-a337-495f-9777-7037808ff020 -- POST / 200 198.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,966 mnist_classifier_MNISTClassifier p0nprcvx 44c1e88e-0fb1-4363-9b30-c3724f704db1 -- POST / 200 196.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,968 mnist_classifier_MNISTClassifier p0nprcvx 291f8b37-c068-4307-9eae-ef4091c81d0c -- POST / 200 196.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:23,968 mnist_classifier_MNISTClassifier p0nprcvx 05b8d6a9-1f18-4133-b06d-8ab7057e969e -- POST / 200 158.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:24,191 mnist_classifier_MNISTClassifier p0nprcvx 73eba569-fcb5-4c9f-9dac-7bbacb0e45a6 -- POST / 200 376.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:24,192 mnist_classifier_MNISTClassifier p0nprcvx aad651b6-0463-4ad7-9718-b0c85d492d7c -- POST / 200 377.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:24,192 mnist_classifier_MNISTClassifier p0nprcvx 63df9675-88f2-4785-a5a9-c6ec624a6a15 -- POST / 200 376.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:24,193 mnist_classifier_MNISTClassifier p0nprcvx 8f2033c0-46ba-419c-ba85-d19e574bb31a -- POST / 200 376.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:24,193 mnist_classifier_MNISTClassifier p0nprcvx f2f0f69c-b789-4157-994d-52324145a67d -- POST / 200 374.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:24,193 mnist_classifier_MNISTClassifier p0nprcvx 3c0aecde-285f-4226-9cd6-3e0c2df103bb -- POST / 200 374.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:24,194 mnist_classifier_MNISTClassifier p0nprcvx 3e5aa905-a204-49ef-bd81-912d3d27ad0d -- POST / 200 371.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:24,195 mnist_classifier_MNISTClassifier p0nprcvx 4962d253-52f8-49f2-adbe-886ab850e35d -- POST / 200 370.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:24,195 mnist_classifier_MNISTClassifier p0nprcvx e4fdd657-6132-4d47-a783-c6900c2a0e66 -- POST / 200 370.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:24,195 mnist_classifier_MNISTClassifier p0nprcvx 964723ab-04e3-4560-b571-6536bf6fd553 -- POST / 200 369.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:24,196 mnist_classifier_MNISTClassifier p0nprcvx bcf97753-b4bc-4663-9c55-181535d4ef73 -- POST / 200 367.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:24,199 mnist_classifier_MNISTClassifier p0nprcvx 75dc89b1-f9b3-4cdb-a6ba-503d276aa7b8 -- POST / 200 368.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:24,202 mnist_classifier_MNISTClassifier p0nprcvx f6bab50a-3d44-4de5-9ed8-12282d4a6cc8 -- POST / 200 370.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:24,204 mnist_classifier_MNISTClassifier p0nprcvx 7627ed75-890d-4900-87c9-84432831e619 -- POST / 200 371.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:24,207 mnist_classifier_MNISTClassifier p0nprcvx 64749dcb-1923-4b21-ad82-9d489eafb222 -- POST / 200 373.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:24,207 mnist_classifier_MNISTClassifier p0nprcvx 2c83c3d3-b1aa-4721-a3ff-97e4835cb74e -- POST / 200 373.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:24,210 mnist_classifier_MNISTClassifier p0nprcvx e5409e5e-88cc-4c65-8cd9-cc6f2f6a99ee -- POST / 200 376.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:24,212 mnist_classifier_MNISTClassifier p0nprcvx 6e01b367-4bad-4d74-a622-187b70e9e65a -- POST / 200 373.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:24,213 mnist_classifier_MNISTClassifier p0nprcvx 25e8d4a3-928e-43aa-ae9d-f4275952103b -- POST / 200 374.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:24,216 mnist_classifier_MNISTClassifier p0nprcvx 5f7afa4c-1b9a-42da-8997-622607243040 -- POST / 200 375.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:24,216 mnist_classifier_MNISTClassifier p0nprcvx 771d6653-68d0-4e1f-8937-87677f636b29 -- POST / 200 375.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:24,217 mnist_classifier_MNISTClassifier p0nprcvx 9789b1cc-fa75-4387-83c2-cceeaa99c6b3 -- POST / 200 375.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:24,218 mnist_classifier_MNISTClassifier p0nprcvx 3591002e-b8c1-45df-8380-cb1a2bd45e7c -- POST / 200 374.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:24,219 mnist_classifier_MNISTClassifier p0nprcvx bd5c652d-5a1b-4b86-ab57-7a1e4a21ce9d -- POST / 200 375.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:24,224 mnist_classifier_MNISTClassifier p0nprcvx f97f3a79-8850-444b-898e-7c6830c529e3 -- POST / 200 382.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:24,380 mnist_classifier_MNISTClassifier p0nprcvx 3eb23dd8-b133-4703-abd4-08c348f1430f -- POST / 200 479.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:24,380 mnist_classifier_MNISTClassifier p0nprcvx 90827d52-d3d1-4537-ba3e-f22d1b73e1d7 -- POST / 200 461.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:24,381 mnist_classifier_MNISTClassifier p0nprcvx 4cbaa7a0-df93-4ff4-9722-1ffc51043a64 -- POST / 200 451.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:24,381 mnist_classifier_MNISTClassifier p0nprcvx 4b153af8-ed07-427c-bc89-db60a8b32c7d -- POST / 200 447.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:24,382 mnist_classifier_MNISTClassifier p0nprcvx 8c217d98-13c5-44bc-b168-d281e7e2bb28 -- POST / 200 438.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:24,382 mnist_classifier_MNISTClassifier p0nprcvx 5f51a007-8eba-4da2-be17-3e0bc7a75445 -- POST / 200 433.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:24,383 mnist_classifier_MNISTClassifier p0nprcvx 87f27724-b1ac-42e2-849a-bf26d03968f8 -- POST / 200 427.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:24,384 mnist_classifier_MNISTClassifier p0nprcvx f2905692-a3cc-4771-8dc4-4050a84859c0 -- POST / 200 413.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:24,387 mnist_classifier_MNISTClassifier p0nprcvx 013bbdaa-b909-4db9-9a4a-c8bb76d81990 -- POST / 200 411.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:24,388 mnist_classifier_MNISTClassifier p0nprcvx 8a81298d-c1ab-461e-968c-56743d07a155 -- POST / 200 410.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:24,389 mnist_classifier_MNISTClassifier p0nprcvx 465a8e40-d76e-4dd1-8a2a-877e2475ff33 -- POST / 200 412.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:24,389 mnist_classifier_MNISTClassifier p0nprcvx 423edea5-b2dd-4445-9693-9494a8280ce2 -- POST / 200 271.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:24,390 mnist_classifier_MNISTClassifier p0nprcvx 7a963e90-f992-47f1-9931-98ff5b2bcebe -- POST / 200 269.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:24,390 mnist_classifier_MNISTClassifier p0nprcvx 51cc99d5-8601-4751-be90-0d248b5befd8 -- POST / 200 269.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:24,390 mnist_classifier_MNISTClassifier p0nprcvx 27085630-9479-416f-bab4-6ca859a49548 -- POST / 200 269.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:24,390 mnist_classifier_MNISTClassifier p0nprcvx d5b7faec-6129-4def-91da-0c6e463c04e8 -- POST / 200 268.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:24,391 mnist_classifier_MNISTClassifier p0nprcvx 26f2b0b8-8793-4bc4-a784-5b2a76bd6647 -- POST / 200 268.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:24,391 mnist_classifier_MNISTClassifier p0nprcvx c38b5e6b-e8c4-4186-9546-18fbfb96092c -- POST / 200 268.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:24,391 mnist_classifier_MNISTClassifier p0nprcvx 4e224bd7-524e-4214-baf2-febb2883b3f6 -- POST / 200 268.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:24,392 mnist_classifier_MNISTClassifier p0nprcvx 83011e5d-081b-4319-bbd6-6065501f8984 -- POST / 200 267.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:24,392 mnist_classifier_MNISTClassifier p0nprcvx af25db82-fd3b-42ab-a395-9125231b96c5 -- POST / 200 266.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:24,392 mnist_classifier_MNISTClassifier p0nprcvx 107d5d52-55ab-4017-8d92-9755a3a1768e -- POST / 200 266.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:24,394 mnist_classifier_MNISTClassifier p0nprcvx a556d999-693f-4680-937d-cb88b2c1faa3 -- POST / 200 267.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:24,394 mnist_classifier_MNISTClassifier p0nprcvx 868f9adf-ecc3-4fc7-a0df-36e364c9fd26 -- POST / 200 267.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:24,394 mnist_classifier_MNISTClassifier p0nprcvx 6e8adb8d-3cd9-4556-b8b5-146a12802b5c -- POST / 200 266.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:24,395 mnist_classifier_MNISTClassifier p0nprcvx f8b0dcea-9985-4f55-97a6-9ffd4cd561ae -- POST / 200 268.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:24,395 mnist_classifier_MNISTClassifier p0nprcvx 36b2c248-72ca-419f-b3e5-cc51fcfc1405 -- POST / 200 266.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:24,395 mnist_classifier_MNISTClassifier p0nprcvx 04d1e55d-af77-4f7a-8019-6e88a6f5c8d9 -- POST / 200 266.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:24,396 mnist_classifier_MNISTClassifier p0nprcvx e5ae82b8-e57d-4433-933e-bbb77f84b152 -- POST / 200 264.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:24,396 mnist_classifier_MNISTClassifier p0nprcvx bc7768c6-0c91-4c48-a24b-80bcc1d5501f -- POST / 200 264.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:24,397 mnist_classifier_MNISTClassifier p0nprcvx 6ec32e40-42b4-4f25-a491-23ad84376336 -- POST / 200 265.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:24,397 mnist_classifier_MNISTClassifier p0nprcvx 6efb3f92-1077-47bf-b584-f7e11529c1c9 -- POST / 200 264.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:24,398 mnist_classifier_MNISTClassifier p0nprcvx bde3b45b-09a4-4799-9c84-44b338971e35 -- POST / 200 265.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:24,398 mnist_classifier_MNISTClassifier p0nprcvx 04b4b593-8b6e-4a82-8033-8ff992a4e9cb -- POST / 200 265.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:24,399 mnist_classifier_MNISTClassifier p0nprcvx b9b1bde4-d694-4e62-8e96-5427c17a318c -- POST / 200 262.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:24,399 mnist_classifier_MNISTClassifier p0nprcvx 85b7b873-0f38-4f3c-baeb-009319f93d4f -- POST / 200 266.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:24,400 mnist_classifier_MNISTClassifier p0nprcvx 732c4127-bb5f-4169-b2d3-78fe69faede6 -- POST / 200 265.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:24,401 mnist_classifier_MNISTClassifier p0nprcvx d6d14e21-d1c8-40da-a9c5-a85863bfc3e0 -- POST / 200 264.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:24,401 mnist_classifier_MNISTClassifier p0nprcvx 881f8030-8056-4d29-8508-e0e807ebb0a9 -- POST / 200 263.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:24,402 mnist_classifier_MNISTClassifier p0nprcvx df4684d1-6e60-466d-8d88-e4b2b0972652 -- POST / 200 264.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:24,403 mnist_classifier_MNISTClassifier p0nprcvx 12ed8f5a-04f0-4150-a72c-6978b7d5f781 -- POST / 200 265.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:24,404 mnist_classifier_MNISTClassifier p0nprcvx 3fe80989-6ab4-44af-9684-2262dffd9cdf -- POST / 200 264.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:24,405 mnist_classifier_MNISTClassifier p0nprcvx ac19cfdc-e8ab-45f6-abad-83fa73d4a55b -- POST / 200 264.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:24,406 mnist_classifier_MNISTClassifier p0nprcvx 40d3a33d-8bfd-4591-b87e-3488a8b52c0e -- POST / 200 265.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:24,408 mnist_classifier_MNISTClassifier p0nprcvx 61194a03-909b-44fd-8af9-d2cc67dfdc71 -- POST / 200 265.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:24,412 mnist_classifier_MNISTClassifier p0nprcvx 486f2254-f260-46b7-a8f4-2ccd2008a246 -- POST / 200 269.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:24,414 mnist_classifier_MNISTClassifier p0nprcvx 7906423c-a937-4126-9f83-ef0a3a0e9b04 -- POST / 200 270.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:24,415 mnist_classifier_MNISTClassifier p0nprcvx 125d51ba-fcc4-4374-abef-d3a7992fc429 -- POST / 200 269.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:24,415 mnist_classifier_MNISTClassifier p0nprcvx 2778e4d6-2939-4f17-87e4-d0714c56c6c0 -- POST / 200 272.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:24,415 mnist_classifier_MNISTClassifier p0nprcvx 2f3dd136-b522-4cef-89ab-4a429d7a6206 -- POST / 200 269.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:24,417 mnist_classifier_MNISTClassifier p0nprcvx 048963a3-a7bb-4ca4-ba13-1b9e18c9128e -- POST / 200 260.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:24,426 mnist_classifier_MNISTClassifier p0nprcvx aba32c13-6e7c-4d1e-8614-d26ea59a9cbd -- POST / 200 267.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:24,426 mnist_classifier_MNISTClassifier p0nprcvx 871354dc-3b00-42c8-81c6-3609b4ee6b99 -- POST / 200 267.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:24,426 mnist_classifier_MNISTClassifier p0nprcvx 0a8a1888-0d9d-4f0e-b8f5-f95d53d38059 -- POST / 200 266.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:24,427 mnist_classifier_MNISTClassifier p0nprcvx 16829f56-879e-45ab-86e6-524fdcba676e -- POST / 200 203.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:24,427 mnist_classifier_MNISTClassifier p0nprcvx 0f4536ce-d131-46ee-85b8-6f1d15864c55 -- POST / 200 201.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:24,429 mnist_classifier_MNISTClassifier p0nprcvx efcb7de0-92f7-47dc-908e-52bf7261bb27 -- POST / 200 219.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:24,430 mnist_classifier_MNISTClassifier p0nprcvx 54c10b5f-2e4b-49ca-9ce7-7a6e76ce149c -- POST / 200 203.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:24,431 mnist_classifier_MNISTClassifier p0nprcvx d9b2a227-1c28-4dc6-8f0d-b0a0a326f02f -- POST / 200 200.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:24,433 mnist_classifier_MNISTClassifier p0nprcvx 33821a37-f66f-4556-9bee-5f46c392fe26 -- POST / 200 205.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:24,438 mnist_classifier_MNISTClassifier p0nprcvx 49bff18b-0347-48df-9dff-605b5f7b3578 -- POST / 200 206.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:24,438 mnist_classifier_MNISTClassifier p0nprcvx d40b70a0-f47d-4c1f-94cc-a24a444e820c -- POST / 200 208.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:24,438 mnist_classifier_MNISTClassifier p0nprcvx df9217ec-2ba0-4295-9db0-c480bc9f4ed5 -- POST / 200 206.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:24,438 mnist_classifier_MNISTClassifier p0nprcvx 4afccc19-8242-4a63-b513-07fa8cf1df7f -- POST / 200 202.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:24,439 mnist_classifier_MNISTClassifier p0nprcvx 06b9550f-0301-4e0b-95b7-e569ea193fec -- POST / 200 205.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:24,440 mnist_classifier_MNISTClassifier p0nprcvx 73f73e0f-3b62-4b29-a895-2edd84aa577d -- POST / 200 202.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:24,441 mnist_classifier_MNISTClassifier p0nprcvx f64737a1-b1ce-4c7b-9fc9-955480ff35d1 -- POST / 200 206.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:24,441 mnist_classifier_MNISTClassifier p0nprcvx fc7beba5-1584-433f-9fc3-4821b7197ed7 -- POST / 200 204.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:24,442 mnist_classifier_MNISTClassifier p0nprcvx 7c83ed1f-0adf-49fc-81b2-da92d6fecacd -- POST / 200 201.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:24,442 mnist_classifier_MNISTClassifier p0nprcvx dd376491-f0ec-4957-9c4d-3d1a7a166ec4 -- POST / 200 201.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:24,443 mnist_classifier_MNISTClassifier p0nprcvx 889e9e47-c752-4c0d-830d-b1bf28fdd0ff -- POST / 200 202.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:24,444 mnist_classifier_MNISTClassifier p0nprcvx 42237545-a205-4b3b-aa3c-fb5597e3f0fb -- POST / 200 202.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:24,445 mnist_classifier_MNISTClassifier p0nprcvx 8d022d2b-6edb-41a1-9fa6-23486c86ccf9 -- POST / 200 199.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:24,445 mnist_classifier_MNISTClassifier p0nprcvx 4f867448-fe7d-40de-a36f-b3a895174b99 -- POST / 200 200.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:24,447 mnist_classifier_MNISTClassifier p0nprcvx 5c5fbf44-08aa-412e-91b3-3d04bf597d52 -- POST / 200 196.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:24,447 mnist_classifier_MNISTClassifier p0nprcvx ea226521-b8f6-42c3-94f3-bdaca7557597 -- POST / 200 195.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:24,449 mnist_classifier_MNISTClassifier p0nprcvx c4026c1a-2988-43c1-bb3e-75753d7f0ba8 -- POST / 200 196.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:24,449 mnist_classifier_MNISTClassifier p0nprcvx 1deed219-5e5c-4c00-8164-c3a3e441993c -- POST / 200 195.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:24,453 mnist_classifier_MNISTClassifier p0nprcvx fb623e8c-555c-404b-9526-52a0178fa72d -- POST / 200 198.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:24,456 mnist_classifier_MNISTClassifier p0nprcvx 71d6525b-63f3-49a0-b178-1294ae5997c7 -- POST / 200 311.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:24,457 mnist_classifier_MNISTClassifier p0nprcvx 3652c54d-c813-42e1-951c-4baf6b42f9c8 -- POST / 200 310.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:24,457 mnist_classifier_MNISTClassifier p0nprcvx 98a43f0e-e011-4a2d-999a-ee69786c37bb -- POST / 200 310.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:24,457 mnist_classifier_MNISTClassifier p0nprcvx 835f6569-f9c0-4a75-a8f3-0de8cd0076e4 -- POST / 200 311.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:24,458 mnist_classifier_MNISTClassifier p0nprcvx 139b7286-d18a-4935-a3f3-6b065386eb0c -- POST / 200 311.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:24,459 mnist_classifier_MNISTClassifier p0nprcvx 47340f3e-8e2c-4491-8b14-ccc2abb1b47c -- POST / 200 310.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:24,459 mnist_classifier_MNISTClassifier p0nprcvx a7e31678-bb50-45fc-8a28-cb0019c3d24c -- POST / 200 310.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:24,460 mnist_classifier_MNISTClassifier p0nprcvx 609120be-76d5-4524-ae89-96082bd519e4 -- POST / 200 308.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:24,460 mnist_classifier_MNISTClassifier p0nprcvx 0aca6980-129f-4b42-8355-67e186eaa1c0 -- POST / 200 310.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:24,460 mnist_classifier_MNISTClassifier p0nprcvx aef96244-8786-40dc-86f0-2fffc6fd4488 -- POST / 200 308.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:24,460 mnist_classifier_MNISTClassifier p0nprcvx 9300bab0-4d6d-427d-af42-cd39006ae351 -- POST / 200 309.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:24,461 mnist_classifier_MNISTClassifier p0nprcvx d6a67c26-02f2-42f8-89eb-1ef404535487 -- POST / 200 309.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:24,461 mnist_classifier_MNISTClassifier p0nprcvx 47b19fe2-6d34-4cd0-a9ae-389d0dec579a -- POST / 200 309.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:24,461 mnist_classifier_MNISTClassifier p0nprcvx 06612bf9-a039-48ea-ba82-502048262a57 -- POST / 200 308.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:24,461 mnist_classifier_MNISTClassifier p0nprcvx 7f603c3b-4b77-4342-b9f3-ee5ef7da456a -- POST / 200 308.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:24,462 mnist_classifier_MNISTClassifier p0nprcvx 84422664-be8d-43e2-96af-97e5b79e9faf -- POST / 200 306.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:24,462 mnist_classifier_MNISTClassifier p0nprcvx 2a8509aa-c8ee-4541-be09-43ae6d0e7cb8 -- POST / 200 308.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:24,462 mnist_classifier_MNISTClassifier p0nprcvx 7d8fcdc8-5a0a-4930-92b7-ef32f0138582 -- POST / 200 307.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:24,463 mnist_classifier_MNISTClassifier p0nprcvx cf7b5ac0-161a-4815-889d-4c4486094718 -- POST / 200 307.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:24,463 mnist_classifier_MNISTClassifier p0nprcvx 06ebf01c-909d-4313-8213-fc626992444b -- POST / 200 307.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:24,463 mnist_classifier_MNISTClassifier p0nprcvx ee37c420-ff96-421d-b0f4-47a78400299c -- POST / 200 307.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:24,670 mnist_classifier_MNISTClassifier p0nprcvx c1fd388e-cee8-419e-a2c4-ee4063a00d0e -- POST / 200 277.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:24,673 mnist_classifier_MNISTClassifier p0nprcvx 9a1b185a-e0d5-4a3e-a7d9-0e948b324b3e -- POST / 200 256.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:24,673 mnist_classifier_MNISTClassifier p0nprcvx b4d5af3a-35bb-4c76-918f-02b25123f2ec -- POST / 200 209.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:24,673 mnist_classifier_MNISTClassifier p0nprcvx 9a977b06-d5af-4ef8-8a58-e50c67621b3d -- POST / 200 206.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:24,674 mnist_classifier_MNISTClassifier p0nprcvx 8b67f3d7-dc76-4d92-aa84-036ceb48639e -- POST / 200 204.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:24,674 mnist_classifier_MNISTClassifier p0nprcvx 1bbe1ada-6871-4be8-8ded-7e7cc527ffa8 -- POST / 200 204.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:24,675 mnist_classifier_MNISTClassifier p0nprcvx d416da5d-6610-490f-b881-523479a0037a -- POST / 200 204.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:24,675 mnist_classifier_MNISTClassifier p0nprcvx 80b2af0d-93a8-4ef1-8f74-750b1f1dcd03 -- POST / 200 200.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:24,676 mnist_classifier_MNISTClassifier p0nprcvx fa054547-8470-44b3-ad6b-81d9685b0f26 -- POST / 200 201.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:24,676 mnist_classifier_MNISTClassifier p0nprcvx 2ed1cdf7-aca2-4aea-a440-778a8080e9a5 -- POST / 200 204.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:24,677 mnist_classifier_MNISTClassifier p0nprcvx 097cfab1-9f13-4690-92b3-11e24db868ba -- POST / 200 202.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:24,677 mnist_classifier_MNISTClassifier p0nprcvx 61a0eff3-107e-484d-b9f4-8f7c87667a22 -- POST / 200 200.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:24,677 mnist_classifier_MNISTClassifier p0nprcvx 44ac0d41-bda0-4900-9829-5498eabceae5 -- POST / 200 201.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:24,678 mnist_classifier_MNISTClassifier p0nprcvx 4807aa17-b31e-4d93-ab49-d5eb47ebb01e -- POST / 200 199.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:24,679 mnist_classifier_MNISTClassifier p0nprcvx f45bf41e-ddbd-46c8-a512-b5a7bb95bbbb -- POST / 200 200.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:24,679 mnist_classifier_MNISTClassifier p0nprcvx e723e114-43ce-4c93-803e-08479ec2d569 -- POST / 200 202.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:24,680 mnist_classifier_MNISTClassifier p0nprcvx b0345cb8-0b35-4c38-b040-0ab2a4c4a935 -- POST / 200 203.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:24,681 mnist_classifier_MNISTClassifier p0nprcvx b6df1340-6bd6-4683-939f-f88e23904cf1 -- POST / 200 202.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:24,684 mnist_classifier_MNISTClassifier p0nprcvx b62fb0f4-b622-4eb0-bf70-e857b41bcac8 -- POST / 200 204.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:24,685 mnist_classifier_MNISTClassifier p0nprcvx 12856c92-f9f9-48c3-8c11-326fd0e763c7 -- POST / 200 205.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:24,685 mnist_classifier_MNISTClassifier p0nprcvx 050b9967-3920-4757-81af-786888f0a5be -- POST / 200 204.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:24,688 mnist_classifier_MNISTClassifier p0nprcvx d0cdb192-4d9a-4aec-8f60-0830e57487f3 -- POST / 200 205.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:24,694 mnist_classifier_MNISTClassifier p0nprcvx aa8b14c7-b5e7-47b5-89fa-4a586c34a088 -- POST / 200 210.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:24,705 mnist_classifier_MNISTClassifier p0nprcvx d39b78ef-e2e8-4824-be98-53f5b1a2f9e3 -- POST / 200 220.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:24,706 mnist_classifier_MNISTClassifier p0nprcvx f6da1748-c4b4-4f34-aeb1-dd75b7ad53ce -- POST / 200 220.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:24,706 mnist_classifier_MNISTClassifier p0nprcvx a426e9c5-b355-45ff-ba76-0d4b705f7ec0 -- POST / 200 220.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:24,707 mnist_classifier_MNISTClassifier p0nprcvx f4ad376c-7033-403e-ac8c-b5dc4d7fa272 -- POST / 200 219.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:24,931 mnist_classifier_MNISTClassifier p0nprcvx edfa2331-0535-4389-8578-6809f31da792 -- POST / 200 441.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:24,933 mnist_classifier_MNISTClassifier p0nprcvx 00bf5158-2d8a-4071-8161-c37d1165394b -- POST / 200 443.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:24,933 mnist_classifier_MNISTClassifier p0nprcvx e77d972e-3ccb-4605-b637-994d58b240a0 -- POST / 200 443.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:24,935 mnist_classifier_MNISTClassifier p0nprcvx 5e51c9a4-a1ff-4fc1-b113-8e846a4a775a -- POST / 200 444.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:24,941 mnist_classifier_MNISTClassifier p0nprcvx 773a1069-ddd7-434b-b015-5fdca9aa12bd -- POST / 200 447.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:24,943 mnist_classifier_MNISTClassifier p0nprcvx 625dfb1b-d51a-4224-a5ce-29a6d1c60e87 -- POST / 200 446.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:24,944 mnist_classifier_MNISTClassifier p0nprcvx ad88e218-521e-4fe8-931f-98daa388f8c4 -- POST / 200 446.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:24,944 mnist_classifier_MNISTClassifier p0nprcvx 4741cc72-61ed-4b2d-ac71-cdd161fc1e77 -- POST / 200 443.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:24,946 mnist_classifier_MNISTClassifier p0nprcvx 01361433-b3b3-400b-88ab-fcb080fd1d54 -- POST / 200 445.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:24,947 mnist_classifier_MNISTClassifier p0nprcvx 18c8cf16-4e26-452b-8b96-6cdecd82aa33 -- POST / 200 446.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:24,948 mnist_classifier_MNISTClassifier p0nprcvx d855325f-a5ce-4462-a709-fef5b4fcb9b7 -- POST / 200 446.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:24,949 mnist_classifier_MNISTClassifier p0nprcvx 9c7fa732-3661-4565-a86c-5efba0ac0c6e -- POST / 200 447.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:24,950 mnist_classifier_MNISTClassifier p0nprcvx d4ece898-020a-4bb2-9b94-79b262349708 -- POST / 200 447.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:24,951 mnist_classifier_MNISTClassifier p0nprcvx 2c81950c-03f3-47eb-ab0b-8b180aeae884 -- POST / 200 448.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:24,951 mnist_classifier_MNISTClassifier p0nprcvx 023b60a9-423b-4d85-b8a0-925cda727df7 -- POST / 200 448.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:24,951 mnist_classifier_MNISTClassifier p0nprcvx 6366eca5-1f7b-4067-a7a0-c7cde282db2a -- POST / 200 449.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:24,952 mnist_classifier_MNISTClassifier p0nprcvx b2dd8135-4b39-440c-b45b-128cbaae93cb -- POST / 200 448.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:24,952 mnist_classifier_MNISTClassifier p0nprcvx 39161c88-7fcc-4ca6-9589-eec6b8fe597d -- POST / 200 448.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:24,953 mnist_classifier_MNISTClassifier p0nprcvx 9093c3be-c112-4322-95db-e49eba3b91ba -- POST / 200 448.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:24,954 mnist_classifier_MNISTClassifier p0nprcvx 0dcf6848-8437-4af1-94de-e2bde0e05555 -- POST / 200 449.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:24,956 mnist_classifier_MNISTClassifier p0nprcvx e12b7939-08ec-4cb9-bb87-3870bf1aeef3 -- POST / 200 450.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:24,956 mnist_classifier_MNISTClassifier p0nprcvx 55bf2354-82ec-426a-9dd0-0035c074b435 -- POST / 200 448.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:24,956 mnist_classifier_MNISTClassifier p0nprcvx ea8fbca7-ef11-4684-9f8b-5315ad8c3001 -- POST / 200 447.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:24,957 mnist_classifier_MNISTClassifier p0nprcvx 018f2759-8af4-4b9a-a50c-914b05c721a1 -- POST / 200 448.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:24,959 mnist_classifier_MNISTClassifier p0nprcvx 57739fe6-a8aa-40f5-929e-4092c8eb5c9e -- POST / 200 449.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:24,959 mnist_classifier_MNISTClassifier p0nprcvx f62300a4-4c85-4895-8ec0-e189d72fbf6f -- POST / 200 432.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:24,960 mnist_classifier_MNISTClassifier p0nprcvx e08a4d30-371e-4b1d-8c7b-9aabc12ab678 -- POST / 200 433.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:24,968 mnist_classifier_MNISTClassifier p0nprcvx 83336602-53aa-410f-8dad-30d2ed63f490 -- POST / 200 440.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:24,971 mnist_classifier_MNISTClassifier p0nprcvx 464dfdb4-81a2-4c0b-8d81-5f1a3a9afaa9 -- POST / 200 436.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:24,974 mnist_classifier_MNISTClassifier p0nprcvx 4db73059-dd1a-49a4-8370-961028e5c57a -- POST / 200 438.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:24,974 mnist_classifier_MNISTClassifier p0nprcvx 7675de91-d9ac-4892-8837-3cc725be5432 -- POST / 200 437.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:24,975 mnist_classifier_MNISTClassifier p0nprcvx 5c7f5b35-e360-4d8b-869a-5712b4a47a90 -- POST / 200 436.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:24,976 mnist_classifier_MNISTClassifier p0nprcvx 618d6af7-1d5f-4c4f-ad7c-81727d2f5000 -- POST / 200 437.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:24,976 mnist_classifier_MNISTClassifier p0nprcvx 6b9d9fec-8593-45fd-8e15-555441ce0b28 -- POST / 200 436.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:24,977 mnist_classifier_MNISTClassifier p0nprcvx f4313bd0-87a7-4b0e-bbcc-018d3aea5fef -- POST / 200 436.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:24,977 mnist_classifier_MNISTClassifier p0nprcvx 2ebf7738-8793-46d4-80cd-72e973479dc4 -- POST / 200 435.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:24,977 mnist_classifier_MNISTClassifier p0nprcvx 32f660e1-b25f-4fff-bcd4-265e2c06d85e -- POST / 200 433.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:24,979 mnist_classifier_MNISTClassifier p0nprcvx 0c71bf56-3c18-405d-a61b-0799de796523 -- POST / 200 430.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:24,981 mnist_classifier_MNISTClassifier p0nprcvx 33ca29f9-581a-4f63-9aa6-a179aa956b32 -- POST / 200 435.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:24,981 mnist_classifier_MNISTClassifier p0nprcvx 789decf4-c34e-4228-a9f8-b8bcb92a8a52 -- POST / 200 426.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:24,982 mnist_classifier_MNISTClassifier p0nprcvx 5422f9f7-b4f7-4394-ab7d-acfe694f1966 -- POST / 200 434.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:24,982 mnist_classifier_MNISTClassifier p0nprcvx 8727f2cf-2944-4f0d-89b9-3bfbd03b1f45 -- POST / 200 426.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:24,982 mnist_classifier_MNISTClassifier p0nprcvx 2811e866-4462-4f3c-970b-789b2144ac03 -- POST / 200 424.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:24,983 mnist_classifier_MNISTClassifier p0nprcvx 981319b9-698a-4007-9a73-71f58ee3a4a9 -- POST / 200 421.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:24,985 mnist_classifier_MNISTClassifier p0nprcvx 5e7daf44-a574-40ad-acee-cfab549e878b -- POST / 200 427.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:24,987 mnist_classifier_MNISTClassifier p0nprcvx 22801d2b-c99e-42f1-a526-0b6cc2775ff9 -- POST / 200 425.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:24,988 mnist_classifier_MNISTClassifier p0nprcvx 6502bc33-77eb-4295-8fb3-3d9716a3bd13 -- POST / 200 423.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:24,990 mnist_classifier_MNISTClassifier p0nprcvx 5ea05475-24f4-44a6-8841-4f1d0ff7b061 -- POST / 200 429.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:24,990 mnist_classifier_MNISTClassifier p0nprcvx 2c156753-377c-488d-a8e0-679ba20d4da3 -- POST / 200 424.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:24,990 mnist_classifier_MNISTClassifier p0nprcvx ae9852c2-86b9-459a-91f3-6ab57be48b7e -- POST / 200 422.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:24,992 mnist_classifier_MNISTClassifier p0nprcvx 47a09fdd-9f72-4bc4-907b-b004600be664 -- POST / 200 419.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:24,992 mnist_classifier_MNISTClassifier p0nprcvx 69c43d2f-e99e-47d5-af40-475b970cc3f0 -- POST / 200 425.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:24,997 mnist_classifier_MNISTClassifier p0nprcvx 0ffb4598-7a28-4d2b-9571-edea8759960f -- POST / 200 423.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:24,999 mnist_classifier_MNISTClassifier p0nprcvx d85551b7-e24f-4c61-9b43-90938bb8a7a7 -- POST / 200 417.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,001 mnist_classifier_MNISTClassifier p0nprcvx 78f25fb7-deba-4fda-88fb-aade5353c9f8 -- POST / 200 420.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,001 mnist_classifier_MNISTClassifier p0nprcvx f15a6821-5bd4-40e6-b020-5332ce208871 -- POST / 200 418.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,002 mnist_classifier_MNISTClassifier p0nprcvx 1e7fd88f-cde6-4ec8-af66-97308b02d5d4 -- POST / 200 419.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,002 mnist_classifier_MNISTClassifier p0nprcvx 7e7ac63c-a6bc-4779-9cb8-f2432c415fe6 -- POST / 200 416.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,009 mnist_classifier_MNISTClassifier p0nprcvx 36db4d8b-a6c5-4672-995f-2d10a5cb9212 -- POST / 200 421.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,009 mnist_classifier_MNISTClassifier p0nprcvx a6bee463-81a5-48d8-b00b-5e686319c525 -- POST / 200 420.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,010 mnist_classifier_MNISTClassifier p0nprcvx d62b5e86-1564-4341-9f75-8de626b37822 -- POST / 200 416.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,010 mnist_classifier_MNISTClassifier p0nprcvx d7fe3875-eb13-49ce-abcb-f5556fb1ce2f -- POST / 200 415.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,010 mnist_classifier_MNISTClassifier p0nprcvx aa898d80-7628-425d-93a6-e27c3e4f3d56 -- POST / 200 415.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,010 mnist_classifier_MNISTClassifier p0nprcvx 3a345b62-cca8-495d-8198-937c582afa5a -- POST / 200 413.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,010 mnist_classifier_MNISTClassifier p0nprcvx aa9a80ac-66ef-4458-a962-4e90b213d563 -- POST / 200 415.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,011 mnist_classifier_MNISTClassifier p0nprcvx 043ef6f2-dcbc-4d62-98cf-24bbf756f8fd -- POST / 200 411.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,011 mnist_classifier_MNISTClassifier p0nprcvx 086c9fd1-b60e-4988-8ca3-25bc8c15f66b -- POST / 200 413.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,011 mnist_classifier_MNISTClassifier p0nprcvx 24917daa-c0e1-4f31-8650-ca8dfa26320e -- POST / 200 413.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,011 mnist_classifier_MNISTClassifier p0nprcvx a0d75057-a32b-482a-8a33-87985590881d -- POST / 200 411.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,011 mnist_classifier_MNISTClassifier p0nprcvx 25ed58b5-24f0-4791-a728-078d1f047179 -- POST / 200 410.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,011 mnist_classifier_MNISTClassifier p0nprcvx 453a6135-4e8f-4867-be69-246d42a0ea50 -- POST / 200 413.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,012 mnist_classifier_MNISTClassifier p0nprcvx c145467d-5e9a-4b9c-8128-bf61a15feaa3 -- POST / 200 412.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,012 mnist_classifier_MNISTClassifier p0nprcvx 28bd2946-6d6d-4fe1-91ed-f00644959ff9 -- POST / 200 412.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,076 mnist_classifier_MNISTClassifier p0nprcvx 41029b37-b98e-4344-8257-fc04f342758c -- POST / 200 420.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,082 mnist_classifier_MNISTClassifier p0nprcvx 13f0a7ec-ce25-4fb0-b44e-96564f5e4196 -- POST / 200 398.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,086 mnist_classifier_MNISTClassifier p0nprcvx 987bbaa5-ddf2-42a6-a7d0-4ef8b2e8d816 -- POST / 200 374.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,087 mnist_classifier_MNISTClassifier p0nprcvx 10d221a6-46d4-4991-880d-61f61fd936f3 -- POST / 200 375.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,088 mnist_classifier_MNISTClassifier p0nprcvx 6fb5a9ae-4a63-4fd3-8b33-ce9ae209a9b4 -- POST / 200 376.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,092 mnist_classifier_MNISTClassifier p0nprcvx 5a71d5d4-b676-4e99-a293-49de160640eb -- POST / 200 379.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,092 mnist_classifier_MNISTClassifier p0nprcvx ee9c4b2f-f1ca-4af3-9bc5-2123c961c8c4 -- POST / 200 353.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,093 mnist_classifier_MNISTClassifier p0nprcvx 1d518f0f-cf75-4326-9775-12d43d5c3159 -- POST / 200 353.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,093 mnist_classifier_MNISTClassifier p0nprcvx b0a24ace-42b0-4e5c-afc1-3831e05e4c3c -- POST / 200 379.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,093 mnist_classifier_MNISTClassifier p0nprcvx 5ee172ce-8561-4702-827d-446537e2694f -- POST / 200 356.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,093 mnist_classifier_MNISTClassifier p0nprcvx 9e7f8c9f-883a-4780-836f-8b822a80bce9 -- POST / 200 352.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,094 mnist_classifier_MNISTClassifier p0nprcvx df92300b-6305-4218-b23a-5a07b7182915 -- POST / 200 345.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,094 mnist_classifier_MNISTClassifier p0nprcvx c24c56d1-6638-4647-8521-286876fce225 -- POST / 200 351.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,094 mnist_classifier_MNISTClassifier p0nprcvx 95123037-73ba-4b19-9715-899fe3fe6d33 -- POST / 200 352.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,096 mnist_classifier_MNISTClassifier p0nprcvx ea1cac4a-b4f0-4b52-ae2c-9313434f19d5 -- POST / 200 346.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,096 mnist_classifier_MNISTClassifier p0nprcvx 1751d444-e858-45cf-acf8-04d7de457072 -- POST / 200 353.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,098 mnist_classifier_MNISTClassifier p0nprcvx eb05b331-fb2e-432c-9b16-f5ad7e459fa4 -- POST / 200 353.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,098 mnist_classifier_MNISTClassifier p0nprcvx 9589d430-a921-4906-ba19-e154fb4dab2b -- POST / 200 353.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,100 mnist_classifier_MNISTClassifier p0nprcvx c77b293a-7b60-4829-8c2c-63bdc3df7fe4 -- POST / 200 353.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,100 mnist_classifier_MNISTClassifier p0nprcvx 722ad9f8-b438-41ce-a367-cd3908b09339 -- POST / 200 354.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,106 mnist_classifier_MNISTClassifier p0nprcvx cb241576-a818-4842-9857-83b5f3b4afff -- POST / 200 358.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,106 mnist_classifier_MNISTClassifier p0nprcvx 1bc6bf6f-08a0-4379-ae23-e21720fe7db3 -- POST / 200 356.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,107 mnist_classifier_MNISTClassifier p0nprcvx b165a4f5-4f12-4df1-8d01-8ce710ba94f1 -- POST / 200 356.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,107 mnist_classifier_MNISTClassifier p0nprcvx c07f5f9c-91db-4237-89b2-134e35a79be8 -- POST / 200 356.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,112 mnist_classifier_MNISTClassifier p0nprcvx 3e10b07e-ba0b-48ca-89b5-610488fb5e9a -- POST / 200 359.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,112 mnist_classifier_MNISTClassifier p0nprcvx c582e5fe-3a50-49c5-9233-c5706d4a6c1d -- POST / 200 359.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,112 mnist_classifier_MNISTClassifier p0nprcvx e7e193ad-4c9f-4491-9fa4-4f678ef1c9e6 -- POST / 200 359.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,219 mnist_classifier_MNISTClassifier p0nprcvx e016012c-5172-4b48-90fd-be9ea5f60718 -- POST / 200 262.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,221 mnist_classifier_MNISTClassifier p0nprcvx cb144e00-1b3b-407e-9461-b96bcfdd6c1f -- POST / 200 263.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,221 mnist_classifier_MNISTClassifier p0nprcvx f1a1f285-9bec-4f5b-b8c7-c813c5705d6c -- POST / 200 263.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,221 mnist_classifier_MNISTClassifier p0nprcvx 3631954f-a30e-47c8-b1a2-3d6b647b9817 -- POST / 200 250.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,222 mnist_classifier_MNISTClassifier p0nprcvx a0ec8b44-86fa-423f-bcc8-f08eceb3899f -- POST / 200 224.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,223 mnist_classifier_MNISTClassifier p0nprcvx f8494b8a-9e76-4b1c-9fd9-66ddd7353573 -- POST / 200 207.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,224 mnist_classifier_MNISTClassifier p0nprcvx 7ef79d73-d841-4e8b-8b45-e179e4945979 -- POST / 200 208.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,225 mnist_classifier_MNISTClassifier p0nprcvx 54f865da-b009-40a3-8f93-053ab77748c4 -- POST / 200 207.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,227 mnist_classifier_MNISTClassifier p0nprcvx 38882fa6-850f-4fe1-81eb-ddbba4ccef94 -- POST / 200 209.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,230 mnist_classifier_MNISTClassifier p0nprcvx 39d9eb03-bfa7-40eb-990b-ade20ff1e2ff -- POST / 200 211.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,231 mnist_classifier_MNISTClassifier p0nprcvx d33d540d-47e5-45ce-a53c-742b27ded282 -- POST / 200 211.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,232 mnist_classifier_MNISTClassifier p0nprcvx 4b6428c5-c1dd-42c6-83e8-2b480e910504 -- POST / 200 209.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,235 mnist_classifier_MNISTClassifier p0nprcvx a585d60e-daaf-4b35-88a7-0460f7fce6b3 -- POST / 200 208.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,236 mnist_classifier_MNISTClassifier p0nprcvx 9b555d44-2525-4516-b857-26348027459a -- POST / 200 214.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,236 mnist_classifier_MNISTClassifier p0nprcvx 770f70ce-87ab-4d1a-9020-444a6a6589fa -- POST / 200 213.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,237 mnist_classifier_MNISTClassifier p0nprcvx 2dd74141-6b68-4da3-822d-e00231a6817d -- POST / 200 213.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,238 mnist_classifier_MNISTClassifier p0nprcvx c87473f5-44b8-4fd2-b7a3-d82139f1d929 -- POST / 200 213.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,238 mnist_classifier_MNISTClassifier p0nprcvx 1ef6fa1c-03a3-4944-8c4b-64068a743335 -- POST / 200 211.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,252 mnist_classifier_MNISTClassifier p0nprcvx afadf9b1-70f7-47a7-8435-f50e6f013833 -- POST / 200 227.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,254 mnist_classifier_MNISTClassifier p0nprcvx 5ddde6b4-e5da-4857-b029-fb94dee09319 -- POST / 200 225.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,254 mnist_classifier_MNISTClassifier p0nprcvx e5bd342d-1053-42a8-8908-1f8b31db2b74 -- POST / 200 225.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,370 mnist_classifier_MNISTClassifier p0nprcvx 54786f67-e815-4a52-b1e7-193388819634 -- POST / 200 341.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,371 mnist_classifier_MNISTClassifier p0nprcvx 38fd871a-a2ea-46d7-b4d9-8d64275fada3 -- POST / 200 341.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,372 mnist_classifier_MNISTClassifier p0nprcvx 443a3660-23f9-473e-b72e-61a0bc693db7 -- POST / 200 341.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,372 mnist_classifier_MNISTClassifier p0nprcvx c7c5a0ae-ef0d-42c1-920d-6443da27ff1a -- POST / 200 342.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,373 mnist_classifier_MNISTClassifier p0nprcvx b20b09ab-41e3-47cb-840d-22b712e8a325 -- POST / 200 342.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,374 mnist_classifier_MNISTClassifier p0nprcvx 09f0f571-5565-4c1e-81f2-834eafad6794 -- POST / 200 341.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,374 mnist_classifier_MNISTClassifier p0nprcvx 66b98c5f-7e5c-44f2-b217-9eb823a8a08e -- POST / 200 341.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,376 mnist_classifier_MNISTClassifier p0nprcvx 042f7f95-6f43-4e76-bbbb-2f27e2bf27f4 -- POST / 200 339.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,376 mnist_classifier_MNISTClassifier p0nprcvx 9d369d98-1b22-4932-afee-43d95979c530 -- POST / 200 339.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,377 mnist_classifier_MNISTClassifier p0nprcvx c8afcb3b-dd00-4b2a-b8a1-0933efcd7875 -- POST / 200 340.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,377 mnist_classifier_MNISTClassifier p0nprcvx 0a0da255-a1ca-470e-b128-e5def2c2d0ac -- POST / 200 340.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,378 mnist_classifier_MNISTClassifier p0nprcvx f6350e17-8083-4411-a0e2-217179e56baf -- POST / 200 340.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,379 mnist_classifier_MNISTClassifier p0nprcvx d3530f58-6a03-4048-ac65-89836b8def99 -- POST / 200 339.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,381 mnist_classifier_MNISTClassifier p0nprcvx a1c15bbd-fd6c-4cd9-92ff-bfb891fe1d06 -- POST / 200 341.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,382 mnist_classifier_MNISTClassifier p0nprcvx df8cc2c5-2b5d-4665-b87b-088a6fa23fcd -- POST / 200 340.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,382 mnist_classifier_MNISTClassifier p0nprcvx 5f1372a5-6040-4e7f-aa62-1dd76a33d40e -- POST / 200 339.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,382 mnist_classifier_MNISTClassifier p0nprcvx c4e261aa-32f6-4cbd-8971-c0e572bebb84 -- POST / 200 339.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,383 mnist_classifier_MNISTClassifier p0nprcvx 81dfcf85-8ea1-4dbe-8125-a9ee508b9029 -- POST / 200 339.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,383 mnist_classifier_MNISTClassifier p0nprcvx d7a939fa-7ec7-4e7a-8668-dae9746bc9aa -- POST / 200 333.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,383 mnist_classifier_MNISTClassifier p0nprcvx 115e6eba-f561-4c85-9d09-0355a7e2b01e -- POST / 200 333.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,383 mnist_classifier_MNISTClassifier p0nprcvx edfdc3a8-6768-4603-a9fb-30f20b239ea8 -- POST / 200 332.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,384 mnist_classifier_MNISTClassifier p0nprcvx 22349c3b-8f77-45fb-bc7a-4d3071e6295f -- POST / 200 332.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,386 mnist_classifier_MNISTClassifier p0nprcvx 9a9c2a35-9975-4d47-a0e8-f38e6d46e8b9 -- POST / 200 333.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,386 mnist_classifier_MNISTClassifier p0nprcvx 22dea1b9-3e9d-4c62-884a-ce42af0168bb -- POST / 200 322.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,386 mnist_classifier_MNISTClassifier p0nprcvx 5bb098fe-0a31-4a5e-89aa-7ac57f4c1a65 -- POST / 200 332.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,388 mnist_classifier_MNISTClassifier p0nprcvx 5604b977-f84c-4068-a8da-724a2910b16c -- POST / 200 324.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,388 mnist_classifier_MNISTClassifier p0nprcvx add1cfd8-0132-4c63-a957-a6d299d0aef3 -- POST / 200 322.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,389 mnist_classifier_MNISTClassifier p0nprcvx 3df9bc84-1db4-4375-8e77-89d3cbb87390 -- POST / 200 291.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,390 mnist_classifier_MNISTClassifier p0nprcvx 88f6498a-960c-4095-9dc3-dabb33f07fa1 -- POST / 200 304.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,390 mnist_classifier_MNISTClassifier p0nprcvx 765c1efe-58aa-4af1-8f82-dac7f37f850d -- POST / 200 293.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,391 mnist_classifier_MNISTClassifier p0nprcvx 46ad3a58-7c2e-4c97-894b-b49a973de918 -- POST / 200 293.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,392 mnist_classifier_MNISTClassifier p0nprcvx 15384029-7d69-4779-8418-d219c625d9df -- POST / 200 276.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,392 mnist_classifier_MNISTClassifier p0nprcvx 90ed81ad-7c96-4e21-93a1-6c2c23f6bff3 -- POST / 200 274.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,392 mnist_classifier_MNISTClassifier p0nprcvx f0e058ed-ee41-46a9-85c5-e2ec68e54d32 -- POST / 200 273.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,393 mnist_classifier_MNISTClassifier p0nprcvx ea27be68-46c9-473c-93ca-ea9d0f0e55e7 -- POST / 200 271.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,393 mnist_classifier_MNISTClassifier p0nprcvx 12bf4ddc-176b-4108-87f5-9a2b46c86a93 -- POST / 200 271.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,393 mnist_classifier_MNISTClassifier p0nprcvx 0e26bb16-858b-42e5-914a-c27447001dc7 -- POST / 200 271.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,394 mnist_classifier_MNISTClassifier p0nprcvx f05d0c1a-8846-4aa8-b0e4-55fd54870299 -- POST / 200 270.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,395 mnist_classifier_MNISTClassifier p0nprcvx 72c95929-9f61-4cd8-93d4-db54f97731c0 -- POST / 200 271.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,395 mnist_classifier_MNISTClassifier p0nprcvx 1275dd9b-15f1-47e9-9853-7c0844a23f8a -- POST / 200 257.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,395 mnist_classifier_MNISTClassifier p0nprcvx 976419d5-6daa-4bc2-b4de-bfae6bb4f023 -- POST / 200 268.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,396 mnist_classifier_MNISTClassifier p0nprcvx 842eebc1-6eb1-4f54-ad11-3d6e96c7d9dd -- POST / 200 265.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,396 mnist_classifier_MNISTClassifier p0nprcvx 4f206a4c-3d0c-4427-8d00-a194451e1479 -- POST / 200 265.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,396 mnist_classifier_MNISTClassifier p0nprcvx 61b40d75-74aa-4c3e-bc15-b33c4f440f85 -- POST / 200 265.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,397 mnist_classifier_MNISTClassifier p0nprcvx a0b761e3-62e4-434e-abda-a8a5d727b3f1 -- POST / 200 263.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,397 mnist_classifier_MNISTClassifier p0nprcvx 2a23f2d9-7666-4ca2-af11-30b897e1a402 -- POST / 200 261.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,397 mnist_classifier_MNISTClassifier p0nprcvx 43911f2d-4041-4b78-b831-b81d189f9d5d -- POST / 200 261.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,398 mnist_classifier_MNISTClassifier p0nprcvx 0c5c8f50-9d59-4ef4-a310-096b72f47167 -- POST / 200 260.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,398 mnist_classifier_MNISTClassifier p0nprcvx fbb2fcc0-87dc-4d42-a5a5-f328cce83243 -- POST / 200 260.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,398 mnist_classifier_MNISTClassifier p0nprcvx 6f127f3f-ed38-48bd-88b7-8c861cdd9ef5 -- POST / 200 273.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,399 mnist_classifier_MNISTClassifier p0nprcvx 84f0fd4c-9d91-41eb-9ccd-3fc0af880855 -- POST / 200 272.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,401 mnist_classifier_MNISTClassifier p0nprcvx 00bb0b58-f1b7-4873-b8d8-e1139cbea04c -- POST / 200 210.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,410 mnist_classifier_MNISTClassifier p0nprcvx 78d0e89d-348a-432c-a15b-527a4f4a2a7e -- POST / 200 218.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,411 mnist_classifier_MNISTClassifier p0nprcvx 43a5c4fb-3c21-42a5-a819-34240630d2ff -- POST / 200 219.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,412 mnist_classifier_MNISTClassifier p0nprcvx a7fe6511-f5ff-4708-aff1-df1c31faa058 -- POST / 200 274.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,412 mnist_classifier_MNISTClassifier p0nprcvx d3eda116-f796-49fe-9d36-4b4fc63bf15e -- POST / 200 255.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,412 mnist_classifier_MNISTClassifier p0nprcvx e45784c1-0b90-4d4c-8ad7-dd9da70e1d6c -- POST / 200 251.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,413 mnist_classifier_MNISTClassifier p0nprcvx 9774562c-bd5f-4ded-94fc-e8d30e79fdc9 -- POST / 200 251.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,413 mnist_classifier_MNISTClassifier p0nprcvx 1578b3f6-7a4b-465f-9755-91605ab3e7de -- POST / 200 250.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,413 mnist_classifier_MNISTClassifier p0nprcvx d47e0945-980b-4bfa-9819-e68e23c32dba -- POST / 200 249.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,413 mnist_classifier_MNISTClassifier p0nprcvx 76b976c8-f36d-4992-947e-211fe0f92bb4 -- POST / 200 249.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,413 mnist_classifier_MNISTClassifier p0nprcvx 0936ec24-da6f-439b-882a-6f87738190b7 -- POST / 200 248.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,413 mnist_classifier_MNISTClassifier p0nprcvx 7395962d-7788-481c-b73f-18ecdf833b32 -- POST / 200 248.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,414 mnist_classifier_MNISTClassifier p0nprcvx 1357423e-b420-43e5-a2b9-02cd5e95a389 -- POST / 200 237.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,414 mnist_classifier_MNISTClassifier p0nprcvx 69cd81eb-cc0a-4675-9759-ee4070e74a74 -- POST / 200 236.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,414 mnist_classifier_MNISTClassifier p0nprcvx 98e8f539-346e-4d59-84e8-2c4da38ae30a -- POST / 200 235.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,414 mnist_classifier_MNISTClassifier p0nprcvx 683a7c59-4dd6-4370-a7d9-265d696cf4d5 -- POST / 200 225.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,414 mnist_classifier_MNISTClassifier p0nprcvx 9aea7f21-5310-4f2e-a07c-e4ae3c7ee340 -- POST / 200 225.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,414 mnist_classifier_MNISTClassifier p0nprcvx 8f4ca633-9dfc-4b8b-835a-7d28e7851256 -- POST / 200 224.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,414 mnist_classifier_MNISTClassifier p0nprcvx eb4ecce7-d5fb-4065-b4c8-124c1a2ece17 -- POST / 200 224.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,415 mnist_classifier_MNISTClassifier p0nprcvx 66f9eb60-9b29-493e-95ec-51012fe937a8 -- POST / 200 224.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,415 mnist_classifier_MNISTClassifier p0nprcvx 70a9413d-dd0e-4313-944f-2872fed34cf0 -- POST / 200 221.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,417 mnist_classifier_MNISTClassifier p0nprcvx a201babd-0d62-4061-90a4-de730981334b -- POST / 200 223.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,419 mnist_classifier_MNISTClassifier p0nprcvx 86151b35-b2f7-4ca4-a6b5-e8a6afac1114 -- POST / 200 220.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,421 mnist_classifier_MNISTClassifier p0nprcvx 723b1ab2-ff4f-452a-8906-3297fcd010ff -- POST / 200 220.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,421 mnist_classifier_MNISTClassifier p0nprcvx ec5cc834-bead-4cd6-955b-a6a03b467986 -- POST / 200 219.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,424 mnist_classifier_MNISTClassifier p0nprcvx eea0739f-8a91-4020-b25e-41a35766d2ce -- POST / 200 214.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,424 mnist_classifier_MNISTClassifier p0nprcvx 6d793565-9d19-4889-95cf-f82f90a47b22 -- POST / 200 210.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,425 mnist_classifier_MNISTClassifier p0nprcvx b89050a0-a0cb-44a3-a8a2-0157ff6f0573 -- POST / 200 210.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,425 mnist_classifier_MNISTClassifier p0nprcvx 5a1abacc-2bd3-4404-986b-27fc168ab1e4 -- POST / 200 170.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,425 mnist_classifier_MNISTClassifier p0nprcvx 721f2198-de8d-4580-8a44-079eca71b604 -- POST / 200 169.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,426 mnist_classifier_MNISTClassifier p0nprcvx 242116ed-539a-47cc-9d38-11479f09d4ce -- POST / 200 160.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,426 mnist_classifier_MNISTClassifier p0nprcvx 918af9b7-52a0-4309-9a51-84e6a78a2c55 -- POST / 200 158.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,426 mnist_classifier_MNISTClassifier p0nprcvx 2dbef74d-833d-4fb6-90c4-63781d78eb43 -- POST / 200 157.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,426 mnist_classifier_MNISTClassifier p0nprcvx bcfdd1c8-daed-4ee0-800b-f82a385b16d1 -- POST / 200 155.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,426 mnist_classifier_MNISTClassifier p0nprcvx 71bb44d8-6598-455b-a07d-6583162b77cd -- POST / 200 155.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,427 mnist_classifier_MNISTClassifier p0nprcvx 0fb63238-b59e-49f6-ab23-5641ef5bc143 -- POST / 200 154.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,453 mnist_classifier_MNISTClassifier p0nprcvx da9962ac-3c35-4336-914d-af15403fca58 -- POST / 200 175.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,489 mnist_classifier_MNISTClassifier p0nprcvx fc08bc87-316b-4e08-a4de-58e99ea3af97 -- POST / 200 211.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,490 mnist_classifier_MNISTClassifier p0nprcvx 83dc2b26-40d6-41d8-9b61-ba0bf5994ab3 -- POST / 200 217.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,491 mnist_classifier_MNISTClassifier p0nprcvx d000e7e2-06b2-4fb4-b93d-d9b8672ff26b -- POST / 200 218.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,491 mnist_classifier_MNISTClassifier p0nprcvx fa1bca19-a79a-44b2-b58c-98d238dfa8be -- POST / 200 218.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,491 mnist_classifier_MNISTClassifier p0nprcvx 6541abf5-9c74-4693-850d-5c844cd969f2 -- POST / 200 217.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,492 mnist_classifier_MNISTClassifier p0nprcvx 66c67478-7232-4d10-964e-762aadaea208 -- POST / 200 217.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,492 mnist_classifier_MNISTClassifier p0nprcvx acf6e9e3-37c9-4985-8a18-9e1b424cd564 -- POST / 200 216.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,492 mnist_classifier_MNISTClassifier p0nprcvx effc7e5e-596c-4757-a778-18cf74c45b2d -- POST / 200 213.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,492 mnist_classifier_MNISTClassifier p0nprcvx 1450f0a0-d7a4-406b-9db7-8895741b2149 -- POST / 200 212.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,492 mnist_classifier_MNISTClassifier p0nprcvx 8c6cc929-066d-48dc-96ad-1a2e69e65751 -- POST / 200 211.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,493 mnist_classifier_MNISTClassifier p0nprcvx dadc0c7e-7f2a-4959-8311-d8fafeb65dd8 -- POST / 200 211.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,493 mnist_classifier_MNISTClassifier p0nprcvx 2dd2b2b4-06eb-4569-a487-b0e0322a6212 -- POST / 200 211.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,662 mnist_classifier_MNISTClassifier p0nprcvx 68485a54-98b8-4286-913b-8f9959e3cd52 -- POST / 200 283.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,664 mnist_classifier_MNISTClassifier p0nprcvx 2c26ef03-04f9-44bd-b8eb-9ab2b3d66ff2 -- POST / 200 288.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,664 mnist_classifier_MNISTClassifier p0nprcvx 06b2ffd9-e4c4-4266-9e2f-8ce13dbeae19 -- POST / 200 263.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,665 mnist_classifier_MNISTClassifier p0nprcvx cb806a21-c195-486d-976d-c604e8dd31d7 -- POST / 200 229.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,665 mnist_classifier_MNISTClassifier p0nprcvx 2fd21775-364c-4b51-b3c5-ff9bcaa9e9e5 -- POST / 200 263.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,665 mnist_classifier_MNISTClassifier p0nprcvx 6c497035-bfeb-4d9d-8398-15d63563b036 -- POST / 200 226.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,666 mnist_classifier_MNISTClassifier p0nprcvx fe94479d-afff-4e8d-b904-8878b3b037ab -- POST / 200 227.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,666 mnist_classifier_MNISTClassifier p0nprcvx c954499a-5ab8-4120-9392-a6214e6a5e52 -- POST / 200 158.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,668 mnist_classifier_MNISTClassifier p0nprcvx 0b67132c-a74f-4f30-95b2-44dcd82d5f9f -- POST / 200 229.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,670 mnist_classifier_MNISTClassifier p0nprcvx a1c3372a-d66e-4fd6-be1f-2036e2c6eb09 -- POST / 200 162.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,671 mnist_classifier_MNISTClassifier p0nprcvx 47fb8318-060c-46a0-97f4-38cac99e10e2 -- POST / 200 232.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,677 mnist_classifier_MNISTClassifier p0nprcvx c285a316-ffc7-425b-97e9-e64430292a58 -- POST / 200 238.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,678 mnist_classifier_MNISTClassifier p0nprcvx 986009be-fdc9-43ec-b36b-21d7351608d7 -- POST / 200 238.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,679 mnist_classifier_MNISTClassifier p0nprcvx ecaf8240-528b-449b-a90d-3c5833346732 -- POST / 200 239.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,680 mnist_classifier_MNISTClassifier p0nprcvx 5650dad6-da6f-489a-ba0b-b1b9126ecd16 -- POST / 200 238.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,680 mnist_classifier_MNISTClassifier p0nprcvx 1e57b085-c304-4cf8-90b2-6cca8b41848b -- POST / 200 237.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,915 mnist_classifier_MNISTClassifier p0nprcvx 5d258574-e734-4ce1-bca9-7fc753367d7f -- POST / 200 471.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,916 mnist_classifier_MNISTClassifier p0nprcvx 61231790-e3f2-4173-9018-46cfb37c0558 -- POST / 200 420.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,916 mnist_classifier_MNISTClassifier p0nprcvx 1224aa93-c823-46ce-b284-3a3c41668c4f -- POST / 200 419.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,916 mnist_classifier_MNISTClassifier p0nprcvx 130295c5-27e3-41f9-ad91-7cc5ba25646c -- POST / 200 418.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,917 mnist_classifier_MNISTClassifier p0nprcvx 322b25d6-df87-4cf0-80e9-cf1d4cc11f24 -- POST / 200 418.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,918 mnist_classifier_MNISTClassifier p0nprcvx 75ce2fd1-0d85-430a-89a7-6c27a3259c1e -- POST / 200 416.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,918 mnist_classifier_MNISTClassifier p0nprcvx 25a152d4-2f4f-488e-a072-d69eb2684200 -- POST / 200 414.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,921 mnist_classifier_MNISTClassifier p0nprcvx 9abe0006-9cd4-4735-bd39-28abbb993204 -- POST / 200 416.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,922 mnist_classifier_MNISTClassifier p0nprcvx 1d5956d5-5492-4684-b348-7625d3eadb38 -- POST / 200 417.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,922 mnist_classifier_MNISTClassifier p0nprcvx 97817654-17aa-40af-b223-66784c606d27 -- POST / 200 417.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,922 mnist_classifier_MNISTClassifier p0nprcvx 4da84b43-eb2b-4441-add7-1f78fe6f3497 -- POST / 200 417.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,923 mnist_classifier_MNISTClassifier p0nprcvx c94d5acb-1691-49a9-b558-17280a6a10e6 -- POST / 200 417.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,923 mnist_classifier_MNISTClassifier p0nprcvx 2ea94f85-7f6b-436b-8f23-cb525fe0c132 -- POST / 200 417.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,923 mnist_classifier_MNISTClassifier p0nprcvx 85c005be-bd7c-4e1f-b9d1-2b321a382e41 -- POST / 200 418.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,923 mnist_classifier_MNISTClassifier p0nprcvx 875d6a17-63ed-41e4-9600-2d6389701d8b -- POST / 200 417.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,924 mnist_classifier_MNISTClassifier p0nprcvx c215bf45-dabb-4e77-8b9a-1a420507df10 -- POST / 200 417.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,924 mnist_classifier_MNISTClassifier p0nprcvx 940da66b-3a46-46bc-b6a1-f0fecf46c2d4 -- POST / 200 417.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,924 mnist_classifier_MNISTClassifier p0nprcvx 0f82ff89-fe03-44dd-bf15-85b8d42bda8a -- POST / 200 417.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,924 mnist_classifier_MNISTClassifier p0nprcvx 332139f1-0c87-4f7e-8795-5144e1c923d3 -- POST / 200 417.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,925 mnist_classifier_MNISTClassifier p0nprcvx 658bc856-b357-4fab-a081-f2471dcf417c -- POST / 200 417.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,925 mnist_classifier_MNISTClassifier p0nprcvx b010e670-b161-45e3-931c-8d7963e592b2 -- POST / 200 417.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,925 mnist_classifier_MNISTClassifier p0nprcvx e3fa8292-4fe4-4361-a22f-c41871ccf4b5 -- POST / 200 417.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,925 mnist_classifier_MNISTClassifier p0nprcvx d6552fc0-b9d8-4a72-b3ee-258c406cd1a3 -- POST / 200 417.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,926 mnist_classifier_MNISTClassifier p0nprcvx 1ac2f2af-56eb-450e-9564-38ea66e97397 -- POST / 200 417.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,927 mnist_classifier_MNISTClassifier p0nprcvx cf4539ec-b6ed-4ba5-a921-78a465c0c919 -- POST / 200 418.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,927 mnist_classifier_MNISTClassifier p0nprcvx abef795e-4d56-40a3-b488-54c2530792ca -- POST / 200 414.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,928 mnist_classifier_MNISTClassifier p0nprcvx 060f8fb8-fccf-4698-8bba-5fc508eacc41 -- POST / 200 418.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,929 mnist_classifier_MNISTClassifier p0nprcvx 06f6c317-ecd1-4a25-b430-b3d615913f89 -- POST / 200 417.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,930 mnist_classifier_MNISTClassifier p0nprcvx 66706e4f-fba0-4bdd-925d-5801ca9da2be -- POST / 200 416.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,930 mnist_classifier_MNISTClassifier p0nprcvx a594e897-5e6b-41ea-b296-2d4d14f7e3e3 -- POST / 200 416.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,930 mnist_classifier_MNISTClassifier p0nprcvx 5ee66fa3-01bb-4d6a-a2ee-ef3c798aa4b1 -- POST / 200 416.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,931 mnist_classifier_MNISTClassifier p0nprcvx c9ac2a53-7c41-415c-9d1f-88e3b9c1eff0 -- POST / 200 415.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,931 mnist_classifier_MNISTClassifier p0nprcvx 0b00237a-07ca-4402-b5f1-160bbeff9e09 -- POST / 200 415.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,932 mnist_classifier_MNISTClassifier p0nprcvx fbd94f40-8f4a-47d8-81b4-87a8288fa58b -- POST / 200 413.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,932 mnist_classifier_MNISTClassifier p0nprcvx 49016be8-1fa8-4709-a1c1-bd3c2a3b73fe -- POST / 200 413.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,932 mnist_classifier_MNISTClassifier p0nprcvx ec0b8efe-6fa2-4166-bb53-d4bb8b9e0504 -- POST / 200 412.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,933 mnist_classifier_MNISTClassifier p0nprcvx f9ea24b7-883f-4fb5-ae91-55f78c44af66 -- POST / 200 408.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,933 mnist_classifier_MNISTClassifier p0nprcvx 9b00a2ff-c9b6-4d48-b56b-15c9d857c1b2 -- POST / 200 412.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,934 mnist_classifier_MNISTClassifier p0nprcvx f6afa810-65bb-49f3-956b-c08dbde9e705 -- POST / 200 408.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,936 mnist_classifier_MNISTClassifier p0nprcvx db98f045-b81c-4d69-8f8f-9999a380d960 -- POST / 200 414.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,937 mnist_classifier_MNISTClassifier p0nprcvx 7c0a76d7-18ac-4701-85cb-fcd36c11703d -- POST / 200 409.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,937 mnist_classifier_MNISTClassifier p0nprcvx 8aee81ce-3bef-49e6-856b-c2cb5a692044 -- POST / 200 408.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,937 mnist_classifier_MNISTClassifier p0nprcvx 5216d9eb-3744-4052-b45b-b41dcd86b8de -- POST / 200 408.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,938 mnist_classifier_MNISTClassifier p0nprcvx 8b9a75b8-18bf-4a48-bd4a-934e665c35da -- POST / 200 408.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,938 mnist_classifier_MNISTClassifier p0nprcvx 6b91ec38-96b2-4029-b020-664289ca52e1 -- POST / 200 407.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,941 mnist_classifier_MNISTClassifier p0nprcvx 3b790ae5-f4b9-4267-9eca-9a7ee5a3efbc -- POST / 200 409.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,941 mnist_classifier_MNISTClassifier p0nprcvx ec76a4b0-001c-42f4-87c2-76d942c7b6bf -- POST / 200 404.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,945 mnist_classifier_MNISTClassifier p0nprcvx 80c71b03-ecba-472a-899a-0992d4d95875 -- POST / 200 407.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,945 mnist_classifier_MNISTClassifier p0nprcvx cc744401-b3f7-41c3-b552-d9891cacce78 -- POST / 200 406.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,946 mnist_classifier_MNISTClassifier p0nprcvx c359c389-239e-46aa-952b-e51b2b9f3de1 -- POST / 200 405.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,950 mnist_classifier_MNISTClassifier p0nprcvx 6bbe5595-a7f7-4099-a1ca-e1d8d93a5a5d -- POST / 200 409.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,951 mnist_classifier_MNISTClassifier p0nprcvx 6b463bf8-6ad7-48df-9a46-efbaccb33e47 -- POST / 200 409.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,951 mnist_classifier_MNISTClassifier p0nprcvx ee9af543-48da-4b31-b71a-b0db1bbad01b -- POST / 200 409.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,952 mnist_classifier_MNISTClassifier p0nprcvx 630261c3-314f-42af-ba1e-a6611478b4b4 -- POST / 200 410.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,954 mnist_classifier_MNISTClassifier p0nprcvx 4bb601fc-3a3f-49db-99e6-e218406c1373 -- POST / 200 352.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,960 mnist_classifier_MNISTClassifier p0nprcvx caf48496-82ef-4276-b83d-2b2be3065835 -- POST / 200 358.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,960 mnist_classifier_MNISTClassifier p0nprcvx cecd8c7f-9ffb-4735-803c-b1a3438277c5 -- POST / 200 358.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,960 mnist_classifier_MNISTClassifier p0nprcvx 2e08ab44-458b-44ef-9f2c-7f2de3c9a4f5 -- POST / 200 358.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,961 mnist_classifier_MNISTClassifier p0nprcvx 763e9f2c-0eaa-411f-9bd2-331a3a011eba -- POST / 200 355.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,961 mnist_classifier_MNISTClassifier p0nprcvx ecf52dac-feff-4013-ae72-bf08b510f34c -- POST / 200 354.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,961 mnist_classifier_MNISTClassifier p0nprcvx faa8734a-adc0-4394-9ff6-79582e69d4b8 -- POST / 200 349.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,961 mnist_classifier_MNISTClassifier p0nprcvx e0272bbb-f614-4032-a22d-41a2a97222ed -- POST / 200 348.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,961 mnist_classifier_MNISTClassifier p0nprcvx 8720389d-5ee7-401c-9819-f36da3046428 -- POST / 200 345.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,961 mnist_classifier_MNISTClassifier p0nprcvx f42e5d09-66ca-4084-804f-5872c5524408 -- POST / 200 345.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,961 mnist_classifier_MNISTClassifier p0nprcvx 84116f3f-4bf8-4751-bc50-a963df79870f -- POST / 200 343.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,962 mnist_classifier_MNISTClassifier p0nprcvx 9f10f82b-9d6e-4813-9c48-887820ae0425 -- POST / 200 341.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,962 mnist_classifier_MNISTClassifier p0nprcvx 12ba26e6-c619-4281-9165-015c5e343c1b -- POST / 200 341.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,962 mnist_classifier_MNISTClassifier p0nprcvx b7ce427c-cdbf-40aa-bcd1-2bfe998add20 -- POST / 200 340.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,962 mnist_classifier_MNISTClassifier p0nprcvx 3582afc8-4ffa-4fa3-84e1-2f9f3911e894 -- POST / 200 339.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,963 mnist_classifier_MNISTClassifier p0nprcvx aa0f5d8b-a5ce-4881-8300-ff33e9a67e3d -- POST / 200 421.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,964 mnist_classifier_MNISTClassifier p0nprcvx 701ef771-422a-451f-a12a-a4e0a3c05f58 -- POST / 200 420.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,964 mnist_classifier_MNISTClassifier p0nprcvx d64d9f18-0a57-434a-80cc-0d3f9a9f229b -- POST / 200 420.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,965 mnist_classifier_MNISTClassifier p0nprcvx d7d7bf28-1b10-4c2d-a99a-d349fe3ff119 -- POST / 200 420.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,965 mnist_classifier_MNISTClassifier p0nprcvx b7f2d93d-89d6-44f5-8764-bd148aa5ff0c -- POST / 200 382.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,965 mnist_classifier_MNISTClassifier p0nprcvx 2246a235-13f1-4c32-bc5f-2b23fe94dc3c -- POST / 200 385.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,966 mnist_classifier_MNISTClassifier p0nprcvx 92c3313e-0c72-4f0e-8c0c-1e7b0b159e85 -- POST / 200 381.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,966 mnist_classifier_MNISTClassifier p0nprcvx 290b1de8-22c0-418a-a4ac-1e6438292c47 -- POST / 200 380.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,967 mnist_classifier_MNISTClassifier p0nprcvx 8a88f980-43f3-4a59-9492-b0751f954ae4 -- POST / 200 369.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,967 mnist_classifier_MNISTClassifier p0nprcvx 6bb19b00-6c00-4e3b-89b3-7200c0164425 -- POST / 200 366.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:25,967 mnist_classifier_MNISTClassifier p0nprcvx 6dfd1d56-6a5c-4872-992f-8bce4ebad3d3 -- POST / 200 366.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:26,003 mnist_classifier_MNISTClassifier p0nprcvx c62e06bd-9557-4919-8e27-cfc25f5d6c50 -- POST / 200 378.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:26,029 mnist_classifier_MNISTClassifier p0nprcvx 07c30906-a757-4a41-8aef-b8042533b0c5 -- POST / 200 404.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:26,030 mnist_classifier_MNISTClassifier p0nprcvx 0e4ef156-426f-47e8-ab87-e79f332fde37 -- POST / 200 404.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:26,032 mnist_classifier_MNISTClassifier p0nprcvx 7facfc42-7fce-431f-8042-4e5a86a0ad48 -- POST / 200 406.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:26,032 mnist_classifier_MNISTClassifier p0nprcvx 4e366ffb-e224-4bdb-983a-27181084a3a1 -- POST / 200 374.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:26,033 mnist_classifier_MNISTClassifier p0nprcvx a1da3c00-a590-4182-ac53-eb2bf81f5239 -- POST / 200 373.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:26,033 mnist_classifier_MNISTClassifier p0nprcvx 7876081f-083f-4695-8943-36f52f107af6 -- POST / 200 342.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:26,033 mnist_classifier_MNISTClassifier p0nprcvx 5f1f154c-07e7-4fcd-bfae-9a7f1025c5e2 -- POST / 200 341.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:26,033 mnist_classifier_MNISTClassifier p0nprcvx 9de108d7-f7a1-4edf-8b06-9c09439d5d62 -- POST / 200 339.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:26,034 mnist_classifier_MNISTClassifier p0nprcvx 1632c5dd-1b50-4306-932e-3c2d2db63018 -- POST / 200 339.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:26,034 mnist_classifier_MNISTClassifier p0nprcvx a21f7c91-6226-4763-bb74-49e7e9f08967 -- POST / 200 339.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:26,034 mnist_classifier_MNISTClassifier p0nprcvx e5a73ed4-8e89-4d52-8b71-22e552eb560b -- POST / 200 339.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:26,034 mnist_classifier_MNISTClassifier p0nprcvx ab075762-8932-4ca7-9c2a-d1b62f3b9007 -- POST / 200 339.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:26,035 mnist_classifier_MNISTClassifier p0nprcvx 5e4730b6-770e-4dd1-b3f2-feaeac8b1a7e -- POST / 200 338.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:26,035 mnist_classifier_MNISTClassifier p0nprcvx d4a85a91-92d8-43e2-803f-1f594aabd1be -- POST / 200 338.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:26,035 mnist_classifier_MNISTClassifier p0nprcvx 5c7a16f1-2b86-4870-9895-94bd7104018e -- POST / 200 338.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:26,035 mnist_classifier_MNISTClassifier p0nprcvx 83655be9-fca3-4005-b584-d37cfd2ea5c0 -- POST / 200 327.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:26,035 mnist_classifier_MNISTClassifier p0nprcvx 6641f192-50c6-4f91-b23a-f745cfc3e783 -- POST / 200 327.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:26,036 mnist_classifier_MNISTClassifier p0nprcvx 105a7059-503d-48db-9e17-e26e228d3338 -- POST / 200 326.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:26,036 mnist_classifier_MNISTClassifier p0nprcvx df58829c-c371-424c-a803-501096b2a374 -- POST / 200 322.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:26,133 mnist_classifier_MNISTClassifier p0nprcvx e517f761-de73-4284-b131-b4be78e841db -- POST / 200 206.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:26,134 mnist_classifier_MNISTClassifier p0nprcvx babaa12f-314f-4acf-9645-50b123fa9f0c -- POST / 200 180.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:26,134 mnist_classifier_MNISTClassifier p0nprcvx b6e2410e-5bdd-4e46-b268-97894111c75b -- POST / 200 162.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:26,135 mnist_classifier_MNISTClassifier p0nprcvx 3a6a315d-8a7f-4592-850d-1a1bed001198 -- POST / 200 162.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:26,135 mnist_classifier_MNISTClassifier p0nprcvx 7b78b5b5-4887-4273-8a05-939d7da46df7 -- POST / 200 158.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:26,136 mnist_classifier_MNISTClassifier p0nprcvx 07a200d6-d1e1-49fe-a71c-e924bf0ae517 -- POST / 200 159.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:26,137 mnist_classifier_MNISTClassifier p0nprcvx cbf4c12d-cd66-404e-8e44-3acbef822386 -- POST / 200 158.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:26,138 mnist_classifier_MNISTClassifier p0nprcvx f6cfdb7d-0273-410f-bf7f-8053401910ba -- POST / 200 157.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:26,138 mnist_classifier_MNISTClassifier p0nprcvx 11c706ba-89eb-4d0a-8d33-a5c4437c055e -- POST / 200 157.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:26,139 mnist_classifier_MNISTClassifier p0nprcvx 12ce9d7e-da05-4ebf-898c-7dd3b5602210 -- POST / 200 155.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:26,139 mnist_classifier_MNISTClassifier p0nprcvx 3595c9af-b4e4-439e-9195-f2e628a03274 -- POST / 200 154.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:26,140 mnist_classifier_MNISTClassifier p0nprcvx 90dcdcb8-ee1f-4b41-b6d2-ddc361b7f183 -- POST / 200 154.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:26,140 mnist_classifier_MNISTClassifier p0nprcvx 0330e7ac-8a28-4632-b006-3a44491786aa -- POST / 200 155.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:26,140 mnist_classifier_MNISTClassifier p0nprcvx e2ff7501-bb2c-4326-951f-4509d9c9b54a -- POST / 200 156.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:26,140 mnist_classifier_MNISTClassifier p0nprcvx 084a057a-494a-4bf5-a7ce-46ba62a790d1 -- POST / 200 155.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:26,141 mnist_classifier_MNISTClassifier p0nprcvx e57eb806-01af-41bf-a21d-32e99cb2aefa -- POST / 200 139.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:26,141 mnist_classifier_MNISTClassifier p0nprcvx e288b828-3fba-4f88-9037-70aad1239488 -- POST / 200 138.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:26,142 mnist_classifier_MNISTClassifier p0nprcvx 2b08c155-6ccd-498e-bfa7-0af98de4752e -- POST / 200 113.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:26,142 mnist_classifier_MNISTClassifier p0nprcvx b3bac787-1d22-4c3f-9f29-56d56f9d8259 -- POST / 200 113.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:26,144 mnist_classifier_MNISTClassifier p0nprcvx bdb7a93d-26f1-46ef-9549-e08ed6898bc4 -- POST / 200 106.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:26,145 mnist_classifier_MNISTClassifier p0nprcvx 51a5ad1f-41f5-4f77-a474-fa928df816fb -- POST / 200 105.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:26,146 mnist_classifier_MNISTClassifier p0nprcvx d8d44ce8-2d24-433b-a5b0-b870a4859af4 -- POST / 200 103.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:26,147 mnist_classifier_MNISTClassifier p0nprcvx 2cc7a97a-7eed-417e-9bcd-66576db68af8 -- POST / 200 103.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:26,148 mnist_classifier_MNISTClassifier p0nprcvx d60cea2c-f6e7-4317-ac1e-fed2694af339 -- POST / 200 104.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:26,149 mnist_classifier_MNISTClassifier p0nprcvx 6ffc2d8b-4c80-48ae-acc4-df372a3364c3 -- POST / 200 102.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:26,150 mnist_classifier_MNISTClassifier p0nprcvx aa09baa4-f3be-4a5a-b381-8c3403122cdd -- POST / 200 100.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:26,150 mnist_classifier_MNISTClassifier p0nprcvx c6218156-252d-4ac9-b626-f9657b9aea84 -- POST / 200 89.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:26,151 mnist_classifier_MNISTClassifier p0nprcvx 149300a5-3474-4ac5-a548-b91dcdae6815 -- POST / 200 93.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:26,151 mnist_classifier_MNISTClassifier p0nprcvx 8448358d-1ed9-4f1c-8683-094a67dc4a41 -- POST / 200 93.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:26,152 mnist_classifier_MNISTClassifier p0nprcvx 58940489-4c8b-4297-acee-23ef157d84e2 -- POST / 200 93.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:26,152 mnist_classifier_MNISTClassifier p0nprcvx d97202dd-c6eb-4a03-b04a-495d0e07d12a -- POST / 200 93.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:26,153 mnist_classifier_MNISTClassifier p0nprcvx 4f073465-2900-4f90-95d8-336f4897f306 -- POST / 200 93.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4642) INFO 2026-04-17 16:02:26,153 mnist_classifier_MNISTClassifier p0nprcvx c3bb332b-33b1-473e-a22e-18f9bcb6c9f7 -- POST / 200 93.9ms
Processed 1000 requests in 5.09 seconds
Throughput: 196.54 requests/second

Ray Serve automatically buffers and load balances requests across the replicas.

Fault tolerance

In production, process and machine failures are inevitable. Ray Serve is designed so that each major component in the Serve stack (the controller, replicas, and proxies) can fail and recover while your application continues to handle traffic.

Serve can also recover from larger infrastructure failures, such as entire nodes or pods failing. Serve can even recover from head node failures, or the entire head pod if deploying on KubeRay.

For more information about Ray Serve’s fault tolerance, see the Ray Serve fault-tolerance guide.

Monitor the deployment

Monitoring is critical when running large-scale deployments. The Ray dashboard displays Serve metrics like request throughput, latency, and error rates. It also shows cluster resource usage, replica status, and overall deployment health in real time. The dashboard also lets you inspect logs from individual replicas across the cluster.

For debugging, Ray offers distributed debugging tools that let you attach a debugger to running replicas across the cluster. For more information, see the Ray Serve monitoring documentation.

Conclusion

In this tutorial, you:

• Deployed a PyTorch model using Ray Serve with production best practices.

• Enabled dynamic request batching to optimize performance.

• Configured autoscaling and fractional GPU allocation to efficiently scale across a cluster.

• Tested the service with concurrent asynchronous requests.

Further reading

Ray Serve has more production features that are out of scope for this tutorial but are worth checking out:

• Specialized large language model (LLM) serving APIs that handle complexities like managing key-value (KV) caches and continuous batching.

• Model multiplexing to dynamically load and serve many different models on the same deployment. This is useful for serving per-user fine-tuned models, for example.

• Composed deployments to orchestrate multiple deployments into a single app.

For more information, see the Ray Serve documentation and Ray Serve examples.