Serve PyTorch models at scale with Ray Serve

Note

Go to the end to download the full example code.

This tutorial shows how to deploy a PyTorch model using Ray Serve with production-ready features.

How to create a production-ready PyTorch model deployment that can scale to thousands of nodes and GPUs
How to configure an HTTP endpoint for the deployment using FastAPI
Enable dynamic request batching for higher throughput
Configure autoscaling and per-replica CPU/GPU resource allocation
Load test the service with concurrent requests and monitor it with the Ray dashboard
How Ray Serve deployments can self-heal from failures
Ray Serve’s advanced features like model multiplexing and model composition.

PyTorch v2.9+ and torchvision
Ray Serve (ray[serve]) v2.52.1+
A GPU is recommended for higher throughput but is not required

Ray Serve is a scalable framework for serving machine learning models in production. It’s built on top of Ray, which is a unified framework for scaling AI and Python applications that simplifies the complexities of distributed computing. Ray is also open source and part of the PyTorch Foundation.

Setup#

To install the dependencies, run:

pip install "ray[serve]" torch torchvision

Start by importing the required libraries:

import asyncio
import time
from typing import Any

from fastapi import FastAPI
from pydantic import BaseModel
import aiohttp
import numpy as np
import torch
import torch.nn as nn
from ray import serve
from torchvision.transforms import v2

Define a PyTorch model#

Define a simple convolutional neural network for the MNIST digit classification dataset:

class MNISTNet(nn.Module):
    def __init__(self):
        super().__init__()
        self.conv1 = nn.Conv2d(1, 32, 3, 1)
        self.dropout1 = nn.Dropout(0.25)
        self.conv2 = nn.Conv2d(32, 64, 3, 1)
        self.fc1 = nn.Linear(9216, 128)
        self.dropout2 = nn.Dropout(0.5)
        self.fc2 = nn.Linear(128, 10)

    def forward(self, x):
        x = self.conv1(x)
        x = nn.functional.relu(x)
        x = self.conv2(x)
        x = nn.functional.relu(x)
        x = nn.functional.max_pool2d(x, 2)
        x = self.dropout1(x)
        x = torch.flatten(x, 1)
        x = self.fc1(x)
        x = nn.functional.relu(x)
        x = self.dropout2(x)
        x = self.fc2(x)
        return nn.functional.log_softmax(x, dim=1)

Define the Ray Serve deployment#

To deploy this model with Ray Serve, wrap the model in a Python class and decorate it with @serve.deployment.

Processing requests in batches is more efficient than processing requests one by one, especially when using GPUs. Ray Serve provides built-in support for dynamic request batching, where individual incoming requests are opportunistically batched. Enable dynamic batching using the @serve.batch decorator as shown in the following code:

app = FastAPI()

class ImageRequest(BaseModel):  # Used for request validation and generating API documentation
    image: list[list[float]] | list[list[list[float]]]  # 2D or 3D array

@serve.deployment
@serve.ingress(app)
class MNISTClassifier:
    def __init__(self):
        self.device = torch.device("cuda" if torch.cuda.is_available() else "cpu")
        self.model = MNISTNet().to(self.device)
        # Define the transformation pipeline for the input images.
        self.transform = v2.Compose([
            v2.ToImage(),
            v2.ToDtype(torch.float32, scale=True),
            # Mean and standard deviation of the MNIST training subset.
            v2.Normalize(mean=[0.1307], std=[0.3013]),
        ])

        self.model.eval()

    # batch_wait_timeout_s is the maximum time to wait for a full batch,
    # trading off latency for throughput.
    @serve.batch(max_batch_size=128, batch_wait_timeout_s=0.1)
    async def predict_batch(self, images: list[np.ndarray]) -> list[dict[str, Any]]:
        # Stack all images into a single tensor.
        batch_tensor = torch.cat([
            self.transform(img).unsqueeze(0)
            for img in images
        ]).to(self.device).float()

        # Single forward pass on the entire batch at once.
        with torch.no_grad():
            logits = self.model(batch_tensor)
            predictions = torch.argmax(logits, dim=1).cpu().numpy()

        # Unbatch the results and preserve their original order.
        return [
            {
                "predicted_label": int(pred),
                "logits": logit.cpu().numpy().tolist()
            }
            for pred, logit in zip(predictions, logits)
        ]

    @app.post("/")
    async def handle_request(self, request: ImageRequest):
        """Handle an incoming HTTP request using FastAPI.

        Inputs are automatically validated using the Pydantic model.
        """
        # Process the single request.
        image_array = np.array(request.image)

        # Ray Serve's @serve.batch automatically batches requests.
        result = await self.predict_batch(image_array)

        return result

This is a FastAPI app, which extends Ray Serve with features like automatic request validation with Pydantic, auto-generated OpenAPI-style API documentation, and more.

Configure autoscaling and resource allocation#

In production, traffic can vary significantly. Ray Serve’s autoscaling feature automatically adjusts the number of replicas based on traffic load, ensuring you have enough capacity during peaks while saving resources during quiet periods. Ray Serve scales to very large deployments with thousands of nodes and replicas.

You can also specify resource allocation per replica, such as the number of CPUs or GPUs. Ray Serve handles the orchestration of these resources across your cluster. Ray also supports fractional GPUs, allowing multiple replicas to share a single GPU when models are small enough to fit in memory together.

The following is a sample configuration with autoscaling and resource allocation:

num_cpus_per_replica = 1
num_gpus_per_replica = 1  # Set to 0 to run the model on CPUs instead of GPUs.
mnist_app = MNISTClassifier.options(
    autoscaling_config={
        "target_ongoing_requests": 50,  # Target 50 ongoing requests per replica.
        "min_replicas": 1,              # Keep at least 1 replica alive.
        "max_replicas": 80,             # Scale up to 80 replicas to maintain target_ongoing_requests.
        "upscale_delay_s": 5,           # Wait 5s before scaling up.
        "downscale_delay_s": 30,        # Wait 30s before scaling down.
    },
    # Max invocations to handle_request per replica to process simultaneously.
    # Requests exceeding this limit are queued by the router until capacity is available.
    max_ongoing_requests=200,
    # Max queue size for requests that exceed max_ongoing_requests.
    # If the queue is full, future requests are backpressured with errors until space is available.
    # -1 means the queue can grow until cluster memory is exhausted.
    max_queued_requests=-1,
    # Set the resources per replica.
    ray_actor_options={"num_cpus": num_cpus_per_replica, "num_gpus": num_gpus_per_replica}
).bind()

The app is ready to deploy. Suppose you ran this on a cluster of 10 machines, each with 4 GPUs. With num_gpus=0.5, Ray schedules 2 replicas per GPU, giving you 80 replicas across the cluster. This configuration permits the deployment to elastically scale up to 80 replicas as needed to handle traffic spikes and scale back down to 1 replica when traffic subsides.

Test the endpoint with concurrent requests#

To deploy the app, use the serve.run function:

# Start the Ray Serve application.
handle = serve.run(mnist_app, name="mnist_classifier")

2026-04-01 13:44:28,234 WARNING services.py:2137 -- WARNING: The object store is using /tmp instead of /dev/shm because /dev/shm has only 2147471360 bytes available. This will harm performance! You may be able to free up space by deleting files in /dev/shm. If you are inside a Docker container, you can increase /dev/shm size by passing '--shm-size=10.24gb' to 'docker run' (or add it to the run_options list in a Ray cluster config). Make sure to set this to more than 30% of available RAM.
2026-04-01 13:44:28,399 INFO worker.py:2014 -- Started a local Ray instance. View the dashboard at 127.0.0.1:8265
/usr/local/lib/python3.10/dist-packages/ray/_private/worker.py:2062: FutureWarning: Tip: In future versions of Ray, Ray will no longer override accelerator visible devices env var if num_gpus=0 or num_gpus=None (default). To enable this behavior and turn off this error message, set RAY_ACCEL_ENV_VAR_OVERRIDE_ON_ZERO=0
  warnings.warn(
(ProxyActor pid=4521) INFO 2026-04-01 13:44:30,873 proxy 172.17.0.2 -- Proxy starting on node 673ea856514c5e72192a789a3c8a480b01e271e69f33c21625338cec (HTTP port: 8000).
INFO 2026-04-01 13:44:30,941 serve 3836 -- Started Serve in namespace "serve".
(ServeController pid=4525) INFO 2026-04-01 13:44:30,954 controller 4525 -- Registering autoscaling state for deployment Deployment(name='MNISTClassifier', app='mnist_classifier')
(ServeController pid=4525) INFO 2026-04-01 13:44:30,954 controller 4525 -- Deploying new version of Deployment(name='MNISTClassifier', app='mnist_classifier') (initial target replicas: 1).
(ProxyActor pid=4521) INFO 2026-04-01 13:44:30,937 proxy 172.17.0.2 -- Got updated endpoints: {}.
(ProxyActor pid=4521) INFO 2026-04-01 13:44:30,957 proxy 172.17.0.2 -- Got updated endpoints: {Deployment(name='MNISTClassifier', app='mnist_classifier'): EndpointInfo(route='/', app_is_cross_language=False, route_patterns=None)}.
(ProxyActor pid=4521) INFO 2026-04-01 13:44:30,964 proxy 172.17.0.2 -- Started <ray.serve._private.router.SharedRouterLongPollClient object at 0x7fe1735e8d60>.
(ServeController pid=4525) INFO 2026-04-01 13:44:31,059 controller 4525 -- Adding 1 replica to Deployment(name='MNISTClassifier', app='mnist_classifier').
(ProxyActor pid=4521) INFO 2026-04-01 13:44:34,775 proxy 172.17.0.2 -- Got updated endpoints: {Deployment(name='MNISTClassifier', app='mnist_classifier'): EndpointInfo(route='/', app_is_cross_language=False, route_patterns=['/', '/docs', '/docs/oauth2-redirect', '/openapi.json', '/redoc'])}.
INFO 2026-04-01 13:44:35,060 serve 3836 -- Application 'mnist_classifier' is ready at http://127.0.0.1:8000/.

You will see output similar to:

Started Serve in namespace "serve".
Registering autoscaling state for deployment Deployment(name='MNISTClassifier', app='mnist_classifier')
Deploying new version of Deployment(name='MNISTClassifier', app='mnist_classifier') (initial target replicas: 1).
Proxy starting on node ... (HTTP port: 8000).
Got updated endpoints: {}.
Got updated endpoints: {Deployment(name='MNISTClassifier', app='mnist_classifier'): EndpointInfo(route='/', app_is_cross_language=False, route_patterns=None)}.
Started <ray.serve._private.router.SharedRouterLongPollClient object at 0x73a53c52c250>.
Adding 1 replica to Deployment(name='MNISTClassifier', app='mnist_classifier').
Got updated endpoints: {Deployment(name='MNISTClassifier', app='mnist_classifier'): EndpointInfo(route='/', app_is_cross_language=False, route_patterns=['/', '/docs', '/docs/oauth2-redirect', '/openapi.json', '/redoc'])}.
Application 'mnist_classifier' is ready at http://127.0.0.1:8000/.

The app is now listening for requests on port 8000.

To test the deployment, you can send many requests concurrently using aiohttp. The following code demonstrates how to send 1000 concurrent requests to the app:

async def send_single_request(session, url, data):
    async with session.post(url, json=data) as response:
        return await response.json()

async def send_concurrent_requests(num_requests):
    image = np.random.rand(28, 28).tolist()

    print(f"Sending {num_requests} concurrent requests...")
    async with aiohttp.ClientSession() as session:
        tasks = [
            send_single_request(session, url="http://localhost:8000/", data={"image": image})
            for _ in range(num_requests)
        ]
        responses = await asyncio.gather(*tasks)

    return responses

# Run the concurrent requests.
start_time = time.time()
responses = asyncio.run(send_concurrent_requests(1000))
elapsed = time.time() - start_time

print(f"Processed {len(responses)} requests in {elapsed:.2f} seconds")
print(f"Throughput: {len(responses)/elapsed:.2f} requests/second")

Sending 1000 concurrent requests...
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:36,309 mnist_classifier_MNISTClassifier 483o5qtx c75494d2-a00d-4cb9-9911-e3eb012e455a -- POST / 200 565.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:36,311 mnist_classifier_MNISTClassifier 483o5qtx ab079bc9-d885-4da3-a481-adab4c883de9 -- POST / 200 556.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:36,312 mnist_classifier_MNISTClassifier 483o5qtx a39158a6-0b2f-4121-9993-bbe56871deec -- POST / 200 554.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:36,313 mnist_classifier_MNISTClassifier 483o5qtx 9d36e073-a4e3-4d6b-b138-4d1c366ea115 -- POST / 200 554.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:36,315 mnist_classifier_MNISTClassifier 483o5qtx 89a257ae-7491-4881-abe7-239e919b9052 -- POST / 200 543.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:36,316 mnist_classifier_MNISTClassifier 483o5qtx 5850b9fa-870c-432f-aa50-4e012a6db039 -- POST / 200 546.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:36,316 mnist_classifier_MNISTClassifier 483o5qtx 44ecec91-8071-4d77-bb50-378514302a2c -- POST / 200 543.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:36,318 mnist_classifier_MNISTClassifier 483o5qtx d5029874-8ce6-4077-a83e-2cacdc7054f9 -- POST / 200 547.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:36,318 mnist_classifier_MNISTClassifier 483o5qtx ef3219ed-213e-462c-990b-0a88dbd4484a -- POST / 200 544.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:36,318 mnist_classifier_MNISTClassifier 483o5qtx 5d04407b-274e-4f56-afe3-1cf4133461d9 -- POST / 200 543.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:36,318 mnist_classifier_MNISTClassifier 483o5qtx 5f43ebfe-47ae-4cff-9525-976a0b7d39a4 -- POST / 200 542.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:36,319 mnist_classifier_MNISTClassifier 483o5qtx 8ab62ff3-f057-4fa0-972b-4d5d324526c3 -- POST / 200 541.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:36,322 mnist_classifier_MNISTClassifier 483o5qtx 7965e08c-f76b-443f-a999-a61dd5803279 -- POST / 200 542.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:36,323 mnist_classifier_MNISTClassifier 483o5qtx 614e15a7-3b60-4725-b1a9-562193c5a9d9 -- POST / 200 541.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:36,325 mnist_classifier_MNISTClassifier 483o5qtx fa7046b3-5f9d-4105-8a9a-7af17a0044ff -- POST / 200 542.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:36,328 mnist_classifier_MNISTClassifier 483o5qtx b60d172a-b219-4dec-86de-c7f5707619f1 -- POST / 200 543.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:36,329 mnist_classifier_MNISTClassifier 483o5qtx 323daf21-d83d-438a-93c9-2e42384dbe21 -- POST / 200 541.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:36,332 mnist_classifier_MNISTClassifier 483o5qtx 27a909b9-330b-4ffb-ae5b-48646786a2b1 -- POST / 200 544.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:36,334 mnist_classifier_MNISTClassifier 483o5qtx ff8b516f-3734-410c-bb9e-1e0204fddb10 -- POST / 200 545.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:36,336 mnist_classifier_MNISTClassifier 483o5qtx e482b145-18a0-428c-ac0f-dfee8ebf06cc -- POST / 200 544.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:36,336 mnist_classifier_MNISTClassifier 483o5qtx 288d4e9c-901a-4222-8069-c7ee3b14d4a4 -- POST / 200 542.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:36,449 mnist_classifier_MNISTClassifier 483o5qtx 2f172bd3-c1e5-401b-909a-228107fee805 -- POST / 200 654.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:36,450 mnist_classifier_MNISTClassifier 483o5qtx d5be0cb1-15bb-47c3-bc0f-642e53ebb1cc -- POST / 200 653.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:36,451 mnist_classifier_MNISTClassifier 483o5qtx f181ce7b-fb65-4c7c-992f-d8f02dc5de1b -- POST / 200 653.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:36,451 mnist_classifier_MNISTClassifier 483o5qtx 0be0b6dc-deb9-4b15-afc5-73db5f0b2021 -- POST / 200 653.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:36,452 mnist_classifier_MNISTClassifier 483o5qtx 86d38c2c-1062-4990-9898-b15b590ec548 -- POST / 200 653.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:36,453 mnist_classifier_MNISTClassifier 483o5qtx 04898cee-da06-4d3d-b734-a1d8afe1b0ce -- POST / 200 654.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:36,454 mnist_classifier_MNISTClassifier 483o5qtx fef88cc3-852e-4cd9-b9c9-6cc409d38d8e -- POST / 200 655.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:36,455 mnist_classifier_MNISTClassifier 483o5qtx cd198472-627a-4246-ac16-89aa0769b0da -- POST / 200 654.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:36,455 mnist_classifier_MNISTClassifier 483o5qtx 37fe788e-b35d-42c8-b866-17568a05e368 -- POST / 200 654.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:36,456 mnist_classifier_MNISTClassifier 483o5qtx 01699ff1-46a6-43ec-8495-5a013de94d20 -- POST / 200 652.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:36,457 mnist_classifier_MNISTClassifier 483o5qtx b6f8996b-f764-4f4d-936b-91c98fe9c7e4 -- POST / 200 651.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:36,457 mnist_classifier_MNISTClassifier 483o5qtx 0b581902-c8b1-4e0d-a2d1-addfb4a06f6d -- POST / 200 651.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:36,458 mnist_classifier_MNISTClassifier 483o5qtx f021937c-b16b-48bf-9253-4f411930e0a2 -- POST / 200 651.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:36,459 mnist_classifier_MNISTClassifier 483o5qtx 3e4b3f7c-dbe6-457f-8bd9-011ad1f249db -- POST / 200 649.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:36,459 mnist_classifier_MNISTClassifier 483o5qtx 5850743e-97d4-478d-aa57-3d5e585c7f2e -- POST / 200 647.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:36,460 mnist_classifier_MNISTClassifier 483o5qtx 7f0b0f4f-ef78-42bc-ac68-eb2341654dab -- POST / 200 647.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:36,461 mnist_classifier_MNISTClassifier 483o5qtx 6642a4f6-2067-4f12-9170-ab1038065b7e -- POST / 200 648.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:36,462 mnist_classifier_MNISTClassifier 483o5qtx 21952d67-042c-4c0c-a591-18a6ef3b82d8 -- POST / 200 647.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:36,463 mnist_classifier_MNISTClassifier 483o5qtx 96a6ec8d-ddf6-418b-9877-fa3e23eef580 -- POST / 200 645.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:36,464 mnist_classifier_MNISTClassifier 483o5qtx f818aed7-2780-4c11-ac06-d9a26af4c1a9 -- POST / 200 645.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:36,464 mnist_classifier_MNISTClassifier 483o5qtx 0d5682b6-6c73-4c59-9906-371b11e02083 -- POST / 200 646.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:36,466 mnist_classifier_MNISTClassifier 483o5qtx 8717fa38-9baa-4388-bd64-d558d34f823f -- POST / 200 644.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:36,467 mnist_classifier_MNISTClassifier 483o5qtx d5f95d80-6012-4a94-9a31-e30ebb04d4ab -- POST / 200 643.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:36,468 mnist_classifier_MNISTClassifier 483o5qtx 6e86299a-b550-403e-bc73-4785802ff928 -- POST / 200 646.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:36,469 mnist_classifier_MNISTClassifier 483o5qtx 651d615e-2b44-444f-802c-46c2edc62424 -- POST / 200 644.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:36,471 mnist_classifier_MNISTClassifier 483o5qtx becb6c8c-11cc-4336-ae08-3d7495cf1297 -- POST / 200 646.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:36,471 mnist_classifier_MNISTClassifier 483o5qtx 86e6ace1-293b-4a2d-aa73-f09832e509f0 -- POST / 200 646.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:36,473 mnist_classifier_MNISTClassifier 483o5qtx 1cf8edc7-231f-4a99-a0cc-09b790a69680 -- POST / 200 645.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:36,475 mnist_classifier_MNISTClassifier 483o5qtx 5952132c-a5a1-4ab7-8965-2cedcfd480ac -- POST / 200 647.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:36,475 mnist_classifier_MNISTClassifier 483o5qtx 90dabaf3-1ba6-4af6-a6de-633e620cb089 -- POST / 200 646.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:36,476 mnist_classifier_MNISTClassifier 483o5qtx c4cbdda1-b69d-4ce3-a9a8-1ab320f2946c -- POST / 200 645.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:36,476 mnist_classifier_MNISTClassifier 483o5qtx 883dbe0d-38ce-43c1-8de4-e12986015f7d -- POST / 200 641.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:36,476 mnist_classifier_MNISTClassifier 483o5qtx 2331733a-ebc2-41c4-825a-f9ffd9f60d92 -- POST / 200 645.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:36,477 mnist_classifier_MNISTClassifier 483o5qtx 59080637-9256-497d-af0e-78de660fd3ea -- POST / 200 641.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:36,477 mnist_classifier_MNISTClassifier 483o5qtx ddb3eef7-0248-4c87-a7c2-aea2aeb0db2e -- POST / 200 638.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:36,477 mnist_classifier_MNISTClassifier 483o5qtx aba4070d-3e2e-4cb0-9079-b7b2494062fd -- POST / 200 638.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:36,478 mnist_classifier_MNISTClassifier 483o5qtx fb4cd8b9-ce70-4ec1-a9b7-9df7cae50fd5 -- POST / 200 640.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:36,478 mnist_classifier_MNISTClassifier 483o5qtx ef0a9ad1-3328-43ef-a77a-810ad4f8f0f2 -- POST / 200 635.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:36,479 mnist_classifier_MNISTClassifier 483o5qtx 10bb72ee-48ac-4de1-8193-598311c8ee4f -- POST / 200 635.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:36,479 mnist_classifier_MNISTClassifier 483o5qtx 1b7d270c-2187-4939-8ed4-1795e7b6750e -- POST / 200 631.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:36,479 mnist_classifier_MNISTClassifier 483o5qtx 3bd3ec33-93d7-45ed-b990-c91ab2e99278 -- POST / 200 631.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:36,480 mnist_classifier_MNISTClassifier 483o5qtx 976dccfb-005e-4c5d-9159-796a29a5c974 -- POST / 200 631.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:36,480 mnist_classifier_MNISTClassifier 483o5qtx 83062734-5a07-4969-b904-2016c071b102 -- POST / 200 503.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:36,480 mnist_classifier_MNISTClassifier 483o5qtx ee3d1ea4-6290-4be2-93fb-c6943c469677 -- POST / 200 503.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:36,481 mnist_classifier_MNISTClassifier 483o5qtx be3ea05f-2816-42a2-9768-a9a036c01cd0 -- POST / 200 504.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:36,482 mnist_classifier_MNISTClassifier 483o5qtx 55f0cf37-93d2-4d5a-b9b9-4cce43efcbed -- POST / 200 504.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:36,483 mnist_classifier_MNISTClassifier 483o5qtx b22bd4cd-52fd-4f16-88af-c01f823d0de2 -- POST / 200 485.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:36,483 mnist_classifier_MNISTClassifier 483o5qtx cd1623fb-724f-42f5-812f-986e1c0e65db -- POST / 200 490.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:36,483 mnist_classifier_MNISTClassifier 483o5qtx dcfd4119-c027-4416-a5d6-d3fe8a9add7d -- POST / 200 492.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:36,484 mnist_classifier_MNISTClassifier 483o5qtx 8ade3078-4cf3-46fb-9983-81d5bf988b3c -- POST / 200 506.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:36,484 mnist_classifier_MNISTClassifier 483o5qtx d0b99ca6-a41f-430e-962e-c06a1c67b1a9 -- POST / 200 503.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:36,489 mnist_classifier_MNISTClassifier 483o5qtx 01878c32-7bf4-4bd1-8e54-4c947246e2cb -- POST / 200 506.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:36,492 mnist_classifier_MNISTClassifier 483o5qtx 19e96da2-dd81-47a9-9c33-4e4ba4afb96a -- POST / 200 508.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:36,493 mnist_classifier_MNISTClassifier 483o5qtx 7ffeddbc-30c7-4c93-9069-c27136e44bff -- POST / 200 509.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:36,495 mnist_classifier_MNISTClassifier 483o5qtx af80ed98-68a8-4ed2-a0fe-0678ed093f8a -- POST / 200 509.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:36,496 mnist_classifier_MNISTClassifier 483o5qtx 128bb49a-c201-4ee4-ab30-a66c0d6dbd8b -- POST / 200 507.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:36,496 mnist_classifier_MNISTClassifier 483o5qtx 91ca74ea-d0d5-4334-a60c-77783db5ad6f -- POST / 200 507.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:36,497 mnist_classifier_MNISTClassifier 483o5qtx a92c451e-38d1-41ba-9fda-02f1320373cd -- POST / 200 506.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:36,497 mnist_classifier_MNISTClassifier 483o5qtx b0311ebe-1663-40e0-8403-8c8737a2bdc2 -- POST / 200 506.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:36,497 mnist_classifier_MNISTClassifier 483o5qtx 3f667eb8-3c30-413e-aede-49cf948c8954 -- POST / 200 506.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:36,497 mnist_classifier_MNISTClassifier 483o5qtx 774ffc90-7d8d-4755-9aa0-5586fc66c229 -- POST / 200 500.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:36,498 mnist_classifier_MNISTClassifier 483o5qtx c9c5cec5-feb5-44fe-abe9-6787035b9f61 -- POST / 200 503.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:36,498 mnist_classifier_MNISTClassifier 483o5qtx 1219ec29-f4b4-4f75-92c6-ffdf5cd86b17 -- POST / 200 502.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:36,498 mnist_classifier_MNISTClassifier 483o5qtx 7fba987f-3826-4cfb-a870-1ba63c208dd8 -- POST / 200 500.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:36,498 mnist_classifier_MNISTClassifier 483o5qtx 69036ddd-559e-4cd5-b627-9772fb598d3a -- POST / 200 498.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:36,499 mnist_classifier_MNISTClassifier 483o5qtx 78e966b3-60ba-4faf-934b-1c2b236a43e8 -- POST / 200 496.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:36,553 mnist_classifier_MNISTClassifier 483o5qtx 09916a6f-5ddc-4f02-b653-6a1a10c0fd15 -- POST / 200 549.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:36,582 mnist_classifier_MNISTClassifier 483o5qtx 71bd39da-c386-4117-bbc8-76b26fe66148 -- POST / 200 578.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:36,583 mnist_classifier_MNISTClassifier 483o5qtx 1f971403-c8f8-4b3a-8c1d-74b68a77e8f1 -- POST / 200 577.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:36,583 mnist_classifier_MNISTClassifier 483o5qtx 145b034d-1280-44f0-a6c5-509ca2eebcd7 -- POST / 200 577.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:36,583 mnist_classifier_MNISTClassifier 483o5qtx d150161c-a932-4944-97a5-333dbe6c2aeb -- POST / 200 577.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:36,583 mnist_classifier_MNISTClassifier 483o5qtx 30fd60ab-25cb-4b55-83fc-7c923e0aa738 -- POST / 200 576.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:36,583 mnist_classifier_MNISTClassifier 483o5qtx e09e92c3-ba2e-4b3e-9000-58bf1add2750 -- POST / 200 576.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:36,584 mnist_classifier_MNISTClassifier 483o5qtx 1e92ca0c-eacf-4357-8ce7-134434af0292 -- POST / 200 575.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:36,584 mnist_classifier_MNISTClassifier 483o5qtx 7095d736-bcd4-45d3-8958-c807f054f20e -- POST / 200 574.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:36,584 mnist_classifier_MNISTClassifier 483o5qtx 38553390-cc78-4e15-85a1-a41bf4a85599 -- POST / 200 574.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:36,584 mnist_classifier_MNISTClassifier 483o5qtx 49f0c056-0a3e-4e86-8dbf-ec4654c6df34 -- POST / 200 574.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:36,584 mnist_classifier_MNISTClassifier 483o5qtx ccfb6c85-e046-4a3e-9f82-c981f99c0a11 -- POST / 200 573.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:36,584 mnist_classifier_MNISTClassifier 483o5qtx 97199274-c623-4622-8ec7-be60f2129ef7 -- POST / 200 573.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:36,584 mnist_classifier_MNISTClassifier 483o5qtx 29935a29-44dc-4cc7-a1e0-c33914ae9d4d -- POST / 200 279.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:36,584 mnist_classifier_MNISTClassifier 483o5qtx 6fb1277d-aaac-479e-9553-d47afa0e5832 -- POST / 200 261.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:36,585 mnist_classifier_MNISTClassifier 483o5qtx 3c9b6aba-c547-45b1-956a-da8d46f909b8 -- POST / 200 261.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:36,585 mnist_classifier_MNISTClassifier 483o5qtx e62f26b8-5b24-44b4-8b76-6bbcac628827 -- POST / 200 259.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:36,585 mnist_classifier_MNISTClassifier 483o5qtx 656e39ce-2069-4136-b29c-79cc1d30ca26 -- POST / 200 250.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:36,585 mnist_classifier_MNISTClassifier 483o5qtx 50a9837a-2a18-4810-a95a-cf1811fac622 -- POST / 200 246.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:36,585 mnist_classifier_MNISTClassifier 483o5qtx f0315d32-e059-424f-b84f-5b8c05231520 -- POST / 200 244.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:36,585 mnist_classifier_MNISTClassifier 483o5qtx be2736f6-df17-49dd-9776-2c6162f40970 -- POST / 200 243.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:36,585 mnist_classifier_MNISTClassifier 483o5qtx 0cae3037-6703-4e13-9966-f1e9c53443df -- POST / 200 242.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:36,586 mnist_classifier_MNISTClassifier 483o5qtx dd395c6b-8596-4cd9-b197-425d29a055d1 -- POST / 200 241.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:36,586 mnist_classifier_MNISTClassifier 483o5qtx ed64c758-a1a9-48d4-8649-0ba60589f6af -- POST / 200 239.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:36,586 mnist_classifier_MNISTClassifier 483o5qtx c8119447-cd5f-4997-aa4c-78e0d2ce4e2f -- POST / 200 239.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:36,586 mnist_classifier_MNISTClassifier 483o5qtx 56b5fbe8-d3a1-4f97-a0c0-5d61e42ae6c8 -- POST / 200 238.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:36,586 mnist_classifier_MNISTClassifier 483o5qtx d7e15979-dfd8-4391-9445-4213ca73f117 -- POST / 200 238.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:36,586 mnist_classifier_MNISTClassifier 483o5qtx 8b1c20bb-7115-409b-9b32-c0cc4b1aba00 -- POST / 200 238.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:36,586 mnist_classifier_MNISTClassifier 483o5qtx 66445ff1-b6b3-454d-a892-6ac29a733dad -- POST / 200 237.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:36,586 mnist_classifier_MNISTClassifier 483o5qtx 27b7d8e9-607a-4454-bcfd-685f157d0bbd -- POST / 200 229.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:36,587 mnist_classifier_MNISTClassifier 483o5qtx 2fc8bf71-4009-4091-a84e-b98c2e40f8b1 -- POST / 200 227.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:36,591 mnist_classifier_MNISTClassifier 483o5qtx b091e4a5-9ffe-420a-be92-e85ae19ba38b -- POST / 200 235.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:36,593 mnist_classifier_MNISTClassifier 483o5qtx e815f3db-32c5-40a6-8775-3bbda08db691 -- POST / 200 226.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:36,599 mnist_classifier_MNISTClassifier 483o5qtx 96c737e4-61e5-4994-9a89-6df8d7f4ef39 -- POST / 200 233.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:36,712 mnist_classifier_MNISTClassifier 483o5qtx 2de0e2d3-7bd2-4ca1-9090-04dfc00271bd -- POST / 200 248.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:36,713 mnist_classifier_MNISTClassifier 483o5qtx bd244dd0-8517-4ad8-950b-c7b21571050e -- POST / 200 247.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:36,713 mnist_classifier_MNISTClassifier 483o5qtx 1d5793ed-015d-4d7c-b1d3-37898fd28425 -- POST / 200 256.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:36,713 mnist_classifier_MNISTClassifier 483o5qtx ba80e60c-ca0e-48b0-ac45-fda9081b70c9 -- POST / 200 245.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:36,715 mnist_classifier_MNISTClassifier 483o5qtx 2a4537c9-7bb9-42d7-9983-27d4ed97f1f1 -- POST / 200 223.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:36,717 mnist_classifier_MNISTClassifier 483o5qtx 8e1fbf2f-417e-44b3-bcbd-a4311de844ff -- POST / 200 244.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:36,717 mnist_classifier_MNISTClassifier 483o5qtx 9b89ea52-239e-4951-881a-50c391178f17 -- POST / 200 236.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:36,720 mnist_classifier_MNISTClassifier 483o5qtx 86991307-9ec6-46e8-9c1f-9f32b5508dbb -- POST / 200 220.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:36,721 mnist_classifier_MNISTClassifier 483o5qtx 58730105-6cb0-4202-87a1-870edda62f44 -- POST / 200 220.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:36,722 mnist_classifier_MNISTClassifier 483o5qtx d8438b61-71e0-4195-93d5-c264eb8d4d88 -- POST / 200 192.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:36,722 mnist_classifier_MNISTClassifier 483o5qtx 10b34852-8522-4dfb-997a-a4b322f4385f -- POST / 200 189.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:36,723 mnist_classifier_MNISTClassifier 483o5qtx cdaf05bb-e3b1-4627-b8ac-edf6b3a11b91 -- POST / 200 222.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:36,725 mnist_classifier_MNISTClassifier 483o5qtx 830d46e0-386d-4efe-bb9a-a36a1957217b -- POST / 200 223.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:36,727 mnist_classifier_MNISTClassifier 483o5qtx a97280ef-0e31-4d29-944e-5842e1946a52 -- POST / 200 226.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:36,729 mnist_classifier_MNISTClassifier 483o5qtx 4b4dc743-3dcc-48c1-b906-aef27d0ff1e4 -- POST / 200 227.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:36,733 mnist_classifier_MNISTClassifier 483o5qtx 12c560f5-88da-4e10-abed-46999129a6de -- POST / 200 229.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:36,734 mnist_classifier_MNISTClassifier 483o5qtx dbdda6e7-2104-461d-a945-4cb8763fa6cb -- POST / 200 224.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:36,735 mnist_classifier_MNISTClassifier 483o5qtx c66d952d-2974-4128-aa2f-2301467546aa -- POST / 200 224.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:36,736 mnist_classifier_MNISTClassifier 483o5qtx 5f09083a-d3fc-40de-8d2c-fbe0eb2273da -- POST / 200 224.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:36,737 mnist_classifier_MNISTClassifier 483o5qtx b8fd3a61-cfad-4d1b-b35a-4ce332655e85 -- POST / 200 223.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:36,737 mnist_classifier_MNISTClassifier 483o5qtx 4e297db6-c6f7-4933-8bce-01d457795aab -- POST / 200 221.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:36,738 mnist_classifier_MNISTClassifier 483o5qtx b51dd76c-75e8-42aa-8e9f-9f6bc92c3cdb -- POST / 200 209.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:36,739 mnist_classifier_MNISTClassifier 483o5qtx 9b7016ae-9f84-4aa7-8e60-4a1eae51d99b -- POST / 200 205.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:36,740 mnist_classifier_MNISTClassifier 483o5qtx bbae121d-9458-4d18-97b3-f07077c776f5 -- POST / 200 209.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:36,871 mnist_classifier_MNISTClassifier 483o5qtx 2e0afb3a-b777-4ba3-a250-bf77b7be45e2 -- POST / 200 321.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:36,872 mnist_classifier_MNISTClassifier 483o5qtx 3b788b15-f9b4-4db3-8bfb-58fe74715a53 -- POST / 200 320.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:36,872 mnist_classifier_MNISTClassifier 483o5qtx 161e7993-1a98-48c0-a481-ed9af94d40d5 -- POST / 200 320.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:36,873 mnist_classifier_MNISTClassifier 483o5qtx 5d4638a3-30a3-4eb5-9e79-2db4e5c88b58 -- POST / 200 320.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:36,874 mnist_classifier_MNISTClassifier 483o5qtx 8cc1ca75-f06b-4352-b512-8f261ea15054 -- POST / 200 255.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:36,874 mnist_classifier_MNISTClassifier 483o5qtx 30cb0dff-57c5-48f8-b364-04adde091b18 -- POST / 200 252.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:36,876 mnist_classifier_MNISTClassifier 483o5qtx 92fda353-e7a2-4a47-a297-6b7e3d4ac483 -- POST / 200 251.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:36,877 mnist_classifier_MNISTClassifier 483o5qtx 39388316-4cfa-4338-ba26-cb81715bb25c -- POST / 200 252.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:36,877 mnist_classifier_MNISTClassifier 483o5qtx 229fc5a2-929a-42db-aba5-2bc8f0e637c6 -- POST / 200 252.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:36,878 mnist_classifier_MNISTClassifier 483o5qtx 0075beeb-47b7-4818-9d3f-be20726c3fc4 -- POST / 200 253.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:36,879 mnist_classifier_MNISTClassifier 483o5qtx 8f66a4c9-f2b9-4ae6-beda-887aafa58445 -- POST / 200 253.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:36,879 mnist_classifier_MNISTClassifier 483o5qtx 57e02b82-1da9-474a-9f8d-eff4217b296a -- POST / 200 254.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:36,880 mnist_classifier_MNISTClassifier 483o5qtx af426fc5-6ce7-4a71-9def-d9610a1ba3c0 -- POST / 200 254.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:36,880 mnist_classifier_MNISTClassifier 483o5qtx 5d507591-a429-42ea-91e2-65c0926017ae -- POST / 200 254.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:36,880 mnist_classifier_MNISTClassifier 483o5qtx dd2885c3-7201-480c-8b9d-42ff8723d1b1 -- POST / 200 254.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:36,881 mnist_classifier_MNISTClassifier 483o5qtx 7cfce7a5-5138-4145-81bb-50e987654c24 -- POST / 200 249.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:36,881 mnist_classifier_MNISTClassifier 483o5qtx fc03edb3-9fc5-49e1-a2c9-49a062e4cc83 -- POST / 200 254.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:36,881 mnist_classifier_MNISTClassifier 483o5qtx 933227ab-14ce-40f1-b3f4-7ab2fcf9a358 -- POST / 200 254.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:36,881 mnist_classifier_MNISTClassifier 483o5qtx 45e1b9c4-3ebe-40b0-a3c9-0716770395f7 -- POST / 200 254.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:36,881 mnist_classifier_MNISTClassifier 483o5qtx d0ab4129-c1b7-49a9-9178-653130173691 -- POST / 200 254.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:36,882 mnist_classifier_MNISTClassifier 483o5qtx 85795116-2c6d-4dd4-8c78-2b2ce87f542a -- POST / 200 254.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:36,882 mnist_classifier_MNISTClassifier 483o5qtx 0655da86-fedb-44e5-804b-32ac3e26c3cb -- POST / 200 255.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:36,883 mnist_classifier_MNISTClassifier 483o5qtx 6c03b62f-b214-404c-b266-a5c0893e7169 -- POST / 200 255.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:36,883 mnist_classifier_MNISTClassifier 483o5qtx da0bcbd9-f77d-4e70-ae9f-cb65e4f88f7e -- POST / 200 255.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:36,883 mnist_classifier_MNISTClassifier 483o5qtx 8bb4df51-002b-4144-a85e-53732969d8f3 -- POST / 200 255.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:36,884 mnist_classifier_MNISTClassifier 483o5qtx 2a26982c-c219-437d-a3e6-8106211e756c -- POST / 200 252.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:36,884 mnist_classifier_MNISTClassifier 483o5qtx 26e25028-a80b-4148-ac71-0f34dbbc6199 -- POST / 200 251.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:36,884 mnist_classifier_MNISTClassifier 483o5qtx b3867d80-e6e1-4423-bc52-b78a7c533382 -- POST / 200 250.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:36,885 mnist_classifier_MNISTClassifier 483o5qtx 481db43d-94a8-49ba-8b6b-560d7dff1f8c -- POST / 200 249.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:36,885 mnist_classifier_MNISTClassifier 483o5qtx c740f20f-5884-4f4c-8b84-6e591609f35b -- POST / 200 249.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:36,885 mnist_classifier_MNISTClassifier 483o5qtx 33cdbfa6-3258-4d44-ad75-ba8c17453d0a -- POST / 200 249.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:36,886 mnist_classifier_MNISTClassifier 483o5qtx 84c6d692-51ac-4b4c-9ef0-815fefef28bc -- POST / 200 248.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:36,886 mnist_classifier_MNISTClassifier 483o5qtx ef80c135-8d93-477c-aec6-a8633259ccde -- POST / 200 246.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:36,887 mnist_classifier_MNISTClassifier 483o5qtx 365978f1-b72a-492d-a669-c2e57b187c4b -- POST / 200 246.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:36,895 mnist_classifier_MNISTClassifier 483o5qtx e55fc013-3fc9-4bec-96c0-f3313845a6a4 -- POST / 200 253.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:36,897 mnist_classifier_MNISTClassifier 483o5qtx 3acc8e50-66c0-41f2-a679-af2bd7a2db6c -- POST / 200 210.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:36,909 mnist_classifier_MNISTClassifier 483o5qtx 05c7a607-6c53-4e9c-962f-87db002d554e -- POST / 200 220.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:36,909 mnist_classifier_MNISTClassifier 483o5qtx ce3ed9a7-d92a-49df-b792-8f82627c332b -- POST / 200 220.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:36,911 mnist_classifier_MNISTClassifier 483o5qtx 2f1e20c2-729d-4e55-b9d8-a7cd067b42dd -- POST / 200 220.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:36,911 mnist_classifier_MNISTClassifier 483o5qtx 180dc15a-421b-4f07-b3fb-73d5019e228a -- POST / 200 220.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:36,916 mnist_classifier_MNISTClassifier 483o5qtx 33685f01-92f1-45f6-a5ed-9e79c4ce8e47 -- POST / 200 224.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:36,916 mnist_classifier_MNISTClassifier 483o5qtx a667e755-c013-4731-af96-db6f9e38dc03 -- POST / 200 221.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:36,917 mnist_classifier_MNISTClassifier 483o5qtx e4342797-ec77-4362-8c10-67a3885f75d6 -- POST / 200 224.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:36,917 mnist_classifier_MNISTClassifier 483o5qtx c18db494-5de0-4fa1-9b83-93ef7b08eb58 -- POST / 200 223.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:36,921 mnist_classifier_MNISTClassifier 483o5qtx b19c795e-108f-4cfc-9c00-32c82f447cd9 -- POST / 200 174.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:36,921 mnist_classifier_MNISTClassifier 483o5qtx c748046a-70b1-4867-b1de-493a20e67688 -- POST / 200 173.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:36,922 mnist_classifier_MNISTClassifier 483o5qtx c146b1a0-cf48-4aaf-b1a5-2eac4fe8fc47 -- POST / 200 173.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:36,924 mnist_classifier_MNISTClassifier 483o5qtx bea6c73c-1b20-40a1-a80a-b90760222717 -- POST / 200 165.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:36,927 mnist_classifier_MNISTClassifier 483o5qtx d4e24393-8caf-4b02-aa8d-7246c837256e -- POST / 200 164.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:36,928 mnist_classifier_MNISTClassifier 483o5qtx 641da622-5ca8-412a-9cae-9aed507b2cf4 -- POST / 200 164.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:36,928 mnist_classifier_MNISTClassifier 483o5qtx 91dc8a7c-6614-4be6-b263-f96350e5264d -- POST / 200 164.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:36,931 mnist_classifier_MNISTClassifier 483o5qtx 090b7bbf-1320-4ae1-a62e-bb96e751a0d5 -- POST / 200 166.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:36,932 mnist_classifier_MNISTClassifier 483o5qtx 042f4d1f-5e17-46cc-8c0d-bec68c610a0f -- POST / 200 167.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:36,933 mnist_classifier_MNISTClassifier 483o5qtx c19af859-2c9d-4939-b368-ceb17d92a961 -- POST / 200 167.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:36,933 mnist_classifier_MNISTClassifier 483o5qtx d369569c-6f93-43b3-b08a-fd143f8be2be -- POST / 200 166.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:36,933 mnist_classifier_MNISTClassifier 483o5qtx 313512cd-da9b-45bd-85c7-ca0f9887ef5c -- POST / 200 162.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:36,938 mnist_classifier_MNISTClassifier 483o5qtx 86ee4588-8215-429f-96a4-09877c41a6b3 -- POST / 200 296.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:36,939 mnist_classifier_MNISTClassifier 483o5qtx e62871f7-d368-447f-a9ac-7af43a4e22f7 -- POST / 200 296.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:36,939 mnist_classifier_MNISTClassifier 483o5qtx 4389e663-0374-4180-a200-db2da282c209 -- POST / 200 296.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:36,939 mnist_classifier_MNISTClassifier 483o5qtx 20460657-587d-4754-8838-a1a83cef4bcc -- POST / 200 296.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:36,940 mnist_classifier_MNISTClassifier 483o5qtx 0d37bebf-66c7-4c97-845b-630feac20591 -- POST / 200 296.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:36,940 mnist_classifier_MNISTClassifier 483o5qtx ea732957-4d38-4a2a-8162-8ac764d394a3 -- POST / 200 295.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:36,941 mnist_classifier_MNISTClassifier 483o5qtx b87afb1b-58d5-432c-8cfb-2d1d16f675fb -- POST / 200 294.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:36,941 mnist_classifier_MNISTClassifier 483o5qtx 60919d05-f278-423c-8911-9d78ee9d00b4 -- POST / 200 293.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:36,941 mnist_classifier_MNISTClassifier 483o5qtx afe096d7-7fb4-48aa-9ba7-c32e2e35c9bd -- POST / 200 291.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:36,941 mnist_classifier_MNISTClassifier 483o5qtx 3bbd953b-75af-4842-a5b0-c418d9c20229 -- POST / 200 284.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:36,942 mnist_classifier_MNISTClassifier 483o5qtx d931e70e-631f-4b04-8b88-23691c38d1e6 -- POST / 200 301.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:36,942 mnist_classifier_MNISTClassifier 483o5qtx de042a63-6b9d-46a1-b903-0836ee1ddc05 -- POST / 200 284.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:36,942 mnist_classifier_MNISTClassifier 483o5qtx 9293752b-87e7-4398-880b-dcf121da73c9 -- POST / 200 284.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:36,942 mnist_classifier_MNISTClassifier 483o5qtx 3539bf6b-8d77-41b4-bd07-f553617b1259 -- POST / 200 283.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:36,942 mnist_classifier_MNISTClassifier 483o5qtx 22ac5715-5b9e-4a28-849e-fdaf6b8ae110 -- POST / 200 282.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:36,943 mnist_classifier_MNISTClassifier 483o5qtx 28459a44-4d0e-42bf-ada2-ee0240280501 -- POST / 200 280.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:36,943 mnist_classifier_MNISTClassifier 483o5qtx bc809dc2-6fa0-44d8-9c53-5c7645256423 -- POST / 200 279.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:36,943 mnist_classifier_MNISTClassifier 483o5qtx 3240aeb3-5dbe-4fc0-82e3-654a04ec20d9 -- POST / 200 278.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:36,943 mnist_classifier_MNISTClassifier 483o5qtx a15bee6f-ab5e-4c21-abe5-373a42805d97 -- POST / 200 277.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:36,943 mnist_classifier_MNISTClassifier 483o5qtx d5642a88-5583-4907-86be-6a9c8665f309 -- POST / 200 276.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:36,943 mnist_classifier_MNISTClassifier 483o5qtx bab7f404-cda8-4406-acc3-bd76c18f8abb -- POST / 200 275.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:36,943 mnist_classifier_MNISTClassifier 483o5qtx 16c6d725-ec32-46a8-bf3e-5f680313aff0 -- POST / 200 275.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:36,943 mnist_classifier_MNISTClassifier 483o5qtx 1f0bba06-0741-4347-bf89-72e492f42564 -- POST / 200 275.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:36,944 mnist_classifier_MNISTClassifier 483o5qtx 479070ab-ff57-48a7-8216-429a9f76a837 -- POST / 200 265.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:36,944 mnist_classifier_MNISTClassifier 483o5qtx cf67715f-1540-4bca-8800-787c6af2db28 -- POST / 200 263.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:36,944 mnist_classifier_MNISTClassifier 483o5qtx 63786727-3290-41cc-9c73-8888e511b210 -- POST / 200 263.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:36,944 mnist_classifier_MNISTClassifier 483o5qtx 91a6dd5f-e855-4a7d-92bd-b86f16de3164 -- POST / 200 262.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:36,944 mnist_classifier_MNISTClassifier 483o5qtx 1df80f1b-3d50-45fe-b6db-5053e05fe53d -- POST / 200 261.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:36,944 mnist_classifier_MNISTClassifier 483o5qtx a66d8583-c05c-4675-8691-42828c52570c -- POST / 200 260.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:36,944 mnist_classifier_MNISTClassifier 483o5qtx d57ca612-63df-47b5-a6c0-d9fed7a4769e -- POST / 200 260.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:36,944 mnist_classifier_MNISTClassifier 483o5qtx 27b521da-c876-40fe-898e-340a935f8db0 -- POST / 200 259.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:36,945 mnist_classifier_MNISTClassifier 483o5qtx 6fb359be-4f28-4b0a-b9d7-d7ca39076398 -- POST / 200 258.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:37,149 mnist_classifier_MNISTClassifier 483o5qtx 78646987-bcbf-4f06-b90e-55a9223a409f -- POST / 200 378.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:37,165 mnist_classifier_MNISTClassifier 483o5qtx 771f51da-2161-49b8-8505-1e3c18193b36 -- POST / 200 392.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:37,167 mnist_classifier_MNISTClassifier 483o5qtx d3cc1d68-30b4-46be-8f3c-0599c694bf0b -- POST / 200 392.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:37,167 mnist_classifier_MNISTClassifier 483o5qtx f3ab68c5-54e5-486c-bcb1-f3de3bd5fca1 -- POST / 200 392.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:37,172 mnist_classifier_MNISTClassifier 483o5qtx cc421a85-fd9d-4eb4-ba91-fb9093418034 -- POST / 200 396.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:37,172 mnist_classifier_MNISTClassifier 483o5qtx 825534aa-3b42-4fd8-ad3a-fe4d59d8abdc -- POST / 200 395.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:37,172 mnist_classifier_MNISTClassifier 483o5qtx 8c4b9edd-0d08-4aa9-9673-daca2160cafa -- POST / 200 394.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:37,172 mnist_classifier_MNISTClassifier 483o5qtx 8ea7bda0-8e47-42a5-8183-7b5fb89ba492 -- POST / 200 394.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:37,173 mnist_classifier_MNISTClassifier 483o5qtx 5af3771f-0838-4eb2-a8e6-9df571fb076b -- POST / 200 395.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:37,173 mnist_classifier_MNISTClassifier 483o5qtx 05d0439b-ddc2-4b3e-8e42-855c6f617396 -- POST / 200 390.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:37,175 mnist_classifier_MNISTClassifier 483o5qtx 3d43ccee-2db6-4626-bd81-e3407af120b7 -- POST / 200 391.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:37,175 mnist_classifier_MNISTClassifier 483o5qtx aef46b7d-0749-48e7-abae-f418bf2de42c -- POST / 200 391.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:37,328 mnist_classifier_MNISTClassifier 483o5qtx 84c70a8e-97f6-4e7e-8f9c-5d336096ed32 -- POST / 200 452.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:37,329 mnist_classifier_MNISTClassifier 483o5qtx 6f1492b3-faa0-42d8-a3c3-8d6c4dd7da50 -- POST / 200 442.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:37,330 mnist_classifier_MNISTClassifier 483o5qtx 5e6ce1cd-f341-4227-a775-a2e12ac02fc9 -- POST / 200 433.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:37,330 mnist_classifier_MNISTClassifier 483o5qtx 7ba9082c-38a6-42f8-b561-c853d4d1601c -- POST / 200 384.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:37,331 mnist_classifier_MNISTClassifier 483o5qtx d7bb6e5b-a72a-45f3-b743-6500a09ba4c7 -- POST / 200 435.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:37,332 mnist_classifier_MNISTClassifier 483o5qtx a8c8c860-71d2-4a9b-b20c-09acba854e5e -- POST / 200 379.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:37,333 mnist_classifier_MNISTClassifier 483o5qtx df932b51-d32a-4224-a0f9-fe19d075e334 -- POST / 200 383.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:37,334 mnist_classifier_MNISTClassifier 483o5qtx 3cd36201-ae18-4451-97d4-ec92e5496645 -- POST / 200 381.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:37,335 mnist_classifier_MNISTClassifier 483o5qtx 396fbfdc-a015-4ea9-bee1-797516d0f7a4 -- POST / 200 380.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:37,335 mnist_classifier_MNISTClassifier 483o5qtx 696513c7-544c-4223-8b1f-aa9b0a51f888 -- POST / 200 379.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:37,336 mnist_classifier_MNISTClassifier 483o5qtx 43b11f9a-330b-4f17-94b2-21c2177d4808 -- POST / 200 380.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:37,339 mnist_classifier_MNISTClassifier 483o5qtx 4ed7ecd3-18d5-4907-986f-1aae275ae03e -- POST / 200 381.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:37,339 mnist_classifier_MNISTClassifier 483o5qtx 61fa2f95-daf8-48b8-86f4-a618049d1a55 -- POST / 200 380.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:37,340 mnist_classifier_MNISTClassifier 483o5qtx d5a7c28c-ba24-4adb-9c83-494276cfbff3 -- POST / 200 380.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:37,341 mnist_classifier_MNISTClassifier 483o5qtx 5c56eed7-93da-4bf5-846d-86459492f4d8 -- POST / 200 379.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:37,341 mnist_classifier_MNISTClassifier 483o5qtx 8e2c0c27-fc42-40f1-9d90-49100ecbb821 -- POST / 200 380.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:37,341 mnist_classifier_MNISTClassifier 483o5qtx f28f9aef-b2a7-4f41-a27d-b5d5d019d37a -- POST / 200 379.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:37,342 mnist_classifier_MNISTClassifier 483o5qtx 6dfc9e2c-d591-4553-98ce-749553f4ef18 -- POST / 200 374.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:37,342 mnist_classifier_MNISTClassifier 483o5qtx 688963b3-bd79-4391-b913-3c2dab29a0ba -- POST / 200 379.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:37,342 mnist_classifier_MNISTClassifier 483o5qtx 592a47de-a8ef-4219-b080-68cf82ade90e -- POST / 200 375.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:37,342 mnist_classifier_MNISTClassifier 483o5qtx eb3cb833-c42f-49d1-a857-30fc082f5c08 -- POST / 200 378.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:37,343 mnist_classifier_MNISTClassifier 483o5qtx 2abf0dd5-1181-4534-8276-a5c4c6549e87 -- POST / 200 374.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:37,343 mnist_classifier_MNISTClassifier 483o5qtx a9ff9e33-6b8a-4e6b-9b60-b4a13b806a2a -- POST / 200 377.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:37,343 mnist_classifier_MNISTClassifier 483o5qtx fc0ca1e4-1a86-4e3a-bee7-e81c8b8bff07 -- POST / 200 377.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:37,345 mnist_classifier_MNISTClassifier 483o5qtx 7b0008d0-9b96-47ee-8a88-552d69bd712c -- POST / 200 376.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:37,346 mnist_classifier_MNISTClassifier 483o5qtx 23b02fe7-090d-422b-93f4-2e08e65b7d42 -- POST / 200 376.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:37,347 mnist_classifier_MNISTClassifier 483o5qtx 9cff3514-274b-4bba-b655-b29570566130 -- POST / 200 377.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:37,347 mnist_classifier_MNISTClassifier 483o5qtx 1e378885-d257-4772-bbf2-eecd53f68701 -- POST / 200 376.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:37,347 mnist_classifier_MNISTClassifier 483o5qtx b7b9a514-7f97-411a-8de0-813791b18c26 -- POST / 200 375.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:37,348 mnist_classifier_MNISTClassifier 483o5qtx e3070848-52b9-4267-9054-cfafdab6970c -- POST / 200 375.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:37,348 mnist_classifier_MNISTClassifier 483o5qtx 246b5d91-bfcc-4f58-95be-80f378d83b5e -- POST / 200 374.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:37,348 mnist_classifier_MNISTClassifier 483o5qtx eb7c2aeb-fdf0-45ee-8b79-efd8f4f32f97 -- POST / 200 374.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:37,348 mnist_classifier_MNISTClassifier 483o5qtx 21fd5a03-0f78-477d-bdf5-b13558753be9 -- POST / 200 363.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:37,349 mnist_classifier_MNISTClassifier 483o5qtx 4481c268-25a6-4c4e-9ca4-2fb4aad5063a -- POST / 200 372.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:37,350 mnist_classifier_MNISTClassifier 483o5qtx f9c27af8-6cae-4c44-bea2-57e0daafa0dd -- POST / 200 376.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:37,351 mnist_classifier_MNISTClassifier 483o5qtx de63681a-f3e8-4bba-9cfa-4127c07b7e6a -- POST / 200 362.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:37,351 mnist_classifier_MNISTClassifier 483o5qtx a6ffe2ac-14d9-4c3d-903c-0e0b4f9b8ebb -- POST / 200 374.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:37,352 mnist_classifier_MNISTClassifier 483o5qtx 21d9e2be-3dd3-415b-8c7d-390c5ebc2f61 -- POST / 200 373.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:37,353 mnist_classifier_MNISTClassifier 483o5qtx 073e8a4f-ee85-4725-aec2-49791e206aa3 -- POST / 200 372.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:37,354 mnist_classifier_MNISTClassifier 483o5qtx 9d9fb77c-b423-43f0-a574-189caf1998c9 -- POST / 200 372.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:37,354 mnist_classifier_MNISTClassifier 483o5qtx 45dc070e-d479-4b99-ab2b-c03e4927b82f -- POST / 200 365.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:37,354 mnist_classifier_MNISTClassifier 483o5qtx 03890fad-5137-499f-b989-f9b9aa3889a2 -- POST / 200 354.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:37,355 mnist_classifier_MNISTClassifier 483o5qtx 9eabc7ea-87ea-416e-b971-7cd03c0f1385 -- POST / 200 364.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:37,355 mnist_classifier_MNISTClassifier 483o5qtx 85b4173f-7174-48c0-ab12-8bad7856249c -- POST / 200 353.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:37,355 mnist_classifier_MNISTClassifier 483o5qtx 034f5af8-708e-4ff9-94d7-cf76f1162a58 -- POST / 200 364.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:37,356 mnist_classifier_MNISTClassifier 483o5qtx 489828aa-f9e0-44ba-a2f2-9c0e8429f3ec -- POST / 200 212.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:37,356 mnist_classifier_MNISTClassifier 483o5qtx 91e037f6-9ce1-4225-acd7-38df2a40ce5a -- POST / 200 210.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:37,357 mnist_classifier_MNISTClassifier 483o5qtx 8ab897a0-4495-4395-9d54-3cc9604c982b -- POST / 200 211.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:37,358 mnist_classifier_MNISTClassifier 483o5qtx f0dc940e-ce15-46e7-bf86-700025e16c97 -- POST / 200 212.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:37,359 mnist_classifier_MNISTClassifier 483o5qtx 9023aa69-a3f3-4c86-9c09-700b9e9f19a9 -- POST / 200 213.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:37,359 mnist_classifier_MNISTClassifier 483o5qtx 1230a309-5f3a-4455-81ad-699cb4b9916b -- POST / 200 212.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:37,360 mnist_classifier_MNISTClassifier 483o5qtx e0fdd108-a8ab-46bc-83ef-c77cebc50054 -- POST / 200 213.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:37,360 mnist_classifier_MNISTClassifier 483o5qtx 699a09c1-5e0d-4395-88bd-82bfe9f7e32b -- POST / 200 213.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:37,361 mnist_classifier_MNISTClassifier 483o5qtx 501efcaa-bcde-46ac-907b-91dec89b62ba -- POST / 200 213.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:37,361 mnist_classifier_MNISTClassifier 483o5qtx 64723248-9b58-420b-9d63-ff07498bc673 -- POST / 200 214.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:37,361 mnist_classifier_MNISTClassifier 483o5qtx d9198a3b-4c49-4240-b75a-91f4b7e6e79c -- POST / 200 213.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:37,362 mnist_classifier_MNISTClassifier 483o5qtx 37ee0133-770f-49e0-a926-937a012b7ecd -- POST / 200 214.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:37,362 mnist_classifier_MNISTClassifier 483o5qtx 42001bca-0160-4ffe-8ad1-ebb43d771ead -- POST / 200 214.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:37,362 mnist_classifier_MNISTClassifier 483o5qtx 95c90413-17fe-4fa1-8100-39922fa7160e -- POST / 200 214.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:37,365 mnist_classifier_MNISTClassifier 483o5qtx b49f5c20-10e8-4c53-a75d-7cc3185958b3 -- POST / 200 216.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:37,373 mnist_classifier_MNISTClassifier 483o5qtx 0a6584be-3944-492d-a8a4-00f95569fbe6 -- POST / 200 224.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:37,375 mnist_classifier_MNISTClassifier 483o5qtx 91cea9bf-e8ce-452f-b917-30262fff386c -- POST / 200 226.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:37,376 mnist_classifier_MNISTClassifier 483o5qtx 314dabf8-3ea3-4131-8f73-68e8e1149283 -- POST / 200 227.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:37,382 mnist_classifier_MNISTClassifier 483o5qtx 5cc8eef2-bcb1-45b4-8f73-f467a3b2e444 -- POST / 200 233.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:37,384 mnist_classifier_MNISTClassifier 483o5qtx c28e70e7-f58f-46a3-be53-9687d21ab59c -- POST / 200 235.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:37,385 mnist_classifier_MNISTClassifier 483o5qtx ebe53c7e-f7bd-4c85-a2f7-8561cff5c517 -- POST / 200 235.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:37,385 mnist_classifier_MNISTClassifier 483o5qtx f0545fa6-36ba-4f60-b0d4-61276024e5d9 -- POST / 200 218.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:37,387 mnist_classifier_MNISTClassifier 483o5qtx c123ccb8-60cd-443e-893f-4a21df7c0b1b -- POST / 200 207.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:37,387 mnist_classifier_MNISTClassifier 483o5qtx aae5fba8-d462-4550-9a47-734dd6674fc0 -- POST / 200 206.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:37,387 mnist_classifier_MNISTClassifier 483o5qtx 2d2d310b-baab-4f65-b345-db9a7745ee0a -- POST / 200 205.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:37,387 mnist_classifier_MNISTClassifier 483o5qtx 43d7b606-3121-45c7-ba8f-1f4f34420d99 -- POST / 200 205.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:37,388 mnist_classifier_MNISTClassifier 483o5qtx e28780da-8c87-4f65-b810-c0a2090ad78f -- POST / 200 203.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:37,432 mnist_classifier_MNISTClassifier 483o5qtx 7e5231bf-aa8b-425e-85af-483661e30a7a -- POST / 200 248.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:37,464 mnist_classifier_MNISTClassifier 483o5qtx c2085860-2b0d-4435-92e0-c6b04889de24 -- POST / 200 279.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:37,465 mnist_classifier_MNISTClassifier 483o5qtx 22338764-3beb-46f5-ad0a-c15002fc9393 -- POST / 200 280.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:37,465 mnist_classifier_MNISTClassifier 483o5qtx 64fad84a-d624-48c0-985f-b8f41ec279ee -- POST / 200 279.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:37,466 mnist_classifier_MNISTClassifier 483o5qtx 59d98159-53a0-4987-ab7f-6253aa3057bb -- POST / 200 279.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:37,466 mnist_classifier_MNISTClassifier 483o5qtx 49d793da-e681-4a9f-b289-81bb18cb7b40 -- POST / 200 279.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:37,466 mnist_classifier_MNISTClassifier 483o5qtx 74681560-4be9-4bb8-aed1-54d5ec3f3eda -- POST / 200 278.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:37,466 mnist_classifier_MNISTClassifier 483o5qtx ba4942b4-ef96-43c3-ac94-9ca509aaa901 -- POST / 200 277.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:37,466 mnist_classifier_MNISTClassifier 483o5qtx 4f4bd92d-a818-4edf-86b2-aceb575615e6 -- POST / 200 276.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:37,466 mnist_classifier_MNISTClassifier 483o5qtx defda67e-bf91-4ee5-9a5c-e5ab359ac180 -- POST / 200 272.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:37,466 mnist_classifier_MNISTClassifier 483o5qtx 9519c94d-e65b-43bb-8155-f99a51b22b63 -- POST / 200 272.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:37,467 mnist_classifier_MNISTClassifier 483o5qtx 12110672-b89d-48d8-bdf4-04a42ae169dc -- POST / 200 271.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:37,469 mnist_classifier_MNISTClassifier 483o5qtx 6d41bf26-ba36-4fa7-a192-fec2f5d49706 -- POST / 200 266.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:37,470 mnist_classifier_MNISTClassifier 483o5qtx 17f71e1a-f2b3-491f-a723-2ebdcebacf9e -- POST / 200 268.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:37,471 mnist_classifier_MNISTClassifier 483o5qtx 15896b82-87fe-4bf1-8682-f9822922f433 -- POST / 200 266.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:37,472 mnist_classifier_MNISTClassifier 483o5qtx 577c71c0-ae9e-41ec-b703-932dedfe9017 -- POST / 200 267.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:37,473 mnist_classifier_MNISTClassifier 483o5qtx 202fdc49-26a2-4d45-9aac-ae08ecc5d058 -- POST / 200 265.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:37,473 mnist_classifier_MNISTClassifier 483o5qtx 9a2f00f6-4bc1-4b45-90c6-fb59be295a7d -- POST / 200 263.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:37,473 mnist_classifier_MNISTClassifier 483o5qtx 40e7a963-a6b9-4643-b506-30c0d00e7d46 -- POST / 200 265.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:37,474 mnist_classifier_MNISTClassifier 483o5qtx 1f7b6956-c636-41d8-8897-09678c0d15fc -- POST / 200 260.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:37,474 mnist_classifier_MNISTClassifier 483o5qtx ab5a1bf1-04b3-4d0d-a6ff-47410f9c807d -- POST / 200 260.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:37,475 mnist_classifier_MNISTClassifier 483o5qtx 080671ce-e69a-4fcb-ac2d-e51d5afdb5b1 -- POST / 200 258.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:37,475 mnist_classifier_MNISTClassifier 483o5qtx 41494dd1-8e0f-4bd1-858e-5a35806063c5 -- POST / 200 257.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:37,476 mnist_classifier_MNISTClassifier 483o5qtx 51e36c5d-b3ff-4f89-9de1-20cd849f402f -- POST / 200 257.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:37,476 mnist_classifier_MNISTClassifier 483o5qtx 2acc0135-c86d-45e8-811c-3ee285d1da7a -- POST / 200 256.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:37,476 mnist_classifier_MNISTClassifier 483o5qtx f3fa37dc-fdaf-464f-a83a-83aa913a4f73 -- POST / 200 257.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:37,479 mnist_classifier_MNISTClassifier 483o5qtx f3e59d38-f04e-450c-a8aa-e4770efe70b5 -- POST / 200 260.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:37,479 mnist_classifier_MNISTClassifier 483o5qtx b4e39b29-7422-43e7-b02f-9e9ed35d8727 -- POST / 200 259.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:37,589 mnist_classifier_MNISTClassifier 483o5qtx a13e987c-5fad-43c8-98e9-ea266fcb267b -- POST / 200 256.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:37,596 mnist_classifier_MNISTClassifier 483o5qtx dcba8576-8f72-4482-a1a8-83c0bc7a0905 -- POST / 200 266.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:37,597 mnist_classifier_MNISTClassifier 483o5qtx c27b8090-c771-4730-a9b4-0d2a2a11a619 -- POST / 200 260.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:37,597 mnist_classifier_MNISTClassifier 483o5qtx 10df47b1-f5c4-4445-97c3-e38707da670c -- POST / 200 252.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:37,599 mnist_classifier_MNISTClassifier 483o5qtx 8419bd96-ba9d-4eaa-9532-74552f6384bf -- POST / 200 249.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:37,599 mnist_classifier_MNISTClassifier 483o5qtx 98f1b88a-13e7-4fcf-99ce-6a07b8705c73 -- POST / 200 241.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:37,600 mnist_classifier_MNISTClassifier 483o5qtx 1f78272c-6461-4bf5-bf07-68cedf2192e4 -- POST / 200 227.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:37,601 mnist_classifier_MNISTClassifier 483o5qtx 1cb8b09b-ba80-46b4-9e70-498716069265 -- POST / 200 212.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:37,602 mnist_classifier_MNISTClassifier 483o5qtx 5271e332-f0fa-47cc-9158-42dc695375ba -- POST / 200 211.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:37,602 mnist_classifier_MNISTClassifier 483o5qtx 3c40c685-fe34-4eac-9141-fa186e45226a -- POST / 200 209.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:37,605 mnist_classifier_MNISTClassifier 483o5qtx f42dd726-0196-4e43-8e7d-2ccb380841fb -- POST / 200 212.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:37,606 mnist_classifier_MNISTClassifier 483o5qtx 8732147d-2e24-4818-819b-79e13779536d -- POST / 200 211.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:37,606 mnist_classifier_MNISTClassifier 483o5qtx 11e23682-5659-48a1-a2c4-f841910933cb -- POST / 200 210.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:37,606 mnist_classifier_MNISTClassifier 483o5qtx 38d297b8-9f08-4399-af3d-2cca00124305 -- POST / 200 209.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:37,608 mnist_classifier_MNISTClassifier 483o5qtx 3ed0b524-4646-46d4-95f2-23d30169e8fc -- POST / 200 211.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:37,608 mnist_classifier_MNISTClassifier 483o5qtx 1770ae60-a27c-4271-a8cf-4b9e9a19daa1 -- POST / 200 206.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:37,609 mnist_classifier_MNISTClassifier 483o5qtx e6c40d42-24ef-41c8-8e89-eac3fa0f8802 -- POST / 200 207.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:37,610 mnist_classifier_MNISTClassifier 483o5qtx 0010abd8-5c3d-41ae-a9b1-1e5241c8294b -- POST / 200 206.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:37,611 mnist_classifier_MNISTClassifier 483o5qtx 5656236e-506c-4925-8112-3b558e8e5013 -- POST / 200 206.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:37,611 mnist_classifier_MNISTClassifier 483o5qtx 5e1231c0-b1c9-4fbc-b6dd-394037390062 -- POST / 200 206.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:37,611 mnist_classifier_MNISTClassifier 483o5qtx 06914bcd-50ee-4c2d-8c5f-2026b3a356e7 -- POST / 200 206.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:37,612 mnist_classifier_MNISTClassifier 483o5qtx 4a5c21ee-ab3a-40c4-a3a6-f80d88b683e0 -- POST / 200 203.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:37,613 mnist_classifier_MNISTClassifier 483o5qtx 429ae69f-c45f-4bcb-ab2e-b73a74afb846 -- POST / 200 202.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:37,613 mnist_classifier_MNISTClassifier 483o5qtx 6ec50328-7504-4244-b29e-394f4a5e5a02 -- POST / 200 204.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:37,614 mnist_classifier_MNISTClassifier 483o5qtx 89442899-8bc7-44a1-8bdf-a08bfaa32ccc -- POST / 200 209.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:37,614 mnist_classifier_MNISTClassifier 483o5qtx 935373cf-de6a-4873-accf-03cff1b53d72 -- POST / 200 202.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:37,614 mnist_classifier_MNISTClassifier 483o5qtx 0e795d83-0410-403e-9b74-c6a335a16e56 -- POST / 200 194.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:37,615 mnist_classifier_MNISTClassifier 483o5qtx e701bf6a-eeb3-426c-9cf3-9e158c596713 -- POST / 200 193.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:37,615 mnist_classifier_MNISTClassifier 483o5qtx bcbb9315-da3e-4115-beb5-464fce7bcf7c -- POST / 200 193.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:37,615 mnist_classifier_MNISTClassifier 483o5qtx 84c74848-362d-4966-ac07-758f3910ff07 -- POST / 200 192.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:37,616 mnist_classifier_MNISTClassifier 483o5qtx f078a197-2136-43bb-9c92-7e7072453984 -- POST / 200 152.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:37,616 mnist_classifier_MNISTClassifier 483o5qtx ab4fa820-5855-4ffa-8bd2-67b54c732378 -- POST / 200 134.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:37,759 mnist_classifier_MNISTClassifier 483o5qtx ef478efa-cb30-4282-b709-b005fbbf441d -- POST / 200 275.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:37,770 mnist_classifier_MNISTClassifier 483o5qtx 613af168-7ba2-4b59-a7d6-db6b1a060f28 -- POST / 200 284.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:37,770 mnist_classifier_MNISTClassifier 483o5qtx 1faf9ef1-c36f-41bf-abfd-d842e5c2f9f4 -- POST / 200 284.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:37,770 mnist_classifier_MNISTClassifier 483o5qtx 1c1bcba7-73f9-4b31-9e59-a6eff4f2dfd1 -- POST / 200 279.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:37,771 mnist_classifier_MNISTClassifier 483o5qtx bfbe8135-64b3-425f-8ddb-3b87f1f20768 -- POST / 200 284.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:37,771 mnist_classifier_MNISTClassifier 483o5qtx 7b2596c7-8b93-474b-9164-536750bf72cb -- POST / 200 284.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:37,771 mnist_classifier_MNISTClassifier 483o5qtx 375b3d4e-6562-42cc-b8bb-e2ff78ed9ecd -- POST / 200 283.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:37,771 mnist_classifier_MNISTClassifier 483o5qtx e2fcbd79-4a09-4c27-8ed5-cbdedcdcc3d1 -- POST / 200 283.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:37,772 mnist_classifier_MNISTClassifier 483o5qtx ed399a43-cac4-46a2-a1cf-805ee34c9497 -- POST / 200 274.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:37,772 mnist_classifier_MNISTClassifier 483o5qtx 56e943f5-bcfc-4c0f-8694-5f894549e976 -- POST / 200 270.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:37,772 mnist_classifier_MNISTClassifier 483o5qtx b93b3632-19bd-43a8-8217-37ba0f8e3202 -- POST / 200 261.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:37,773 mnist_classifier_MNISTClassifier 483o5qtx e8f711b7-4dd7-40db-a59e-bd956f93d1e1 -- POST / 200 262.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:37,773 mnist_classifier_MNISTClassifier 483o5qtx 7a964cf4-fbf0-451d-bfad-e145dc0faf7f -- POST / 200 261.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:37,773 mnist_classifier_MNISTClassifier 483o5qtx 49a72360-baa6-4164-9fcf-2478865cfbf3 -- POST / 200 262.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:37,773 mnist_classifier_MNISTClassifier 483o5qtx 47b19596-a60f-4a0d-924b-a7f4c3074f52 -- POST / 200 262.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:37,774 mnist_classifier_MNISTClassifier 483o5qtx 8b8a5542-6204-4db8-9ac7-c619dc01c444 -- POST / 200 261.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:37,774 mnist_classifier_MNISTClassifier 483o5qtx bec451f5-8feb-4eff-866a-65390cb4d536 -- POST / 200 262.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:37,774 mnist_classifier_MNISTClassifier 483o5qtx 43668bfb-cdc4-454a-9bda-d964b193a1ba -- POST / 200 262.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:37,774 mnist_classifier_MNISTClassifier 483o5qtx abe3cfda-e22e-4a7b-b6af-1efe90863c80 -- POST / 200 262.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:37,775 mnist_classifier_MNISTClassifier 483o5qtx 416f3f26-167c-4e16-84a4-09e86abad12a -- POST / 200 262.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:37,775 mnist_classifier_MNISTClassifier 483o5qtx cd5536bd-926c-4bb0-b193-f7f1d78f19f5 -- POST / 200 262.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:37,775 mnist_classifier_MNISTClassifier 483o5qtx a5bf5986-4ac5-4dfb-8c50-4195cdea1659 -- POST / 200 262.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:37,775 mnist_classifier_MNISTClassifier 483o5qtx 39181a71-2206-445e-926c-b4315f0378f7 -- POST / 200 262.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:37,776 mnist_classifier_MNISTClassifier 483o5qtx 2e7d7422-3ae9-45f0-a7b5-03e0dd13fef5 -- POST / 200 262.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:37,776 mnist_classifier_MNISTClassifier 483o5qtx 0be6aa29-6934-4877-97ec-b583c72cd6bb -- POST / 200 261.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:37,776 mnist_classifier_MNISTClassifier 483o5qtx 66e4af5f-af27-4f21-9ce0-9dc00a116edc -- POST / 200 261.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:37,777 mnist_classifier_MNISTClassifier 483o5qtx eec1f20e-c3b4-4214-b4fc-430937896c90 -- POST / 200 257.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:37,781 mnist_classifier_MNISTClassifier 483o5qtx 335984c7-5432-4ac8-8bcc-f62da3baa7ca -- POST / 200 263.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:37,781 mnist_classifier_MNISTClassifier 483o5qtx 21b40db7-89ab-451f-8199-8ef12328b9f9 -- POST / 200 261.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:37,781 mnist_classifier_MNISTClassifier 483o5qtx ef3a9492-e6a4-4272-81be-63f43eb78020 -- POST / 200 264.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:37,781 mnist_classifier_MNISTClassifier 483o5qtx 4fcd4ea9-72c8-4068-9aeb-354050ca50f7 -- POST / 200 260.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:37,782 mnist_classifier_MNISTClassifier 483o5qtx 9bf80d63-200f-4f6e-afa2-cbd07dd297b1 -- POST / 200 260.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:37,782 mnist_classifier_MNISTClassifier 483o5qtx f5fd1832-6e55-4d77-90e2-e266ac8cf37c -- POST / 200 260.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:37,783 mnist_classifier_MNISTClassifier 483o5qtx ff98c001-4e49-4997-acab-b22168cd28e5 -- POST / 200 260.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:37,783 mnist_classifier_MNISTClassifier 483o5qtx 90da51f8-c791-4627-a85e-9446e8e28a28 -- POST / 200 260.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:37,784 mnist_classifier_MNISTClassifier 483o5qtx 5d94f5f9-8a3e-4ae1-b4d1-9f5f44dc3293 -- POST / 200 238.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:37,784 mnist_classifier_MNISTClassifier 483o5qtx 69b9887e-ec5f-452d-adc0-91266129e5d8 -- POST / 200 257.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:37,785 mnist_classifier_MNISTClassifier 483o5qtx ed0ec283-77a3-42b3-b8e7-fd2f72daf1f7 -- POST / 200 247.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:37,785 mnist_classifier_MNISTClassifier 483o5qtx 7a4aefc2-cc93-4b67-9309-2079e8b32b5f -- POST / 200 244.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:37,786 mnist_classifier_MNISTClassifier 483o5qtx 27f0dc2a-4e70-4eb6-a029-38b359f9b3f1 -- POST / 200 245.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:37,786 mnist_classifier_MNISTClassifier 483o5qtx adaa107a-50c7-48ea-b88f-7756caf92ca9 -- POST / 200 263.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:37,787 mnist_classifier_MNISTClassifier 483o5qtx 7aeab46a-4ced-4c54-8c81-87b3f788a520 -- POST / 200 263.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:37,787 mnist_classifier_MNISTClassifier 483o5qtx bcd310da-1c9a-485a-880b-61103600a576 -- POST / 200 262.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:37,787 mnist_classifier_MNISTClassifier 483o5qtx e67f8866-fea9-4842-8d75-85407291bcd1 -- POST / 200 261.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:37,788 mnist_classifier_MNISTClassifier 483o5qtx 7614d775-241a-4927-a373-11c2a0d0d1e5 -- POST / 200 240.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:37,788 mnist_classifier_MNISTClassifier 483o5qtx e38e962a-61be-4a1e-a7dc-47c33428e4df -- POST / 200 240.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:37,789 mnist_classifier_MNISTClassifier 483o5qtx 70f0e6ef-e150-41d0-9fab-50ca96cd9678 -- POST / 200 240.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:37,789 mnist_classifier_MNISTClassifier 483o5qtx a28cc4c3-c99b-4e62-aed9-38959da00838 -- POST / 200 240.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:37,794 mnist_classifier_MNISTClassifier 483o5qtx 3cb2ec30-7a47-4ce3-9a6a-cab9d38b0000 -- POST / 200 243.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:37,794 mnist_classifier_MNISTClassifier 483o5qtx 04af2f8d-c8a4-4716-b481-1d03e5741580 -- POST / 200 238.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:37,796 mnist_classifier_MNISTClassifier 483o5qtx 3319b1e7-44a9-40c2-8cec-16efbc3d93f9 -- POST / 200 239.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:37,796 mnist_classifier_MNISTClassifier 483o5qtx 67285854-c4c8-43f9-999b-edbcd48fe894 -- POST / 200 238.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:37,797 mnist_classifier_MNISTClassifier 483o5qtx 4c2ccce2-f8d8-4ad7-a905-b043809777e0 -- POST / 200 238.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:37,798 mnist_classifier_MNISTClassifier 483o5qtx 9365a57e-095f-40b2-89df-7a73387b2ddf -- POST / 200 239.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:37,800 mnist_classifier_MNISTClassifier 483o5qtx 94fb7b81-d6b1-4317-b2c4-f5c2ba225ae6 -- POST / 200 240.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:37,802 mnist_classifier_MNISTClassifier 483o5qtx d53b78ba-0ae8-4263-b0ab-5ab4384fc0f6 -- POST / 200 241.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:37,802 mnist_classifier_MNISTClassifier 483o5qtx 063c79e6-0d9d-42b3-bd81-f0ad9a54f9ab -- POST / 200 241.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:37,804 mnist_classifier_MNISTClassifier 483o5qtx bef70a17-d1cd-4dfe-aee8-9c6a9c091a95 -- POST / 200 242.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:37,804 mnist_classifier_MNISTClassifier 483o5qtx c6c7c6ac-6b87-427d-9e84-50d69c4a7734 -- POST / 200 242.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:37,805 mnist_classifier_MNISTClassifier 483o5qtx e2ce5431-9df7-464a-9d4b-8fb1a7d731fd -- POST / 200 242.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:37,805 mnist_classifier_MNISTClassifier 483o5qtx 79f4e42c-719d-4b32-9678-df5ea77bdb67 -- POST / 200 239.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,025 mnist_classifier_MNISTClassifier 483o5qtx 4279653b-02fd-46ac-9680-b78cbdf9ccec -- POST / 200 454.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,028 mnist_classifier_MNISTClassifier 483o5qtx 4d76134b-2124-4693-8386-5c0d81f85fee -- POST / 200 461.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,028 mnist_classifier_MNISTClassifier 483o5qtx daa35a1a-cfab-4dd3-9e02-3a236cf19f13 -- POST / 200 460.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,029 mnist_classifier_MNISTClassifier 483o5qtx 48cf7b8f-e6a0-4870-a981-ba4a853822e5 -- POST / 200 459.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,029 mnist_classifier_MNISTClassifier 483o5qtx 8a938e7a-78e6-4b18-acb8-cc3febc696ad -- POST / 200 458.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,030 mnist_classifier_MNISTClassifier 483o5qtx 1c4a5e33-c20a-4d30-951c-c24cf2154e8a -- POST / 200 458.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,030 mnist_classifier_MNISTClassifier 483o5qtx 255220b4-c443-4d65-96ad-8471b3088e48 -- POST / 200 456.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,033 mnist_classifier_MNISTClassifier 483o5qtx c8704469-1dfb-402b-9a81-71f43f96c49c -- POST / 200 390.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,033 mnist_classifier_MNISTClassifier 483o5qtx 7fc29531-e321-41f9-b517-a17d9b2ae25f -- POST / 200 390.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,033 mnist_classifier_MNISTClassifier 483o5qtx a80b270e-242c-43bb-97fa-a3b4ac7b4212 -- POST / 200 390.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,034 mnist_classifier_MNISTClassifier 483o5qtx 33445eb1-4254-4e4d-93aa-67d25532a6f1 -- POST / 200 390.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,034 mnist_classifier_MNISTClassifier 483o5qtx 26e62fc8-ec8c-43ea-a619-0a50690f3824 -- POST / 200 390.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,035 mnist_classifier_MNISTClassifier 483o5qtx 7467cc8b-166b-4b23-a827-51cf7f3361a1 -- POST / 200 387.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,036 mnist_classifier_MNISTClassifier 483o5qtx e108b187-3a75-4158-8fe3-9360a059c5bc -- POST / 200 387.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,036 mnist_classifier_MNISTClassifier 483o5qtx c8f3f156-35da-4dce-91ad-01938fb6b938 -- POST / 200 387.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,037 mnist_classifier_MNISTClassifier 483o5qtx 8e58cb23-035d-4a73-bf85-7592a406048c -- POST / 200 385.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,038 mnist_classifier_MNISTClassifier 483o5qtx 3b5fcd02-2a55-4e87-9f37-cffdacae4d3a -- POST / 200 385.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,040 mnist_classifier_MNISTClassifier 483o5qtx bc839bcc-899a-4626-9940-f9c4722709d7 -- POST / 200 385.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,042 mnist_classifier_MNISTClassifier 483o5qtx 31c267e7-8541-493e-abc2-db2bd8201e84 -- POST / 200 386.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,042 mnist_classifier_MNISTClassifier 483o5qtx afbf67dc-5c3b-4cde-aa30-2e9ffaff8c80 -- POST / 200 386.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,043 mnist_classifier_MNISTClassifier 483o5qtx 6066ca2c-d764-44f6-a27b-690d7435beca -- POST / 200 379.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,043 mnist_classifier_MNISTClassifier 483o5qtx 54d4da91-2773-4e60-beff-e4494e9ff56c -- POST / 200 377.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,043 mnist_classifier_MNISTClassifier 483o5qtx 56df99d3-b8f9-4092-8c84-94c59baad5aa -- POST / 200 377.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,044 mnist_classifier_MNISTClassifier 483o5qtx 0c2aa97e-3066-4e56-8a15-e7b01c9fdeab -- POST / 200 373.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,044 mnist_classifier_MNISTClassifier 483o5qtx 90cc700b-7b90-48f2-9fce-0f23a6ef5c8a -- POST / 200 372.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,044 mnist_classifier_MNISTClassifier 483o5qtx 592ae640-ec5c-4757-b443-b87dd5ea19c0 -- POST / 200 371.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,045 mnist_classifier_MNISTClassifier 483o5qtx 62c5a950-9a99-43cd-9ecc-4493548238f0 -- POST / 200 371.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,047 mnist_classifier_MNISTClassifier 483o5qtx 0ea907ad-e2a3-4c52-83b6-128a3f5ed372 -- POST / 200 370.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,050 mnist_classifier_MNISTClassifier 483o5qtx 5396767f-29be-4465-9815-1a9673e69f07 -- POST / 200 373.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,056 mnist_classifier_MNISTClassifier 483o5qtx 70dc9508-4300-45f9-a54f-f10ba123062b -- POST / 200 378.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,057 mnist_classifier_MNISTClassifier 483o5qtx 37d33b40-33b8-4720-b25d-c7d3d81b33b7 -- POST / 200 376.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,058 mnist_classifier_MNISTClassifier 483o5qtx 0ebbbac5-a921-4c8f-824b-7baf0dd5f82d -- POST / 200 376.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,059 mnist_classifier_MNISTClassifier 483o5qtx 5315868c-b2c2-4fa8-844b-5414b8c8cdf4 -- POST / 200 376.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,059 mnist_classifier_MNISTClassifier 483o5qtx c2a2a923-15d2-4176-88d7-8ce6f672cbbe -- POST / 200 374.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,060 mnist_classifier_MNISTClassifier 483o5qtx 9f053a7b-f2e9-445d-b740-294f9d4fa4f3 -- POST / 200 372.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,060 mnist_classifier_MNISTClassifier 483o5qtx 23c89bca-a2d7-4818-bc89-1e4e93b37cf5 -- POST / 200 372.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,061 mnist_classifier_MNISTClassifier 483o5qtx baaf814c-052c-4d90-b016-8955cf12491e -- POST / 200 371.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,061 mnist_classifier_MNISTClassifier 483o5qtx b50eafa3-867a-4924-9eb4-f17624ebce0a -- POST / 200 372.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,062 mnist_classifier_MNISTClassifier 483o5qtx cee0e160-37d0-4e16-a117-8636050cbce6 -- POST / 200 370.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,062 mnist_classifier_MNISTClassifier 483o5qtx 59435574-bab8-486a-b7f5-53d1975a6280 -- POST / 200 318.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,155 mnist_classifier_MNISTClassifier 483o5qtx 2ae82344-c75c-4c31-bc36-4a334e7ae51a -- POST / 200 406.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,159 mnist_classifier_MNISTClassifier 483o5qtx aa3d71c2-21a2-4f01-b767-cdc67bb40faa -- POST / 200 407.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,159 mnist_classifier_MNISTClassifier 483o5qtx d6e1e01e-be45-4443-8e96-b26a22585876 -- POST / 200 407.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,161 mnist_classifier_MNISTClassifier 483o5qtx 63819e19-9563-499b-8afc-3ee18ae25514 -- POST / 200 380.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,161 mnist_classifier_MNISTClassifier 483o5qtx 82116928-dab5-49ac-86a6-667a4d2a167e -- POST / 200 349.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,162 mnist_classifier_MNISTClassifier 483o5qtx 8fb32d33-6db6-408a-8da3-3501bc326531 -- POST / 200 358.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,164 mnist_classifier_MNISTClassifier 483o5qtx 27e2ead1-2f1a-4b53-aaf7-b3e45769f47f -- POST / 200 360.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,165 mnist_classifier_MNISTClassifier 483o5qtx 0294bccc-1ea6-4306-b222-7e0bea92f337 -- POST / 200 358.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,165 mnist_classifier_MNISTClassifier 483o5qtx 3aa45bc9-397e-440d-88db-030b722f0361 -- POST / 200 351.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,166 mnist_classifier_MNISTClassifier 483o5qtx 71ca5834-c794-4da8-b515-85351d23b331 -- POST / 200 350.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,166 mnist_classifier_MNISTClassifier 483o5qtx 6d0ed109-8e51-4203-9db0-66134229c1ae -- POST / 200 349.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,167 mnist_classifier_MNISTClassifier 483o5qtx bc704cc8-e756-40e4-b2e4-04e04629cae7 -- POST / 200 349.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,170 mnist_classifier_MNISTClassifier 483o5qtx 51afb44f-5266-4040-9227-2264da14974a -- POST / 200 349.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,176 mnist_classifier_MNISTClassifier 483o5qtx 5b6d041c-9ad4-446e-8dd6-cff4d5af6e39 -- POST / 200 362.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,177 mnist_classifier_MNISTClassifier 483o5qtx 1a15b0b8-d129-47b5-abbb-30f3f33bfbba -- POST / 200 356.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,179 mnist_classifier_MNISTClassifier 483o5qtx c10cb8df-507c-47c8-84db-6f88c44049e8 -- POST / 200 356.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,180 mnist_classifier_MNISTClassifier 483o5qtx 9987ef91-89b8-4eca-b9e3-6c695a618ddc -- POST / 200 355.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,182 mnist_classifier_MNISTClassifier 483o5qtx bca5fe48-a637-4fdb-b9c4-3b5a9495b798 -- POST / 200 357.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,183 mnist_classifier_MNISTClassifier 483o5qtx ea4c003a-62cd-4f4f-8248-d3b2fdc30fd3 -- POST / 200 358.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,185 mnist_classifier_MNISTClassifier 483o5qtx 1d716c28-1823-467b-a0d7-e3e1542daf4c -- POST / 200 360.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,186 mnist_classifier_MNISTClassifier 483o5qtx 4d7fa006-805b-4288-bcbc-40b9ba8c0f49 -- POST / 200 361.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,187 mnist_classifier_MNISTClassifier 483o5qtx 44f3dd83-610e-4c9b-a9d2-9a1f0b49c1bd -- POST / 200 361.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,188 mnist_classifier_MNISTClassifier 483o5qtx 700c3526-f8a5-4c5b-9ff1-7f3f44f8c3ff -- POST / 200 362.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,189 mnist_classifier_MNISTClassifier 483o5qtx 85312e40-ddf0-4cb0-b608-9b7def78409c -- POST / 200 361.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,281 mnist_classifier_MNISTClassifier 483o5qtx 74212fff-e841-46bb-b78c-09868ca40fa1 -- POST / 200 452.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,286 mnist_classifier_MNISTClassifier 483o5qtx 489ac0a7-7691-417c-b54d-302dbe3206ca -- POST / 200 455.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,287 mnist_classifier_MNISTClassifier 483o5qtx 120ad79d-66ab-4604-bd4f-9d9981fb4b2b -- POST / 200 456.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,289 mnist_classifier_MNISTClassifier 483o5qtx 2d02204b-0704-42e9-825c-a39b40f529da -- POST / 200 457.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,290 mnist_classifier_MNISTClassifier 483o5qtx b4d40824-46a4-414c-8b69-f0a08abf364f -- POST / 200 460.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,292 mnist_classifier_MNISTClassifier 483o5qtx 8910efdd-6649-4331-afa0-43dc51d73f8c -- POST / 200 460.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,294 mnist_classifier_MNISTClassifier 483o5qtx 20531fe3-8df5-4adf-a996-decea925b697 -- POST / 200 461.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,294 mnist_classifier_MNISTClassifier 483o5qtx 684f2817-59bd-4069-b1d9-846933502910 -- POST / 200 453.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,296 mnist_classifier_MNISTClassifier 483o5qtx 3fc64ca0-6edc-4bc4-b1ed-8297c9264b8e -- POST / 200 463.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,302 mnist_classifier_MNISTClassifier 483o5qtx b695e379-d9e7-4b3f-a734-1ceb189934a5 -- POST / 200 467.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,306 mnist_classifier_MNISTClassifier 483o5qtx 5da4bb4a-9731-4d88-b914-3f8e8990b161 -- POST / 200 467.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,310 mnist_classifier_MNISTClassifier 483o5qtx d7a72cda-1131-4b86-8a9b-b475e2042778 -- POST / 200 472.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,314 mnist_classifier_MNISTClassifier 483o5qtx f7cd5e0a-84d0-4088-9b78-f04aaf738bfb -- POST / 200 473.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,314 mnist_classifier_MNISTClassifier 483o5qtx 0c335083-279c-4cb5-a5dd-1e122786922d -- POST / 200 473.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,314 mnist_classifier_MNISTClassifier 483o5qtx 7d1b54cd-9b9d-4321-af65-13901f27adac -- POST / 200 469.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,315 mnist_classifier_MNISTClassifier 483o5qtx 3d786f06-2a3e-411b-b454-f56005efd0b0 -- POST / 200 468.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,315 mnist_classifier_MNISTClassifier 483o5qtx 7fadd8d6-2eef-4100-8c1e-9d784c320608 -- POST / 200 474.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,316 mnist_classifier_MNISTClassifier 483o5qtx 70fa5d36-f08e-4995-96ef-afff378e25a3 -- POST / 200 474.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,316 mnist_classifier_MNISTClassifier 483o5qtx 15c9b4c5-621f-484e-8eb6-738365241a5a -- POST / 200 474.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,318 mnist_classifier_MNISTClassifier 483o5qtx 63716bdd-e5a2-4d5d-bafa-4f6c108f1323 -- POST / 200 476.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,320 mnist_classifier_MNISTClassifier 483o5qtx ac2c2ae4-6369-4406-963b-736226b59f15 -- POST / 200 477.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,320 mnist_classifier_MNISTClassifier 483o5qtx b4522928-11bf-41c6-82ef-8de132041b4c -- POST / 200 475.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,321 mnist_classifier_MNISTClassifier 483o5qtx 73ec5d32-0fdc-4c48-b89b-e3368284c0c5 -- POST / 200 472.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,321 mnist_classifier_MNISTClassifier 483o5qtx 5dcbd956-cb6d-4f00-a5cd-dba1d32f0690 -- POST / 200 475.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,323 mnist_classifier_MNISTClassifier 483o5qtx 475c0704-d747-48b4-ae39-92109aeb3938 -- POST / 200 474.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,323 mnist_classifier_MNISTClassifier 483o5qtx 84be7a25-933a-4a74-be9d-bdde8ab40e33 -- POST / 200 472.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,324 mnist_classifier_MNISTClassifier 483o5qtx 7bdeb86b-3092-4429-b648-df3793b8bfec -- POST / 200 244.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,324 mnist_classifier_MNISTClassifier 483o5qtx 168c9162-6638-40b3-87bb-32b9945c69ae -- POST / 200 243.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,326 mnist_classifier_MNISTClassifier 483o5qtx 018a2b95-e6e4-43f1-bfd8-756a573ab1b3 -- POST / 200 472.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,327 mnist_classifier_MNISTClassifier 483o5qtx ba14b613-bd03-43b4-bca5-58d34636ae28 -- POST / 200 472.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,327 mnist_classifier_MNISTClassifier 483o5qtx 4b6af5c1-b06d-4148-8f2d-4c0dbd644f84 -- POST / 200 332.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,328 mnist_classifier_MNISTClassifier 483o5qtx d259b8db-ffd9-41cd-b21d-e91aec053397 -- POST / 200 332.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,329 mnist_classifier_MNISTClassifier 483o5qtx 725d4fbe-816a-44d9-9712-21356a38175d -- POST / 200 333.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,329 mnist_classifier_MNISTClassifier 483o5qtx f9ffb751-1b07-4ab1-863c-c6acc2efbb40 -- POST / 200 333.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,330 mnist_classifier_MNISTClassifier 483o5qtx 6ab707c8-3243-4441-ae68-be0830704cd1 -- POST / 200 334.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,331 mnist_classifier_MNISTClassifier 483o5qtx 091df2b8-1993-47d8-aaf0-97108c3310bf -- POST / 200 335.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,332 mnist_classifier_MNISTClassifier 483o5qtx e694243b-8d5a-4bab-be69-7023c581fdba -- POST / 200 335.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,332 mnist_classifier_MNISTClassifier 483o5qtx e0601199-ec9a-4b8b-9fc3-58e640e490b5 -- POST / 200 335.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,332 mnist_classifier_MNISTClassifier 483o5qtx 239ebed1-890d-4795-a7d9-608f3f1e0663 -- POST / 200 309.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,333 mnist_classifier_MNISTClassifier 483o5qtx 970335de-8f55-4150-b27b-cc465d19ee88 -- POST / 200 268.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,333 mnist_classifier_MNISTClassifier 483o5qtx ec65a927-564e-4964-ae40-424a22b0629c -- POST / 200 266.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,334 mnist_classifier_MNISTClassifier 483o5qtx 906aaa6e-e45b-4c14-b6ed-082e5e980358 -- POST / 200 262.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,335 mnist_classifier_MNISTClassifier 483o5qtx bb86de76-ad9f-42fe-a73e-00e42f998542 -- POST / 200 263.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,336 mnist_classifier_MNISTClassifier 483o5qtx cc3847a7-1dd7-4c1c-bc17-a19554f6c03d -- POST / 200 263.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,336 mnist_classifier_MNISTClassifier 483o5qtx 39e67135-2fa5-4ed6-928a-6e60eafd8a07 -- POST / 200 263.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,337 mnist_classifier_MNISTClassifier 483o5qtx d7422e2f-8cfe-4e23-a939-07b7d1684ec9 -- POST / 200 260.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,338 mnist_classifier_MNISTClassifier 483o5qtx d9bc76d8-d48e-471d-ad93-f7812dc3aed7 -- POST / 200 260.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,339 mnist_classifier_MNISTClassifier 483o5qtx f2570b38-20df-48a6-b4fe-f22f261a146b -- POST / 200 261.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,339 mnist_classifier_MNISTClassifier 483o5qtx fc927922-6e06-46d7-a8da-fb04b3a70de3 -- POST / 200 260.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,340 mnist_classifier_MNISTClassifier 483o5qtx 198cf341-7610-4627-a247-dc1b0e6b39c2 -- POST / 200 258.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,341 mnist_classifier_MNISTClassifier 483o5qtx f96fa63d-894a-4412-a716-e24917942c9c -- POST / 200 258.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,341 mnist_classifier_MNISTClassifier 483o5qtx 42ec97d4-2b79-4115-ad69-49b408c5d1e0 -- POST / 200 258.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,342 mnist_classifier_MNISTClassifier 483o5qtx cbb64980-bb9d-4578-8b8f-de6e46219fac -- POST / 200 258.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,343 mnist_classifier_MNISTClassifier 483o5qtx 0eabbaa5-77b4-4ace-b4ae-33d677ba3259 -- POST / 200 259.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,343 mnist_classifier_MNISTClassifier 483o5qtx 814d956e-b459-41ee-9a10-8d018b754e60 -- POST / 200 257.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,344 mnist_classifier_MNISTClassifier 483o5qtx a9192687-7cea-420f-8d4b-4d5d71f0c985 -- POST / 200 256.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,346 mnist_classifier_MNISTClassifier 483o5qtx 1bf0dd6a-4b90-443a-ac2b-1362e6b09ca4 -- POST / 200 257.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,351 mnist_classifier_MNISTClassifier 483o5qtx f792a23c-5734-4164-a6cc-80cd0a4774ec -- POST / 200 261.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,352 mnist_classifier_MNISTClassifier 483o5qtx b36db41c-675b-4fe3-a410-a8f92b9973c2 -- POST / 200 261.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,353 mnist_classifier_MNISTClassifier 483o5qtx 9b2d7a9a-53a0-413c-b1de-3b45f457d82f -- POST / 200 259.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,354 mnist_classifier_MNISTClassifier 483o5qtx 93ba758a-72dd-41b0-ad3c-b851ceda6d1d -- POST / 200 256.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,356 mnist_classifier_MNISTClassifier 483o5qtx a844b7c5-625d-449d-9898-2e365406ba10 -- POST / 200 244.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,356 mnist_classifier_MNISTClassifier 483o5qtx 2789b4e0-b558-48e4-b58c-66db4f07698e -- POST / 200 253.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,357 mnist_classifier_MNISTClassifier 483o5qtx 133fb926-6b97-41f3-8d59-6c7eeac886e9 -- POST / 200 253.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,357 mnist_classifier_MNISTClassifier 483o5qtx 35ab7091-9a27-49b0-b86a-68c4d92cca18 -- POST / 200 245.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,418 mnist_classifier_MNISTClassifier 483o5qtx a0a10a76-3ba0-4adf-8e20-19a5e9a39504 -- POST / 200 315.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,428 mnist_classifier_MNISTClassifier 483o5qtx 901bebb7-6c80-4f60-85e7-eb7cf715e315 -- POST / 200 325.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,429 mnist_classifier_MNISTClassifier 483o5qtx 759980a6-71b7-4665-a320-2f83b34f1ee7 -- POST / 200 323.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,430 mnist_classifier_MNISTClassifier 483o5qtx 8fd56759-972a-484b-a626-4217dbac4e58 -- POST / 200 323.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,430 mnist_classifier_MNISTClassifier 483o5qtx 59e3a7f5-1e1a-4ea2-aec4-6e731039b022 -- POST / 200 323.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,432 mnist_classifier_MNISTClassifier 483o5qtx fa1ab1c8-e1b6-4447-bcc6-32ccd2eb18a2 -- POST / 200 324.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,433 mnist_classifier_MNISTClassifier 483o5qtx ccaf0299-58f7-439c-81e8-c5fb099eab0c -- POST / 200 324.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,433 mnist_classifier_MNISTClassifier 483o5qtx e5533a1a-e674-47aa-a098-fa0bb25a4a90 -- POST / 200 321.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,434 mnist_classifier_MNISTClassifier 483o5qtx deac09f5-958f-40b9-96c7-7ae1dacb0bb1 -- POST / 200 321.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,435 mnist_classifier_MNISTClassifier 483o5qtx 012b1536-9b55-4896-a2a7-a211aa390e02 -- POST / 200 321.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,436 mnist_classifier_MNISTClassifier 483o5qtx dc4653ce-f264-4037-8aa4-5d484d2c9b82 -- POST / 200 321.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,436 mnist_classifier_MNISTClassifier 483o5qtx e215e4fe-bff7-495a-8eb6-7de6218ca320 -- POST / 200 271.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,437 mnist_classifier_MNISTClassifier 483o5qtx edf14ec0-de15-4216-97ba-54bbdeff796a -- POST / 200 254.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,437 mnist_classifier_MNISTClassifier 483o5qtx a05e62ce-6f33-44f2-bcad-0e33ce044a7d -- POST / 200 286.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,438 mnist_classifier_MNISTClassifier 483o5qtx 6bdf861d-1660-4c7e-af1d-5132bf9b7cd0 -- POST / 200 286.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,438 mnist_classifier_MNISTClassifier 483o5qtx fcfec5e3-236a-4501-afc7-a7b49778108e -- POST / 200 283.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,438 mnist_classifier_MNISTClassifier 483o5qtx dfea3e83-087d-444a-819f-a3031bdfcc5c -- POST / 200 231.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,439 mnist_classifier_MNISTClassifier 483o5qtx 96c2b9eb-bc49-4f17-aef1-70391d6e4755 -- POST / 200 223.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,439 mnist_classifier_MNISTClassifier 483o5qtx 0018bb1e-770d-45b4-97e6-beca93a08d32 -- POST / 200 218.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,440 mnist_classifier_MNISTClassifier 483o5qtx d13bc982-d412-45a2-be87-f3710d93c741 -- POST / 200 217.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,440 mnist_classifier_MNISTClassifier 483o5qtx 2b81fb44-187f-4ede-82d9-5bb7cf0c0774 -- POST / 200 218.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,442 mnist_classifier_MNISTClassifier 483o5qtx d70468ff-5496-4234-8616-1f8e9b3c7910 -- POST / 200 220.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,447 mnist_classifier_MNISTClassifier 483o5qtx c770a06a-d565-4668-8793-68c143096e5a -- POST / 200 224.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,447 mnist_classifier_MNISTClassifier 483o5qtx 88e88ca5-1995-4ed7-ad34-e3b00704be13 -- POST / 200 223.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,449 mnist_classifier_MNISTClassifier 483o5qtx 4f983d97-9a2f-40c1-889f-78d97b9729c3 -- POST / 200 224.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,450 mnist_classifier_MNISTClassifier 483o5qtx dbb0a61a-a7cb-4137-aad9-02f2b97c3f1a -- POST / 200 223.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,452 mnist_classifier_MNISTClassifier 483o5qtx 8d46a83f-1e51-45b3-82a4-304187f19bee -- POST / 200 225.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,455 mnist_classifier_MNISTClassifier 483o5qtx 3dde77f7-a841-4db5-89d1-125ed9db35b4 -- POST / 200 225.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,455 mnist_classifier_MNISTClassifier 483o5qtx 39f746d5-254b-46ad-bf8c-fdc209f48156 -- POST / 200 226.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,460 mnist_classifier_MNISTClassifier 483o5qtx 8183ee7e-84f6-450b-93e4-7f5e23a00405 -- POST / 200 231.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,461 mnist_classifier_MNISTClassifier 483o5qtx 1acba339-f3cf-4896-9709-7ce1d3e390bb -- POST / 200 230.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,461 mnist_classifier_MNISTClassifier 483o5qtx 685e4799-f4d4-42bc-996d-bcc3adecb7aa -- POST / 200 230.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,462 mnist_classifier_MNISTClassifier 483o5qtx d62bfea2-8660-43dc-b336-565f2ca4ecb6 -- POST / 200 226.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,462 mnist_classifier_MNISTClassifier 483o5qtx 140a255f-5631-461b-a7de-31a73f806af5 -- POST / 200 224.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,463 mnist_classifier_MNISTClassifier 483o5qtx b397af8c-1771-4f9f-9abe-eafabda6d488 -- POST / 200 223.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,542 mnist_classifier_MNISTClassifier 483o5qtx 4152e1eb-ae03-466f-b0b2-f2fbcb87dfdf -- POST / 200 252.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,544 mnist_classifier_MNISTClassifier 483o5qtx bd985cc1-3a16-49fc-833e-df079b68bfb3 -- POST / 200 248.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,545 mnist_classifier_MNISTClassifier 483o5qtx 802af067-9567-4d03-9fc1-ec4fcd3f1c84 -- POST / 200 231.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,545 mnist_classifier_MNISTClassifier 483o5qtx 939d0dac-4a34-482d-9a1b-bc16e80aa525 -- POST / 200 219.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,546 mnist_classifier_MNISTClassifier 483o5qtx bba55ee6-8919-4b92-aa2a-6748c8acf3be -- POST / 200 219.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,546 mnist_classifier_MNISTClassifier 483o5qtx 9b727546-25e6-4e1d-b4fa-7b1de259fb29 -- POST / 200 219.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,546 mnist_classifier_MNISTClassifier 483o5qtx dde4d3fc-8e6a-4128-bf55-15ed3d24de9f -- POST / 200 210.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,547 mnist_classifier_MNISTClassifier 483o5qtx 81137693-968a-4a89-b897-450624b60c93 -- POST / 200 201.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,547 mnist_classifier_MNISTClassifier 483o5qtx 86730928-1782-47fd-bb23-9081b0ce0650 -- POST / 200 189.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,549 mnist_classifier_MNISTClassifier 483o5qtx 65886de4-209e-44f1-806d-5c976d0d324e -- POST / 200 187.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,549 mnist_classifier_MNISTClassifier 483o5qtx 7a50b1df-44fc-409e-a2b2-e662fbe054aa -- POST / 200 203.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,552 mnist_classifier_MNISTClassifier 483o5qtx 65aa2cee-a801-4814-a1c6-d8ecf59450db -- POST / 200 187.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,553 mnist_classifier_MNISTClassifier 483o5qtx 5ae790f6-bdd5-40ea-873d-1e82b0d34f56 -- POST / 200 187.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,553 mnist_classifier_MNISTClassifier 483o5qtx 67ce9b29-b5d0-4063-8ca0-0ccc7db897ae -- POST / 200 187.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,554 mnist_classifier_MNISTClassifier 483o5qtx 18eafe06-5b5f-416f-b1ef-9a655c09ac99 -- POST / 200 188.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,554 mnist_classifier_MNISTClassifier 483o5qtx 14b1b9f5-b715-4fc9-a537-978027935938 -- POST / 200 185.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,555 mnist_classifier_MNISTClassifier 483o5qtx d6ca4a7f-85c2-47af-bf3b-1ab52f65e2a3 -- POST / 200 187.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,556 mnist_classifier_MNISTClassifier 483o5qtx 44c7bc39-ef37-41d5-b108-2fb64a1ac5d8 -- POST / 200 185.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,556 mnist_classifier_MNISTClassifier 483o5qtx 408f3dda-f969-49cd-b0f8-6eb112c4a520 -- POST / 200 185.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,557 mnist_classifier_MNISTClassifier 483o5qtx 704bacf1-fd2c-4d4d-b0ad-d4bab18feb22 -- POST / 200 180.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,557 mnist_classifier_MNISTClassifier 483o5qtx ca57edf4-247a-4ffa-83bf-f9484d8a47a4 -- POST / 200 183.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,557 mnist_classifier_MNISTClassifier 483o5qtx 19aca2a4-5e57-47bc-9a55-f3a5b77b8afb -- POST / 200 184.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,558 mnist_classifier_MNISTClassifier 483o5qtx 28d34001-a06f-49a8-bad4-a14cd9c87cdf -- POST / 200 181.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,560 mnist_classifier_MNISTClassifier 483o5qtx c5039885-f23a-412f-a50e-1728b5fe557f -- POST / 200 186.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,561 mnist_classifier_MNISTClassifier 483o5qtx 376c4ceb-fa93-4315-9156-756858298024 -- POST / 200 185.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,563 mnist_classifier_MNISTClassifier 483o5qtx 0ea5d9c3-ffe8-47cb-8eb3-95d1e41b4f3e -- POST / 200 187.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,563 mnist_classifier_MNISTClassifier 483o5qtx c640f455-edbc-40ef-a4fe-fb1847208ce9 -- POST / 200 186.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,565 mnist_classifier_MNISTClassifier 483o5qtx 3ed1bad5-ae7c-4816-bb66-23202dee8533 -- POST / 200 187.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,565 mnist_classifier_MNISTClassifier 483o5qtx 24699623-5ee9-42f9-bf32-0acf2e70a327 -- POST / 200 177.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,565 mnist_classifier_MNISTClassifier 483o5qtx 21912027-90fc-43e5-9d18-2c644c22677e -- POST / 200 176.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,568 mnist_classifier_MNISTClassifier 483o5qtx f56355ff-8f1d-4a2e-86ef-e641fd883978 -- POST / 200 172.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,569 mnist_classifier_MNISTClassifier 483o5qtx a2265640-c513-47ae-babf-f0c781912b4c -- POST / 200 178.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,570 mnist_classifier_MNISTClassifier 483o5qtx f0276c73-ffd6-4f7c-8ab9-4b2620bdb9cb -- POST / 200 178.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,572 mnist_classifier_MNISTClassifier 483o5qtx 64f694df-b8e9-4891-b773-78d6248ac198 -- POST / 200 170.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,573 mnist_classifier_MNISTClassifier 483o5qtx fe7f9be6-70a2-401f-a3cd-0c471ff95558 -- POST / 200 175.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,574 mnist_classifier_MNISTClassifier 483o5qtx 457a22f4-6e8d-4bc1-a449-3f1401d6a551 -- POST / 200 175.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,575 mnist_classifier_MNISTClassifier 483o5qtx bda50c66-cd9c-44ef-bba6-13ed7032348e -- POST / 200 175.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,578 mnist_classifier_MNISTClassifier 483o5qtx a35b111a-a2fe-4018-8b7b-76e89c3e92bb -- POST / 200 177.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,578 mnist_classifier_MNISTClassifier 483o5qtx 928a6df8-e996-4f0f-8a6f-25897b4fed80 -- POST / 200 160.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,693 mnist_classifier_MNISTClassifier 483o5qtx 0e5bdbf9-786b-4bd2-b963-e274a11677f7 -- POST / 200 246.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,694 mnist_classifier_MNISTClassifier 483o5qtx 85fa2c9f-2ab9-42e1-95e7-84dfa546c6fb -- POST / 200 248.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,694 mnist_classifier_MNISTClassifier 483o5qtx fb009663-575b-47d8-9057-09145ec4ff84 -- POST / 200 230.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,697 mnist_classifier_MNISTClassifier 483o5qtx d4da47ff-92ce-428c-9905-3b45c7381d59 -- POST / 200 250.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,699 mnist_classifier_MNISTClassifier 483o5qtx 3e074a19-3005-4471-b852-0e1f0df53823 -- POST / 200 234.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,701 mnist_classifier_MNISTClassifier 483o5qtx 98edebab-ecb9-4a4d-b46d-f41c7252c4d2 -- POST / 200 233.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,702 mnist_classifier_MNISTClassifier 483o5qtx 6a24f2ae-b68f-41fa-8a0a-acf99a81a73d -- POST / 200 224.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,702 mnist_classifier_MNISTClassifier 483o5qtx e2a1bba8-77a8-4396-b438-cc9099b6e02e -- POST / 200 223.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,703 mnist_classifier_MNISTClassifier 483o5qtx c790d981-1434-47e8-b2f9-2acb76160424 -- POST / 200 224.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,704 mnist_classifier_MNISTClassifier 483o5qtx eff00958-01ca-4224-ba13-f1f21c01e6d8 -- POST / 200 223.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,704 mnist_classifier_MNISTClassifier 483o5qtx 6a1ac8aa-c9ae-42d2-9a5e-93c9ad0e3f84 -- POST / 200 223.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,705 mnist_classifier_MNISTClassifier 483o5qtx 843cfdd9-97a0-48b4-8fbd-4224a05d6050 -- POST / 200 224.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,706 mnist_classifier_MNISTClassifier 483o5qtx 4fe5acd1-7b77-4b9e-a945-ba89c5d9b717 -- POST / 200 224.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,706 mnist_classifier_MNISTClassifier 483o5qtx 7a1c024e-f77c-4d89-abf3-5d64810f6323 -- POST / 200 220.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,706 mnist_classifier_MNISTClassifier 483o5qtx de704feb-5584-4895-9d89-cd950ebc6f1d -- POST / 200 220.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,707 mnist_classifier_MNISTClassifier 483o5qtx 230d8aa6-6754-4387-8a58-e75df14a8feb -- POST / 200 216.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,708 mnist_classifier_MNISTClassifier 483o5qtx 31b13f70-7135-4c64-90e4-616bf2e6e4f1 -- POST / 200 191.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,709 mnist_classifier_MNISTClassifier 483o5qtx d4eed848-8fd6-4ca3-b671-07e7b7bca468 -- POST / 200 215.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,710 mnist_classifier_MNISTClassifier 483o5qtx 6c75c941-0d0d-4c7f-8304-adbfc34cd8cf -- POST / 200 213.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,710 mnist_classifier_MNISTClassifier 483o5qtx 116de2e3-511c-4749-ae1c-e68a9c3f3287 -- POST / 200 213.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,712 mnist_classifier_MNISTClassifier 483o5qtx 3baeaa27-c00f-4275-87e6-25686df17972 -- POST / 200 215.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,714 mnist_classifier_MNISTClassifier 483o5qtx ae387a8f-ae35-4f75-92fb-1a2a69ceb16e -- POST / 200 216.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,714 mnist_classifier_MNISTClassifier 483o5qtx 6931d178-43f2-4fab-994f-9689019af74b -- POST / 200 217.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,718 mnist_classifier_MNISTClassifier 483o5qtx 17a41bb9-b108-491b-ad1f-13ec87ee832a -- POST / 200 220.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,718 mnist_classifier_MNISTClassifier 483o5qtx 820260f8-c387-468b-a7fd-e87851f0808f -- POST / 200 221.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,719 mnist_classifier_MNISTClassifier 483o5qtx 2986584d-ec90-4ec6-8e54-fc48e2a63f15 -- POST / 200 205.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,722 mnist_classifier_MNISTClassifier 483o5qtx 47354b68-5fda-46fb-a069-020118772a66 -- POST / 200 208.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,723 mnist_classifier_MNISTClassifier 483o5qtx b5da12fb-088a-45ee-9e09-c7d52a45b387 -- POST / 200 209.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,723 mnist_classifier_MNISTClassifier 483o5qtx 26842430-2a3d-43d0-a4e1-4857b5b8ddbf -- POST / 200 209.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,726 mnist_classifier_MNISTClassifier 483o5qtx b75cb8af-820d-43ce-90b1-c65227444496 -- POST / 200 234.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,733 mnist_classifier_MNISTClassifier 483o5qtx 2bf9d6fe-726d-4d5e-88e2-58773bc0a9e6 -- POST / 200 239.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,830 mnist_classifier_MNISTClassifier 483o5qtx d31b8f7b-3e63-4335-b333-101e1aeec4c3 -- POST / 200 313.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,834 mnist_classifier_MNISTClassifier 483o5qtx 71f4c52b-43ec-4f60-8c6d-85bedad833e6 -- POST / 200 315.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,834 mnist_classifier_MNISTClassifier 483o5qtx 090a4bad-3b1e-4818-acf0-a8ac972af653 -- POST / 200 286.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,835 mnist_classifier_MNISTClassifier 483o5qtx 4e028791-3575-4d19-baa8-7af286a927d4 -- POST / 200 286.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,836 mnist_classifier_MNISTClassifier 483o5qtx 5aaa90fc-72bb-499c-963c-dbb0d64796f8 -- POST / 200 275.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,836 mnist_classifier_MNISTClassifier 483o5qtx 5c4fd6eb-925d-4b61-bb34-1f144e4e8dec -- POST / 200 280.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,838 mnist_classifier_MNISTClassifier 483o5qtx ce13d6ee-02c4-4565-b1f0-365a92365f95 -- POST / 200 279.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,839 mnist_classifier_MNISTClassifier 483o5qtx 8d616885-5aa4-4fff-992f-f6f9473e07b0 -- POST / 200 278.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,840 mnist_classifier_MNISTClassifier 483o5qtx de56ad62-0414-425d-ae35-43fd41b20b1f -- POST / 200 260.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,849 mnist_classifier_MNISTClassifier 483o5qtx bf7bc30f-8a99-41a8-884b-4c11c31d22fc -- POST / 200 279.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,851 mnist_classifier_MNISTClassifier 483o5qtx 472be55e-0701-4535-806f-0a8bce69dbf7 -- POST / 200 267.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,854 mnist_classifier_MNISTClassifier 483o5qtx 023f2ae8-aa9c-443a-9e89-31646dde4487 -- POST / 200 272.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,856 mnist_classifier_MNISTClassifier 483o5qtx 48f1c2b3-ee78-4821-9f0a-01cb73c310c3 -- POST / 200 272.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,858 mnist_classifier_MNISTClassifier 483o5qtx d3a751a1-d2e9-418d-a103-1291720015a6 -- POST / 200 269.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,859 mnist_classifier_MNISTClassifier 483o5qtx 8ab1837a-3d19-4120-826e-dc8238cd5c02 -- POST / 200 269.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,859 mnist_classifier_MNISTClassifier 483o5qtx 4b185135-bcbf-484a-9add-81eee332496b -- POST / 200 266.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,861 mnist_classifier_MNISTClassifier 483o5qtx 1278c826-6ee0-48ac-aa05-cd6e75334af2 -- POST / 200 267.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,863 mnist_classifier_MNISTClassifier 483o5qtx 7fa518e4-82c9-4422-ba2c-8fe85efaa2c6 -- POST / 200 264.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,864 mnist_classifier_MNISTClassifier 483o5qtx 3d2c06cf-2fe2-4b94-b2db-d43d5c97f2c7 -- POST / 200 265.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,865 mnist_classifier_MNISTClassifier 483o5qtx 69225e0c-d548-41e5-9e21-b1de3966f464 -- POST / 200 269.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,866 mnist_classifier_MNISTClassifier 483o5qtx e0fcbcfd-0817-49f3-882c-591afe6c89a1 -- POST / 200 267.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,867 mnist_classifier_MNISTClassifier 483o5qtx cdb3fb2d-da8e-4c24-9c50-3d121bcf9e51 -- POST / 200 267.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,867 mnist_classifier_MNISTClassifier 483o5qtx c9382740-151c-4d87-8f8f-50eab4187c47 -- POST / 200 258.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,868 mnist_classifier_MNISTClassifier 483o5qtx 06a20018-8b77-45d1-ae29-33bd3279fc21 -- POST / 200 266.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,868 mnist_classifier_MNISTClassifier 483o5qtx 1e7a76bd-d700-4d02-92e2-6a4394e60e43 -- POST / 200 266.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,869 mnist_classifier_MNISTClassifier 483o5qtx 6fd9d4f7-d537-475c-8bf1-88e6a889baa4 -- POST / 200 266.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,869 mnist_classifier_MNISTClassifier 483o5qtx 84422d18-9df7-4b0a-a3f0-901b1721a626 -- POST / 200 260.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:38,870 mnist_classifier_MNISTClassifier 483o5qtx 88ec1d08-99f6-4b87-95f5-30c28b5587f5 -- POST / 200 261.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,089 mnist_classifier_MNISTClassifier 483o5qtx 7fd04487-dc4a-4c19-b437-0ca6e38f1a9a -- POST / 200 479.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,094 mnist_classifier_MNISTClassifier 483o5qtx 858b4a1b-cd51-43d4-8103-1714bc4a84b0 -- POST / 200 483.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,099 mnist_classifier_MNISTClassifier 483o5qtx a4c63794-d8f3-4c6c-bbd4-727bb9d37130 -- POST / 200 482.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,100 mnist_classifier_MNISTClassifier 483o5qtx b7059cbb-86b0-4895-85f9-49a391712dbe -- POST / 200 483.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,101 mnist_classifier_MNISTClassifier 483o5qtx 4c261173-1c20-4ceb-ae2f-faddd92fc2a1 -- POST / 200 468.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,102 mnist_classifier_MNISTClassifier 483o5qtx 82550590-4e05-465c-9b91-f626628df654 -- POST / 200 469.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,103 mnist_classifier_MNISTClassifier 483o5qtx 9fc4fc97-af99-4ede-83e3-cdc51715b1f6 -- POST / 200 470.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,103 mnist_classifier_MNISTClassifier 483o5qtx feb63cf0-1bf4-4aad-b339-437e72e8e783 -- POST / 200 466.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,104 mnist_classifier_MNISTClassifier 483o5qtx 438a85d0-d18f-4825-93d8-22824456dbbd -- POST / 200 465.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,105 mnist_classifier_MNISTClassifier 483o5qtx 457c6839-b785-47c6-af78-365b8db13eca -- POST / 200 466.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,105 mnist_classifier_MNISTClassifier 483o5qtx 40e5a79b-4252-4830-9559-5be5189851ff -- POST / 200 466.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,106 mnist_classifier_MNISTClassifier 483o5qtx 86463c0c-9b05-4470-8d3a-6ccc22372bde -- POST / 200 472.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,106 mnist_classifier_MNISTClassifier 483o5qtx ecbee390-dd66-4c91-9629-3f668ef216d8 -- POST / 200 472.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,106 mnist_classifier_MNISTClassifier 483o5qtx 75b0822e-4142-4c16-9a5c-42366393ecae -- POST / 200 470.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,107 mnist_classifier_MNISTClassifier 483o5qtx 8b6b9481-964f-4c99-8f67-6ec16cd45b01 -- POST / 200 464.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,108 mnist_classifier_MNISTClassifier 483o5qtx 10f6ac17-e473-46b6-9d3f-ca833a716640 -- POST / 200 462.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,109 mnist_classifier_MNISTClassifier 483o5qtx a110fff2-e0a7-44a9-a91c-c8e2e48743a4 -- POST / 200 463.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,110 mnist_classifier_MNISTClassifier 483o5qtx 8f3f53cb-67b8-4ff4-9bf9-99544db8b83a -- POST / 200 464.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,111 mnist_classifier_MNISTClassifier 483o5qtx 6c92652e-9c36-44ac-a290-6bb037bbe93a -- POST / 200 463.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,112 mnist_classifier_MNISTClassifier 483o5qtx 7feb634b-72f7-4a8a-a2b6-176a9c2e4d2a -- POST / 200 464.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,113 mnist_classifier_MNISTClassifier 483o5qtx 1f670ee4-a513-4544-8b9c-37345a372468 -- POST / 200 465.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,114 mnist_classifier_MNISTClassifier 483o5qtx 397a5d99-0c2b-4cd6-9feb-8bfa2e2ac812 -- POST / 200 465.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,115 mnist_classifier_MNISTClassifier 483o5qtx 9802f0ff-fd3d-4300-895a-8a52f968d03e -- POST / 200 463.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,116 mnist_classifier_MNISTClassifier 483o5qtx 104ebc07-495e-49f6-b82b-7a06e1fcb77b -- POST / 200 463.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,118 mnist_classifier_MNISTClassifier 483o5qtx 460d037e-0fd1-4b32-9f76-09dcfc0e133b -- POST / 200 461.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,120 mnist_classifier_MNISTClassifier 483o5qtx 95ed0595-d474-4ba1-b3f8-915c4f1bddaf -- POST / 200 460.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,121 mnist_classifier_MNISTClassifier 483o5qtx f9690c1c-a606-45b0-9a57-2dff7e9a1423 -- POST / 200 457.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,122 mnist_classifier_MNISTClassifier 483o5qtx 32d6a02e-e208-4411-b3b2-95cfd67c0c57 -- POST / 200 456.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,125 mnist_classifier_MNISTClassifier 483o5qtx cd73b4ad-3d0b-4a74-960f-322e2fec71b9 -- POST / 200 458.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,126 mnist_classifier_MNISTClassifier 483o5qtx 00538128-e491-4d7b-a78f-482f36b3100a -- POST / 200 458.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,126 mnist_classifier_MNISTClassifier 483o5qtx c5389909-8c2c-41b5-b089-36311146ebcd -- POST / 200 458.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,128 mnist_classifier_MNISTClassifier 483o5qtx 8a53d56f-166c-485a-a7de-588031a6777a -- POST / 200 458.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,128 mnist_classifier_MNISTClassifier 483o5qtx 42fec535-543d-42a8-a819-b8d1b3172ab2 -- POST / 200 457.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,128 mnist_classifier_MNISTClassifier 483o5qtx aa9bdf1f-3145-431c-8585-81196fa4d2bc -- POST / 200 457.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,129 mnist_classifier_MNISTClassifier 483o5qtx 6a3514fa-bdab-4d6f-a6f1-e8024fb1290e -- POST / 200 457.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,129 mnist_classifier_MNISTClassifier 483o5qtx 562b4b55-593f-441d-a7a5-202ae25c176d -- POST / 200 457.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,130 mnist_classifier_MNISTClassifier 483o5qtx 08d14534-9605-4dbe-adbf-0cf04831e608 -- POST / 200 457.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,131 mnist_classifier_MNISTClassifier 483o5qtx b4209000-81a8-422a-b1b5-1460ffc6b5a9 -- POST / 200 458.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,132 mnist_classifier_MNISTClassifier 483o5qtx 9e33cea3-1bb3-4838-81a8-faaa39f88180 -- POST / 200 455.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,133 mnist_classifier_MNISTClassifier 483o5qtx c54f5f97-4f5e-4a43-8993-a12a7b8cae14 -- POST / 200 456.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,133 mnist_classifier_MNISTClassifier 483o5qtx 9fb9cc19-8d85-48d5-b1a9-8f1dd68a8193 -- POST / 200 456.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,134 mnist_classifier_MNISTClassifier 483o5qtx 18652c65-cbe2-473d-be18-7668e2e8569a -- POST / 200 395.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,134 mnist_classifier_MNISTClassifier 483o5qtx 78d6b004-c493-4ae9-ae34-4d425bc13767 -- POST / 200 393.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,136 mnist_classifier_MNISTClassifier 483o5qtx 1dbb810f-bbca-44a7-af3e-a15fd2695c26 -- POST / 200 400.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,139 mnist_classifier_MNISTClassifier 483o5qtx 1d55915e-541e-4b9a-a525-c016f4a99992 -- POST / 200 402.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,140 mnist_classifier_MNISTClassifier 483o5qtx 09041c95-023c-4706-ab63-9ebcc15a18a4 -- POST / 200 398.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,141 mnist_classifier_MNISTClassifier 483o5qtx d4aa934f-fd93-4592-98de-11c084e4007d -- POST / 200 397.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,208 mnist_classifier_MNISTClassifier 483o5qtx a96b5d21-10d2-4fcd-ae42-24dfcc7f21f5 -- POST / 200 464.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,214 mnist_classifier_MNISTClassifier 483o5qtx 41ea5fc6-21b7-4f75-af85-adb3882484dc -- POST / 200 456.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,216 mnist_classifier_MNISTClassifier 483o5qtx cdf74693-90c8-4664-8133-5e843ede9387 -- POST / 200 455.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,218 mnist_classifier_MNISTClassifier 483o5qtx 7570b2b2-4f8d-4e92-8ee8-cad51a0268ba -- POST / 200 452.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,219 mnist_classifier_MNISTClassifier 483o5qtx df8b702f-36d5-4bdc-8056-1bbaf8dddd24 -- POST / 200 458.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,220 mnist_classifier_MNISTClassifier 483o5qtx bf133151-2dbe-452b-9c26-1ba9a5db4beb -- POST / 200 454.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,221 mnist_classifier_MNISTClassifier 483o5qtx 006951c1-4089-4298-b9c0-ab8d5463b42a -- POST / 200 446.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,221 mnist_classifier_MNISTClassifier 483o5qtx 58aafd25-9bfd-49f2-94ba-ac50bc885a02 -- POST / 200 444.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,223 mnist_classifier_MNISTClassifier 483o5qtx d6376aff-1a07-4f3f-80d7-d63438c39379 -- POST / 200 447.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,224 mnist_classifier_MNISTClassifier 483o5qtx 136b16e2-53a2-4d70-9e9a-c420d3e78dc3 -- POST / 200 450.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,225 mnist_classifier_MNISTClassifier 483o5qtx 9f529c57-095d-4fa7-b640-6e4fe939a231 -- POST / 200 447.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,226 mnist_classifier_MNISTClassifier 483o5qtx 92c9fca8-3d26-4c9c-80e4-ec7855b210e2 -- POST / 200 441.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,227 mnist_classifier_MNISTClassifier 483o5qtx c3730a6f-cd9d-4131-8eee-8303e3f944a1 -- POST / 200 444.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,228 mnist_classifier_MNISTClassifier 483o5qtx 94cb6356-391a-4686-8e7f-106f663ac4e9 -- POST / 200 444.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,228 mnist_classifier_MNISTClassifier 483o5qtx 2e4d185c-e630-469f-a284-bb0cd97dfc59 -- POST / 200 440.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,236 mnist_classifier_MNISTClassifier 483o5qtx de99cde0-d0af-4d66-b113-dfbc343ac2c3 -- POST / 200 448.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,237 mnist_classifier_MNISTClassifier 483o5qtx 22ce32bd-ca3a-4ef5-8d4b-07d0c3eab7ee -- POST / 200 448.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,239 mnist_classifier_MNISTClassifier 483o5qtx 66fd9f1a-6be9-4a31-80f5-5c8a037e4d39 -- POST / 200 446.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,239 mnist_classifier_MNISTClassifier 483o5qtx 0d07d3f2-4a2e-48a3-b146-0f5b232e8f52 -- POST / 200 446.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,239 mnist_classifier_MNISTClassifier 483o5qtx db5c9722-e44e-4520-956b-ffe78ee89e10 -- POST / 200 443.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,241 mnist_classifier_MNISTClassifier 483o5qtx 4566135d-9709-4d13-be96-56626af2d57e -- POST / 200 444.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,241 mnist_classifier_MNISTClassifier 483o5qtx f8bc2e43-d1dd-4daa-83c9-9f3642d0e5b6 -- POST / 200 444.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,241 mnist_classifier_MNISTClassifier 483o5qtx 72df752e-2740-4f88-b15d-ee7c7eca1755 -- POST / 200 444.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,248 mnist_classifier_MNISTClassifier 483o5qtx 5a9b2884-3e44-4a7f-b504-3d681ffee639 -- POST / 200 449.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,253 mnist_classifier_MNISTClassifier 483o5qtx 24630191-160b-4b99-8a8b-a97783a11348 -- POST / 200 454.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,255 mnist_classifier_MNISTClassifier 483o5qtx 2bfbbbc7-8a08-4fe2-89bd-846dacd3258e -- POST / 200 429.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,255 mnist_classifier_MNISTClassifier 483o5qtx 159d581b-f321-4399-8224-179e959461ea -- POST / 200 427.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,256 mnist_classifier_MNISTClassifier 483o5qtx 07c9600d-bd25-48f4-8027-de79dce7ca98 -- POST / 200 428.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,256 mnist_classifier_MNISTClassifier 483o5qtx cf36adf9-a9b5-4fd8-bcab-0639f06ea460 -- POST / 200 238.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,257 mnist_classifier_MNISTClassifier 483o5qtx 8f75485b-e80f-4fc8-831c-a5e7ce63dc64 -- POST / 200 238.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,260 mnist_classifier_MNISTClassifier 483o5qtx 6ca282cf-a6a6-4831-8f87-74bbd23ad1ed -- POST / 200 241.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,262 mnist_classifier_MNISTClassifier 483o5qtx f22145b1-6e66-4787-8d71-49384866156b -- POST / 200 243.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,262 mnist_classifier_MNISTClassifier 483o5qtx 01854178-6c97-4c85-8ba9-e6b8e1021b96 -- POST / 200 231.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,263 mnist_classifier_MNISTClassifier 483o5qtx 4defa856-1cb5-43b2-adfe-ce64eefda13c -- POST / 200 230.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,263 mnist_classifier_MNISTClassifier 483o5qtx 6ee40a1d-a4c1-429a-b302-a1f25c410eb1 -- POST / 200 231.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,264 mnist_classifier_MNISTClassifier 483o5qtx 1a75d12b-d1d2-47ef-9956-264cdeef5971 -- POST / 200 232.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,266 mnist_classifier_MNISTClassifier 483o5qtx d0f8a963-037a-4447-a1d7-282672e96aa5 -- POST / 200 231.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,266 mnist_classifier_MNISTClassifier 483o5qtx d9eadbb0-bdb9-476c-96d4-90bbf85fa92f -- POST / 200 231.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,267 mnist_classifier_MNISTClassifier 483o5qtx 4e4fb71d-6c5d-45bb-9a3a-fe54165e5835 -- POST / 200 231.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,355 mnist_classifier_MNISTClassifier 483o5qtx a89008f0-f488-4035-b1fa-abf703a01360 -- POST / 200 319.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,358 mnist_classifier_MNISTClassifier 483o5qtx 022e901a-3bac-4649-9c4f-e9735b67a8ca -- POST / 200 319.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,362 mnist_classifier_MNISTClassifier 483o5qtx 70494d18-f6ab-48d5-bfb8-02ef813a8726 -- POST / 200 326.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,363 mnist_classifier_MNISTClassifier 483o5qtx c3060479-ff8c-4a34-96d8-d754c01eee40 -- POST / 200 323.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,363 mnist_classifier_MNISTClassifier 483o5qtx bdcd29d7-873f-4ee2-8ff0-bf8ef4ebca46 -- POST / 200 322.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,365 mnist_classifier_MNISTClassifier 483o5qtx 82ed4f4b-c83d-4702-b6ce-04b427df8a7c -- POST / 200 323.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,367 mnist_classifier_MNISTClassifier 483o5qtx 75cf6f40-9840-4e5b-921b-5ab7d24fa6fb -- POST / 200 325.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,368 mnist_classifier_MNISTClassifier 483o5qtx 876db7d0-c4e3-41c0-890a-162e08a6a136 -- POST / 200 325.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,368 mnist_classifier_MNISTClassifier 483o5qtx 1f63aecb-64f0-47ac-8c84-2a17e3efebf5 -- POST / 200 326.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,369 mnist_classifier_MNISTClassifier 483o5qtx 16ee292c-7317-4825-a3d7-efd01355efbd -- POST / 200 326.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,372 mnist_classifier_MNISTClassifier 483o5qtx 72f8b71c-d575-47f2-837a-36aba2b4a62f -- POST / 200 329.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,373 mnist_classifier_MNISTClassifier 483o5qtx fd84e91d-cb1e-41e0-bdcc-2f40bcfdf942 -- POST / 200 330.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,374 mnist_classifier_MNISTClassifier 483o5qtx 78803b9a-9372-40b6-8c1a-c1dba8358d06 -- POST / 200 332.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,374 mnist_classifier_MNISTClassifier 483o5qtx c82bafd5-9a3c-401a-8572-1aaba2cd22c5 -- POST / 200 330.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,375 mnist_classifier_MNISTClassifier 483o5qtx 341f8694-75d1-4bee-9c4c-b1fc55716eb6 -- POST / 200 296.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,376 mnist_classifier_MNISTClassifier 483o5qtx 40a9f2b7-6ace-4095-a57d-d124547d242f -- POST / 200 301.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,381 mnist_classifier_MNISTClassifier 483o5qtx ffc01408-bda3-4a68-b4f5-18137e32d462 -- POST / 200 235.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,382 mnist_classifier_MNISTClassifier 483o5qtx 6d7e1a40-ecdf-4f11-b6c0-c6b56ba09c1e -- POST / 200 245.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,382 mnist_classifier_MNISTClassifier 483o5qtx ba41704e-d5e5-46f2-9325-2b31abcf739f -- POST / 200 245.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,384 mnist_classifier_MNISTClassifier 483o5qtx 2da33de3-d898-4921-8ee0-a9bc1ee4c45f -- POST / 200 236.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,385 mnist_classifier_MNISTClassifier 483o5qtx 4eb059ff-1596-4388-a410-5b4a93d34d4e -- POST / 200 234.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,387 mnist_classifier_MNISTClassifier 483o5qtx f4f0c13e-b6af-485c-97ed-4a252d558cbf -- POST / 200 238.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,389 mnist_classifier_MNISTClassifier 483o5qtx a124333d-a1dd-4475-a061-0c63837a6c4c -- POST / 200 239.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,390 mnist_classifier_MNISTClassifier 483o5qtx e9da204e-ab6b-40d1-997e-5ed9ff88c91d -- POST / 200 236.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,391 mnist_classifier_MNISTClassifier 483o5qtx 19e709a4-2917-4301-b4ae-795f0e2fb8c7 -- POST / 200 239.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,396 mnist_classifier_MNISTClassifier 483o5qtx 82dfdc72-7ab0-42b3-8e05-32c4fd40edaf -- POST / 200 244.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,399 mnist_classifier_MNISTClassifier 483o5qtx 2d9684b7-d94e-4a78-baf9-9c97e46dd855 -- POST / 200 244.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,399 mnist_classifier_MNISTClassifier 483o5qtx b27c7552-8a11-49b2-9df8-482a53daf47d -- POST / 200 242.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,401 mnist_classifier_MNISTClassifier 483o5qtx 27f27e7c-d5c9-48d4-b9e2-bd0357f9c369 -- POST / 200 245.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,402 mnist_classifier_MNISTClassifier 483o5qtx 2817eef5-8dcc-4434-ac46-95f9c1d12a8a -- POST / 200 245.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,402 mnist_classifier_MNISTClassifier 483o5qtx b83adc95-9b4a-4b5b-a449-7f9c18afd9ed -- POST / 200 245.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,403 mnist_classifier_MNISTClassifier 483o5qtx 1d91417d-636d-489b-9cb6-dadddb4520c5 -- POST / 200 245.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,404 mnist_classifier_MNISTClassifier 483o5qtx 014f394e-d993-429c-acf9-64f819b1ce32 -- POST / 200 245.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,404 mnist_classifier_MNISTClassifier 483o5qtx 48fe1c74-31ee-4a2f-a07e-3a7a8a4b43f2 -- POST / 200 244.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,406 mnist_classifier_MNISTClassifier 483o5qtx e7a450b2-5a92-43d5-9155-415e19fddbca -- POST / 200 244.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,406 mnist_classifier_MNISTClassifier 483o5qtx 1455e40b-d21f-4124-b45d-80e8d2b2fcac -- POST / 200 243.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,407 mnist_classifier_MNISTClassifier 483o5qtx 6b4fcb04-20d3-433a-bcba-30f868046535 -- POST / 200 243.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,407 mnist_classifier_MNISTClassifier 483o5qtx 84914676-f218-460b-91be-2a37886bddc7 -- POST / 200 242.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,409 mnist_classifier_MNISTClassifier 483o5qtx bd9ee829-2132-44b8-ae41-4f573b47a305 -- POST / 200 244.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,409 mnist_classifier_MNISTClassifier 483o5qtx ea5ffb10-cb2e-4bec-a34f-063076d52a27 -- POST / 200 240.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,410 mnist_classifier_MNISTClassifier 483o5qtx a3d367d7-4972-4b48-9c5a-dcd556ea8372 -- POST / 200 240.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,412 mnist_classifier_MNISTClassifier 483o5qtx a20acac7-b89c-4304-ac60-105f10d38f69 -- POST / 200 240.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,413 mnist_classifier_MNISTClassifier 483o5qtx a217532d-ab76-4383-8c45-70bcbe410fdd -- POST / 200 241.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,413 mnist_classifier_MNISTClassifier 483o5qtx 9e786cec-b62e-4188-a373-b732c98c7f4e -- POST / 200 238.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,414 mnist_classifier_MNISTClassifier 483o5qtx d9a9742a-52e3-46d9-9efe-ef77380f3c9e -- POST / 200 242.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,473 mnist_classifier_MNISTClassifier 483o5qtx 82c6c756-359e-4d21-a6d9-6fb116802760 -- POST / 200 301.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,474 mnist_classifier_MNISTClassifier 483o5qtx 1ab9f15f-8fda-4f7e-99b0-42fcbc7f3f36 -- POST / 200 301.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,475 mnist_classifier_MNISTClassifier 483o5qtx 66a6eb2e-3efd-448d-b2f6-6ba77d9b3348 -- POST / 200 296.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,475 mnist_classifier_MNISTClassifier 483o5qtx b4817621-c7c7-4508-9c1c-d954b840b63a -- POST / 200 298.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,476 mnist_classifier_MNISTClassifier 483o5qtx 025ddfee-1aae-4bf5-893e-22bb5132725f -- POST / 200 298.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,478 mnist_classifier_MNISTClassifier 483o5qtx 8149f140-ae9d-4977-9dae-c9696c50ebd9 -- POST / 200 302.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,479 mnist_classifier_MNISTClassifier 483o5qtx fcb81305-37fb-428d-84df-e6cf595fdc6c -- POST / 200 300.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,479 mnist_classifier_MNISTClassifier 483o5qtx 7f344f23-1b29-4234-b665-c8f49e98b272 -- POST / 200 300.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,480 mnist_classifier_MNISTClassifier 483o5qtx 84d6d1bd-5f29-4c58-84d0-ac076a8aef64 -- POST / 200 300.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,483 mnist_classifier_MNISTClassifier 483o5qtx fc514979-0313-414e-9954-212931edab28 -- POST / 200 302.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,483 mnist_classifier_MNISTClassifier 483o5qtx 4daa41ef-23c5-46f9-8b2b-f4714cbf01c4 -- POST / 200 301.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,483 mnist_classifier_MNISTClassifier 483o5qtx 67f86ec9-61a6-4650-86f9-ec51258bbb77 -- POST / 200 300.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,484 mnist_classifier_MNISTClassifier 483o5qtx 99a4f9bc-f353-45cd-90a8-c59cd408cc91 -- POST / 200 261.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,484 mnist_classifier_MNISTClassifier 483o5qtx 33fee698-8f3c-4e67-bb6b-4ef2d421f83c -- POST / 200 261.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,484 mnist_classifier_MNISTClassifier 483o5qtx b3719d94-bbc4-49c5-9f86-22eb26cba2e8 -- POST / 200 261.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,485 mnist_classifier_MNISTClassifier 483o5qtx 40a564e7-7f9c-44af-bba7-413aeff87c93 -- POST / 200 262.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,485 mnist_classifier_MNISTClassifier 483o5qtx 3aa311b3-6228-415e-840b-9946ad02ac2e -- POST / 200 223.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,485 mnist_classifier_MNISTClassifier 483o5qtx 291351fd-cb73-412b-aa4e-9ba574c8c22c -- POST / 200 223.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,485 mnist_classifier_MNISTClassifier 483o5qtx 5fb2dd2d-0561-4013-949e-ec1b1eaf1805 -- POST / 200 217.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,486 mnist_classifier_MNISTClassifier 483o5qtx ce884eba-a523-4b69-b7c2-578d29168a97 -- POST / 200 212.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,486 mnist_classifier_MNISTClassifier 483o5qtx bc005ec3-9bb5-4ad0-a395-61e36bead41f -- POST / 200 210.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,486 mnist_classifier_MNISTClassifier 483o5qtx a69a99b7-d536-4c13-9308-423cf2032eb7 -- POST / 200 208.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,487 mnist_classifier_MNISTClassifier 483o5qtx 0c749eb0-2207-48d0-bff8-abc9c3d3c664 -- POST / 200 208.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,487 mnist_classifier_MNISTClassifier 483o5qtx 02684981-3c4f-4a2f-b314-824d2bee7721 -- POST / 200 207.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,488 mnist_classifier_MNISTClassifier 483o5qtx 87e5289e-7d2a-4203-86ec-53b599b23bf0 -- POST / 200 203.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,489 mnist_classifier_MNISTClassifier 483o5qtx a095be7f-0685-409c-9bf0-84977673b77d -- POST / 200 200.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,489 mnist_classifier_MNISTClassifier 483o5qtx e708a167-456f-4dfd-9832-4ddc94ffb2d2 -- POST / 200 203.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,489 mnist_classifier_MNISTClassifier 483o5qtx c5ad073a-a183-4c13-9b71-238c1b8ac619 -- POST / 200 208.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,490 mnist_classifier_MNISTClassifier 483o5qtx fe442904-52c6-493f-a6a6-56624762a582 -- POST / 200 208.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,490 mnist_classifier_MNISTClassifier 483o5qtx d1b23924-eb60-4a30-a8e1-c8e1e0f1c20a -- POST / 200 208.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,493 mnist_classifier_MNISTClassifier 483o5qtx e518de1e-7201-4297-bada-9f58b3737ebe -- POST / 200 210.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,493 mnist_classifier_MNISTClassifier 483o5qtx d50ee32c-3bcd-4594-aaa4-ede9111a0a52 -- POST / 200 209.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,493 mnist_classifier_MNISTClassifier 483o5qtx fa1ce94c-51cb-4386-8cd2-287ed236c59a -- POST / 200 204.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,493 mnist_classifier_MNISTClassifier 483o5qtx 2fb262e3-da3b-494d-bbcd-7619b59a4d69 -- POST / 200 205.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,493 mnist_classifier_MNISTClassifier 483o5qtx 2ba1a1fc-2a3d-42c6-b22c-3c0bf6d8eab4 -- POST / 200 201.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,494 mnist_classifier_MNISTClassifier 483o5qtx a83cd799-73de-4c63-9c2d-fa0b762f2562 -- POST / 200 201.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,494 mnist_classifier_MNISTClassifier 483o5qtx b01d5820-1ba7-490b-900e-0c71bfc80399 -- POST / 200 200.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,494 mnist_classifier_MNISTClassifier 483o5qtx 6c1df266-abb5-424f-baf3-f23aa19becb1 -- POST / 200 199.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,494 mnist_classifier_MNISTClassifier 483o5qtx 44a4aafb-0d0d-404f-b796-9dd66e68f04c -- POST / 200 200.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,495 mnist_classifier_MNISTClassifier 483o5qtx 7925b616-b90e-42cf-b974-5df463cf23f2 -- POST / 200 198.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,495 mnist_classifier_MNISTClassifier 483o5qtx 7b16b059-f533-4324-beb2-172620781564 -- POST / 200 188.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,495 mnist_classifier_MNISTClassifier 483o5qtx bdb7598f-6b07-4605-ba94-cd2a79bbacf1 -- POST / 200 199.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,495 mnist_classifier_MNISTClassifier 483o5qtx ae88c5b8-7e96-4692-9a21-c536dc6814ad -- POST / 200 199.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,496 mnist_classifier_MNISTClassifier 483o5qtx 116c8efd-7045-48f2-9452-b94d96f73871 -- POST / 200 185.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,496 mnist_classifier_MNISTClassifier 483o5qtx 00a392fc-2f90-4be9-956e-090f45e79a25 -- POST / 200 186.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,496 mnist_classifier_MNISTClassifier 483o5qtx 779b1559-918a-4a30-a9ba-a277d62e2e43 -- POST / 200 183.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,497 mnist_classifier_MNISTClassifier 483o5qtx 1aab1de4-a57f-44e2-9df3-bb06727200cd -- POST / 200 184.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,636 mnist_classifier_MNISTClassifier 483o5qtx c9b5431f-0e63-4cb3-ac8d-aeb0597a7fdb -- POST / 200 321.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,649 mnist_classifier_MNISTClassifier 483o5qtx 5e53b3b7-8fc6-4bff-95a1-3bcddcdf7ba1 -- POST / 200 333.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,652 mnist_classifier_MNISTClassifier 483o5qtx 2a91c9db-7a35-4c29-bd2f-0255bc40b300 -- POST / 200 335.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,653 mnist_classifier_MNISTClassifier 483o5qtx c0b435de-296a-4fc7-892a-32c9f9e6ccaa -- POST / 200 329.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,784 mnist_classifier_MNISTClassifier 483o5qtx 364c5b8a-8f36-478d-87d6-a7281333cc67 -- POST / 200 268.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,785 mnist_classifier_MNISTClassifier 483o5qtx 40977205-f51a-49b3-90b8-aa173876eeca -- POST / 200 266.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,785 mnist_classifier_MNISTClassifier 483o5qtx 4a4e747e-9de4-4fe1-bd66-7a12948326c0 -- POST / 200 267.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,786 mnist_classifier_MNISTClassifier 483o5qtx 6bdffa57-7c01-4017-84db-eb19271a201f -- POST / 200 267.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,786 mnist_classifier_MNISTClassifier 483o5qtx 14d51927-c104-436b-b066-bf02b5daf128 -- POST / 200 266.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,787 mnist_classifier_MNISTClassifier 483o5qtx a5cee0ec-29b1-485a-8282-47876a5517b5 -- POST / 200 258.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,788 mnist_classifier_MNISTClassifier 483o5qtx 650e55ca-7e8f-4517-b73b-236fcc1dc3e5 -- POST / 200 263.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,789 mnist_classifier_MNISTClassifier 483o5qtx bd76aeaf-9df3-4e4e-83e0-0be545c7a146 -- POST / 200 242.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,790 mnist_classifier_MNISTClassifier 483o5qtx c71ed3cc-195c-4089-959e-9d6ca541c319 -- POST / 200 259.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,790 mnist_classifier_MNISTClassifier 483o5qtx dad8c9b6-d29c-48cd-b3b9-841462172ae1 -- POST / 200 258.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,793 mnist_classifier_MNISTClassifier 483o5qtx 046bd220-efba-4416-b63d-65396aaef4a1 -- POST / 200 258.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,793 mnist_classifier_MNISTClassifier 483o5qtx a2d17b74-8d80-423c-970a-981764cfafdb -- POST / 200 251.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,793 mnist_classifier_MNISTClassifier 483o5qtx d3feac38-4eb6-43f2-bac4-29e74eb2bdc1 -- POST / 200 250.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,794 mnist_classifier_MNISTClassifier 483o5qtx ae5882e7-227b-4111-aae9-6d67acb252b7 -- POST / 200 250.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,794 mnist_classifier_MNISTClassifier 483o5qtx ddeb9535-f363-401c-951f-0cd75a0a4631 -- POST / 200 250.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,794 mnist_classifier_MNISTClassifier 483o5qtx 4a922eae-63b3-4655-98fa-8eb2ed1c7ff9 -- POST / 200 248.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,794 mnist_classifier_MNISTClassifier 483o5qtx 247a7dbd-3952-4723-91cc-cd34fb8fb1bc -- POST / 200 246.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,795 mnist_classifier_MNISTClassifier 483o5qtx e5468c92-f05e-4158-927b-c9f76c7baa0d -- POST / 200 248.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,795 mnist_classifier_MNISTClassifier 483o5qtx aa6f32e4-3e8e-425e-afaa-c1decfcd4395 -- POST / 200 226.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,795 mnist_classifier_MNISTClassifier 483o5qtx 297039d9-0f17-42c0-aade-a3c1fa7a6a0c -- POST / 200 225.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,796 mnist_classifier_MNISTClassifier 483o5qtx 273c2edb-cc54-4ca3-8b6a-1a865b39b18d -- POST / 200 248.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,796 mnist_classifier_MNISTClassifier 483o5qtx 4018c96c-a15f-427a-a64e-75e6f1563b99 -- POST / 200 248.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,797 mnist_classifier_MNISTClassifier 483o5qtx 047420db-c901-4f60-aced-b6f3538c91fd -- POST / 200 247.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,797 mnist_classifier_MNISTClassifier 483o5qtx b1cdfd7b-09ec-40bf-8458-2b7cbfe3f36e -- POST / 200 247.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,797 mnist_classifier_MNISTClassifier 483o5qtx 369f52e2-e26a-4ef4-82e1-99aed755898f -- POST / 200 246.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,797 mnist_classifier_MNISTClassifier 483o5qtx ba02bacd-2658-4bf2-bf33-dda49bc31a33 -- POST / 200 244.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,798 mnist_classifier_MNISTClassifier 483o5qtx a6100ef5-1db2-49c0-9dce-940fbdb29995 -- POST / 200 243.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,798 mnist_classifier_MNISTClassifier 483o5qtx 61fdf082-fc45-4900-95ac-5b068ec410d9 -- POST / 200 243.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,798 mnist_classifier_MNISTClassifier 483o5qtx 23b2572b-a168-45ad-b291-a8045223e4cd -- POST / 200 238.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,798 mnist_classifier_MNISTClassifier 483o5qtx e261a0f2-7cc6-4d96-95bf-f8eefdcec07b -- POST / 200 237.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,799 mnist_classifier_MNISTClassifier 483o5qtx 9ff2135b-64bf-4213-b0cf-9a6ef56adeb0 -- POST / 200 228.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,800 mnist_classifier_MNISTClassifier 483o5qtx 30c864bb-58ba-4fcc-9592-f0e3cb12746b -- POST / 200 228.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,801 mnist_classifier_MNISTClassifier 483o5qtx 9b9d058e-50ea-4a41-8db8-51b3c6811a3c -- POST / 200 228.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,801 mnist_classifier_MNISTClassifier 483o5qtx ce5ca201-d020-4bf5-8ba3-f5a711b0eda5 -- POST / 200 226.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,801 mnist_classifier_MNISTClassifier 483o5qtx 11d269ac-523e-462c-a96c-f41a7182e14e -- POST / 200 226.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,802 mnist_classifier_MNISTClassifier 483o5qtx 6810a280-007f-4a00-9ecb-04a2b5eb4705 -- POST / 200 224.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,802 mnist_classifier_MNISTClassifier 483o5qtx ec008375-fd0e-4389-b673-e700978c3a43 -- POST / 200 225.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,802 mnist_classifier_MNISTClassifier 483o5qtx dc96fc3b-7a50-4cfe-82fb-202deec5880c -- POST / 200 224.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,803 mnist_classifier_MNISTClassifier 483o5qtx a935c3a8-04ad-4df3-b3a0-dbfa2d20197b -- POST / 200 222.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,803 mnist_classifier_MNISTClassifier 483o5qtx 6e9672ad-1c0b-4465-a2ca-a62eb2dc9a89 -- POST / 200 224.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,804 mnist_classifier_MNISTClassifier 483o5qtx 0087e8d7-fb27-4225-94b1-a9d0f630ec58 -- POST / 200 222.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,804 mnist_classifier_MNISTClassifier 483o5qtx e2f3f041-a5a2-4499-9b1a-da51cad2658f -- POST / 200 224.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,806 mnist_classifier_MNISTClassifier 483o5qtx 61f8522f-a56a-4d56-be78-2b6ae31f076c -- POST / 200 224.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,808 mnist_classifier_MNISTClassifier 483o5qtx 5d80945b-8682-4596-aa69-ab209886c45f -- POST / 200 225.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,811 mnist_classifier_MNISTClassifier 483o5qtx dee0cb0c-d5ff-4221-aec9-38f7deabd330 -- POST / 200 227.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,812 mnist_classifier_MNISTClassifier 483o5qtx 69a5c44b-bceb-4d60-8f54-092552ac820f -- POST / 200 226.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,813 mnist_classifier_MNISTClassifier 483o5qtx 4c3c83bd-eb6d-45dc-9c2e-4ece92012a3c -- POST / 200 229.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,814 mnist_classifier_MNISTClassifier 483o5qtx 0ec5c0f3-8ce7-436f-972e-4c2d6d8f31e4 -- POST / 200 228.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,814 mnist_classifier_MNISTClassifier 483o5qtx ce73b9fb-cc1c-402e-af61-1355a26e2423 -- POST / 200 223.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,815 mnist_classifier_MNISTClassifier 483o5qtx dd696d50-0d32-45cf-a1d8-9167f5caacb8 -- POST / 200 227.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,815 mnist_classifier_MNISTClassifier 483o5qtx 54463a51-6ccf-49c2-b253-1b34fafd26b7 -- POST / 200 225.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,815 mnist_classifier_MNISTClassifier 483o5qtx 46ed25c9-3e43-4d03-a9b1-4de05c2f9c3d -- POST / 200 222.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,815 mnist_classifier_MNISTClassifier 483o5qtx 60d689ea-41b7-4108-9dd6-1a8c4a2edb42 -- POST / 200 212.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,816 mnist_classifier_MNISTClassifier 483o5qtx 66127a62-9993-4727-9fb3-99dd57b91867 -- POST / 200 222.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,816 mnist_classifier_MNISTClassifier 483o5qtx a4b9aa1d-041b-4660-9e3e-53f9397b00f8 -- POST / 200 210.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,816 mnist_classifier_MNISTClassifier 483o5qtx 1731d901-2aa3-4b1a-bd5e-0e2963c90a97 -- POST / 200 223.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,817 mnist_classifier_MNISTClassifier 483o5qtx ae461e3b-9b53-40ae-9757-4e8a70a580ca -- POST / 200 223.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,817 mnist_classifier_MNISTClassifier 483o5qtx 5974c0c8-cc32-4e8b-a8f8-956f42a6609e -- POST / 200 222.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,817 mnist_classifier_MNISTClassifier 483o5qtx 558ba581-07ad-493b-ad7f-d8789d0d6792 -- POST / 200 223.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,818 mnist_classifier_MNISTClassifier 483o5qtx bdb32158-d2ac-4e19-99c5-f744536202ad -- POST / 200 222.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,818 mnist_classifier_MNISTClassifier 483o5qtx 19fc1616-54a3-4248-b7ea-bbeab7247ebe -- POST / 200 221.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,818 mnist_classifier_MNISTClassifier 483o5qtx eec99080-03d2-4468-9cd8-084eb2c789d1 -- POST / 200 219.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,819 mnist_classifier_MNISTClassifier 483o5qtx 1286128b-dbc7-45a4-adc5-abdb4f4cf43f -- POST / 200 219.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,820 mnist_classifier_MNISTClassifier 483o5qtx a7b4dad2-86e1-4e2e-a990-f3d7f7478eda -- POST / 200 212.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,830 mnist_classifier_MNISTClassifier 483o5qtx 928c09af-ec9c-41f0-a729-bfb7c50465fc -- POST / 200 222.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,831 mnist_classifier_MNISTClassifier 483o5qtx 325d0a84-a109-41bd-9531-c57989adda5c -- POST / 200 222.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,832 mnist_classifier_MNISTClassifier 483o5qtx 63b515f7-eeea-4b24-b58a-6344d0021497 -- POST / 200 222.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,832 mnist_classifier_MNISTClassifier 483o5qtx 34f2b1fa-5d6d-451a-9776-7c5e99e626f2 -- POST / 200 222.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,832 mnist_classifier_MNISTClassifier 483o5qtx 8b3c0d37-6a87-40b3-b35a-325cb3aefb34 -- POST / 200 221.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,834 mnist_classifier_MNISTClassifier 483o5qtx da04d01b-0452-45f4-b3fa-8d1f522c6cfb -- POST / 200 219.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,835 mnist_classifier_MNISTClassifier 483o5qtx f34540d4-3352-4b76-b6a0-0acf9d57e789 -- POST / 200 222.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,835 mnist_classifier_MNISTClassifier 483o5qtx 8bb834fc-e294-4012-b536-acab4ed80d99 -- POST / 200 223.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,835 mnist_classifier_MNISTClassifier 483o5qtx 7c3dc456-5b33-4f9a-a2c5-84d488578b45 -- POST / 200 219.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,835 mnist_classifier_MNISTClassifier 483o5qtx a15de739-0209-47d6-8608-cba8764524f7 -- POST / 200 222.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,835 mnist_classifier_MNISTClassifier 483o5qtx f7dc2349-8bb4-4106-94f0-f1b81860d379 -- POST / 200 221.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,835 mnist_classifier_MNISTClassifier 483o5qtx 35cc3e7b-0fd2-45f8-9dea-446ad666424f -- POST / 200 218.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,835 mnist_classifier_MNISTClassifier 483o5qtx 0f5a5d08-177b-476f-a274-980fed1f7773 -- POST / 200 217.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,836 mnist_classifier_MNISTClassifier 483o5qtx 6074f403-ee94-46ff-bbbc-01f90d93aa89 -- POST / 200 234.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,836 mnist_classifier_MNISTClassifier 483o5qtx debad42b-4692-4fce-a6a9-39571a402075 -- POST / 200 234.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,837 mnist_classifier_MNISTClassifier 483o5qtx 9d59e782-c4f9-4c0e-bb6d-bbcec92b5b7c -- POST / 200 234.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,837 mnist_classifier_MNISTClassifier 483o5qtx d1d8efe7-e4fa-4d10-95a5-10b9822d1c2e -- POST / 200 218.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,837 mnist_classifier_MNISTClassifier 483o5qtx 8ca5423f-9fdc-488c-9011-917129557d6c -- POST / 200 217.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,837 mnist_classifier_MNISTClassifier 483o5qtx d9c453ab-4730-4b76-8ab8-8702b3dcf981 -- POST / 200 217.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,838 mnist_classifier_MNISTClassifier 483o5qtx 5f929b5b-b465-4d82-8ccf-3867e7a4891f -- POST / 200 218.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,838 mnist_classifier_MNISTClassifier 483o5qtx a0d09a56-6247-4c1f-bc8f-f82690443fa8 -- POST / 200 211.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,839 mnist_classifier_MNISTClassifier 483o5qtx 5239af83-c87c-40a0-ae81-8216cd1ae19f -- POST / 200 211.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,839 mnist_classifier_MNISTClassifier 483o5qtx 6301c19a-fa43-4ae6-ad37-6709d07987a0 -- POST / 200 210.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,839 mnist_classifier_MNISTClassifier 483o5qtx bc4bb9e4-76f2-42a6-b3bb-ea128eb5a68a -- POST / 200 210.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,840 mnist_classifier_MNISTClassifier 483o5qtx 0c571cbe-861c-4bfb-aea5-b222d7115c7a -- POST / 200 208.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,840 mnist_classifier_MNISTClassifier 483o5qtx 1207140d-f235-4096-882e-242a8a977886 -- POST / 200 207.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,841 mnist_classifier_MNISTClassifier 483o5qtx 44b4d35a-6df5-42c7-a74e-79db3f76e896 -- POST / 200 207.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,841 mnist_classifier_MNISTClassifier 483o5qtx f6bba64e-4b04-4289-822a-5ff9ac989780 -- POST / 200 207.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,841 mnist_classifier_MNISTClassifier 483o5qtx c6166675-bc12-484e-9d2c-668789c5bea0 -- POST / 200 205.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,841 mnist_classifier_MNISTClassifier 483o5qtx da580f56-371f-4a20-ad0f-bb078f8b54d6 -- POST / 200 205.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,842 mnist_classifier_MNISTClassifier 483o5qtx 59768c28-c6e9-44c9-8495-7da872eff786 -- POST / 200 190.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,842 mnist_classifier_MNISTClassifier 483o5qtx 215ef047-2087-4d69-a9a1-1aea6f8c75ef -- POST / 200 187.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,843 mnist_classifier_MNISTClassifier 483o5qtx 001d2505-4879-4e16-ac14-fc20dae20fbd -- POST / 200 156.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,843 mnist_classifier_MNISTClassifier 483o5qtx cddef165-6fc6-45b3-b1bc-086bb92fb015 -- POST / 200 156.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,843 mnist_classifier_MNISTClassifier 483o5qtx 48021734-2df8-4768-8d24-e189d32370ab -- POST / 200 156.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4534) INFO 2026-04-01 13:44:39,843 mnist_classifier_MNISTClassifier 483o5qtx 4c74598e-d017-4f93-a0d0-c3bc64fcd001 -- POST / 200 154.8ms
Processed 1000 requests in 4.94 seconds
Throughput: 202.44 requests/second

Ray Serve automatically buffers and load balances requests across the replicas.

Fault tolerance#

In production, process and machine failures are inevitable. Ray Serve is designed so that each major component in the Serve stack (the controller, replicas, and proxies) can fail and recover while your application continues to handle traffic.

Serve can also recover from larger infrastructure failures, such as entire nodes or pods failing. Serve can even recover from head node failures, or the entire head pod if deploying on KubeRay.

For more information about Ray Serve’s fault tolerance, see the Ray Serve fault-tolerance guide.

Monitor the deployment#

Monitoring is critical when running large-scale deployments. The Ray dashboard displays Serve metrics like request throughput, latency, and error rates. It also shows cluster resource usage, replica status, and overall deployment health in real time. The dashboard also lets you inspect logs from individual replicas across the cluster.

For debugging, Ray offers distributed debugging tools that let you attach a debugger to running replicas across the cluster. For more information, see the Ray Serve monitoring documentation.

Conclusion#

In this tutorial, you:

Deployed a PyTorch model using Ray Serve with production best practices.
Enabled dynamic request batching to optimize performance.
Configured autoscaling and fractional GPU allocation to efficiently scale across a cluster.
Tested the service with concurrent asynchronous requests.