To support you with running your workloads, we have curated a set of reproducible benchmark recipes that use some of the most common machine learning (ML) frameworks and models. These are stored in GitHub repositories. To access these repositories, see AI Hypercomputer GitHub organization. These benchmark recipes were tested on clusters created using Cluster Toolkit.

Overview

Before you get started with these recipes, ensure that you have completed the following steps:

1. Choose an accelerator that best suits your workload. See Choose a deployment strategy.
2. Select a consumption method based on your accelerator of choice, see Consumption options.
3. Create your cluster based on the type of accelerator selected. See Cluster deployment guides.

The following reproducible benchmark recipes are available for pre-training and inference on GKE clusters.

To search the catalog, you can filter by a combination of your framework, model, and accelerator.