Skip to content
Open
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Original file line number Diff line number Diff line change
Expand Up @@ -109,11 +109,11 @@ This tutorial teaches users how to submit tasks to the SHS GPU Cluster. It assum
| Lesson | Objective |
|-----------------------------------|-------------------------------------|
| [Getting started with Kubernetes](training/L1_getting_started.md) | a. What is Kubernetes?<br>b. How to send a task to a GPU node.<br>c. How to define the GPU resources needed. |
| [Building and Testing Containers](training/L1.1_building-and-testing-containers.md) | a. How to build container images.<br>b. How to test containers locally.<br>c. Best practices for container setup. |
| [Using Containers in the SHS](training/L2_using-containers-in-the-tre.md) | a. How to run containers inside the SHS.<br>b. Security considerations for SHS containers.<br>c. How to manage container dependencies. |
| [Creating Your First Pod Template](training/L2.1_creating-your-first-pod-template.md) | a. What is a Kubernetes pod template.<br>b. How to define pod resources.<br>c. How to submit a pod to the GPU cluster. |
| [Accessing the BeeGFS Inside the SHS _GPU Cluster_](training/L3_Accessing_the_BeeGFS_Inside_the_EPCC_TRE.md) | a. How to access BeeGFS from the SHS _GPU Cluster_.<br>b. How to read/write data efficiently.<br>c. Best practices for using shared storage. |
| [Requesting Persistent Volumes](training/L4_requesting_persistent_volumes.md) | a. How pods use persistent storage (Persistent Volumes and Persistent Volume Claims).<br>b. How SHS _GPU Cluster_ users access pre-provisioned storage via Persistent Volume Claims.<br>c. How to attach Persistent Volume Claims to pods using volumeMounts and proper securityContext. |
| [Building and Testing Containers](training/L2_building_and_testing_containers.md) | a. How to build container images.<br>b. How to test containers locally.<br>c. Best practices for container setup. |
| [Using Containers in the SHS](training/L3_using_containers_in_the_shs.md) | a. How to run containers inside the SHS.<br>b. Security considerations for SHS containers.<br>c. How to manage container dependencies. |
| [Creating Your First Pod Template](training/L4_creating_your_first_pod_template.md) | a. What is a Kubernetes pod template.<br>b. How to define pod resources.<br>c. How to submit a pod to the GPU cluster. |
| [Accessing the BeeGFS Inside the SHS _GPU Cluster_](training/L5_accessing_the_beegfs_inside_the_epcc_shs.md) | a. How to access BeeGFS from the SHS _GPU Cluster_.<br>b. How to read/write data efficiently.<br>c. Best practices for using shared storage. |
| [Requesting Persistent Volumes](training/L6_requesting_persistent_volumes.md) | a. How pods use persistent storage (Persistent Volumes and Persistent Volume Claims).<br>b. How SHS _GPU Cluster_ users access pre-provisioned storage via Persistent Volume Claims.<br>c. How to attach Persistent Volume Claims to pods using volumeMounts and proper securityContext. |

## Further Reading and Help

Expand Down

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Please rename to ... in-the-EPCC-SHS.md

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

page links are updated

File renamed without changes.

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Please rename to ... in-the-EPCC-SHS.md

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

page links are updated

File renamed without changes.
Original file line number Diff line number Diff line change
Expand Up @@ -2,7 +2,7 @@

## Requirements

It is recommended that users complete [Getting started with Kubernetes](./L1_getting_started.md) and [Requesting persistent volumes With Kubernetes](./L4_requesting_persistent_volumes.md) before proceeding with this tutorial.
It is recommended that users complete [Getting started with Kubernetes](./L1_getting_started.md) and [Requesting persistent volumes With Kubernetes](./L6_requesting_persistent_volumes.md) before proceeding with this tutorial.

## Overview

Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -2,7 +2,7 @@

## Requirements

It is recommended that users complete [Getting started with Kubernetes](./L1_getting_started.md) and [Requesting persistent volumes With Kubernetes](./L4_requesting_persistent_volumes.md) before proceeding with this tutorial.
It is recommended that users complete [Getting started with Kubernetes](./L1_getting_started.md) and [Requesting persistent volumes With Kubernetes](./L6_requesting_persistent_volumes.md) before proceeding with this tutorial.

## Overview

Expand Down Expand Up @@ -32,7 +32,7 @@ The SHS GPU Cluster contains GPUs with 40Gb/80Gb of on board memory and it is ex

Persistent volume claims need to be of sufficient size to hold the input data, any expected output data and a small amount of additional empty space to facilitate IO.

Read the [requesting persistent volumes with Kubernetes](L4_requesting_persistent_volumes.md) lesson to learn how to request and mount persistent volumes to pods.
Read the [requesting persistent volumes with Kubernetes](L6_requesting_persistent_volumes.md) lesson to learn how to request and mount persistent volumes to pods.

It often takes several hours or days to download data sets of 1/2 TB or more to a persistent volume.

Expand Down
27 changes: 12 additions & 15 deletions mkdocs.yml
Original file line number Diff line number Diff line change
Expand Up @@ -127,21 +127,18 @@ nav:
- "Development Workflow": safe-haven-services/shs-container-user-guide/development-workflow.md
- "Workflow Examples": safe-haven-services/shs-container-user-guide/workflow-examples.md
- "Container Examples": safe-haven-services/shs-container-user-guide/container-examples.md
# TRE GPU service docs can be uncommented and added to
# the navigation menu when the TRE GPU service is made
# available to TRE tenants. See Umair Ayub and Kostas for details.
# - "TRE GPU Service":
# - "Overview": safe-haven-services/tre-gpu-service/index.md
# - "Policies": safe-haven-services/tre-gpu-service/policies.md
# - "Kueue": safe-haven-services/tre-gpu-service/kueue.md
# - "Tutorials":
# - "Getting Started": safe-haven-services/tre-gpu-service/training/L1_getting_started.md
# - "Building and Pushing Containers to GHCR": safe-haven-services/tre-gpu-service/training/L1.1_building-and-testing-containers.md
# - "Downloading Containers in the TRE GPU Cluster": safe-haven-services/tre-gpu-service/training/L2_using-containers-in-the-tre.md
# - "Creating your first pod template within a job yaml file": safe-haven-services/tre-gpu-service/training/L2.1_creating-your-first-pod-template.md
# - "Transfer Data Inside the TRE GPU Cluster": safe-haven-services/tre-gpu-service/training/L3_Accessing_the_BeeGFS_Inside_the_EPCC_TRE.md
# - "Persistent Volumes": safe-haven-services/tre-gpu-service/training/L4_requesting_persistent_volumes.md
# - "GPU Service FAQ": safe-haven-services/tre-gpu-service/faq.md
- "SHS GPU Cluster":
- "Overview": safe-haven-services/shs-gpu-cluster/index.md
- "Policies": safe-haven-services/shs-gpu-cluster/policies.md
- "Kueue": safe-haven-services/shs-gpu-cluster/kueue.md
- "Tutorials":
- "Getting Started": safe-haven-services/shs-gpu-cluster/training/L1_getting_started.md
- "Building and Pushing Containers to GHCR": safe-haven-services/shs-gpu-cluster/training/L2_building_and_testing_containers.md
- "Downloading Containers in the SHS GPU Cluster": safe-haven-services/shs-gpu-cluster/training/L3_using_containers_in_the_shs.md
- "Creating your first pod template within a job yaml file": safe-haven-services/shs-gpu-cluster/training/L4_creating_your_first_pod_template.md
- "Transfer Data Inside the SHS GPU Cluster": safe-haven-services/shs-gpu-cluster/training/L5_accessing_the_beegfs_inside_the_epcc_shs.md
- "Persistent Volumes": safe-haven-services/shs-gpu-cluster/training/L6_requesting_persistent_volumes.md
- "SHS GPU Cluster FAQ": safe-haven-services/shs-gpu-cluster/faq.md
# Application Services (Open OnDemand) docs can be uncommented
# and added to the navigation menu when the service is made
# available to safe haven users. See MikeJ for details.
Expand Down