Skip to content
Merged
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
12 changes: 8 additions & 4 deletions docs/deployments/deployment-preparation/numa-considerations.md
Original file line number Diff line number Diff line change
Expand Up @@ -9,12 +9,12 @@ Modern multi-socket servers use a memory architecture called
In a NUMA system, each CPU socket has its own local memory and I/O paths. Accessing local resources is faster than
reaching across sockets to remote memory or devices. Simplyblock is fully NUMA-aware.

On a host with more than one socket, by default one or two storage nodes are deployed per socket.
On a host with more than one socket, by default one storage node is deployed per NUMA node.

Two storage nodes per socket are deployed if:
In rare cases, it can make sense to deploy more than one storage node per NUMA node (disaggregated deployment only):

- more than 32 vCPUs (cores) per NUMA socket are dedicated to simplyblock per socket
- more than 10 NVMe devices are connected to the NUMA socket
- A single socket has attached more than 10 NVMe.
- A single socket provides more than 48 cores (96 vCPUs).

Users can change this behavior. Either by setting the appropriate Helm Chart parameters (in case of Kubernetes-based
storage node deployment) or by manually modifying the initially created configuration file on the storage node
Expand All @@ -28,6 +28,10 @@ If a socket has no NVMe devices connected, it will not qualify to run a simplybl
It is also important that the NIC(s) used by simplyblock for storage traffic are connected to the same NUMA socket.
However, simplyblock does not auto-assign a NIC and users have manually to take care of that.

!!! Important
In a hyper-converged deployment, it can be preferable to attach all NVMe devices to one socket and only deploy a
node on this socket. This saves overall CPU and RAM required for Simplyblock.

## Checking NUMA Configuration

Before configuring simplyblock, the system configuration should be checked for multiple NUMA nodes. This can be done
Expand Down
Loading