GPU Server

Available in Classic

This guide describes how to create and manage a GPU Server in the NAVER Cloud Platform console.

View server information

You can view GPU server information in the same way as general server information. For more information, see Check server information.

Create server

To create a GPU server, navigate to Menu > All Services > Compute > Server in the Classic environment of the NAVER Cloud Platform console. For more information on how to create a server, see Create server.

Manage server

You can manage and change GPU server settings in the same way as general servers. For more information, see Manage server.

Reinstall and upgrade the GPU driver/CUDA

In the following situations during use of a GPU Server, you can reinstall the GPU driver and CUDA of the server:

• If the OS kernel version is changed (updated) and is no longer compatible with the current GPU driver: Reinstall the GPU driver only.
• If you need to upgrade an old version GPU driver currently in use to the latest driver provided on NAVER Cloud Platform
• If you need to upgrade the driver to a specific version

See the following guides depending on your OS:

• Reinstall GPU driver (Linux)
• Reinstall CUDA (Linux)
• Reinstall GPU driver (Windows)
• Reinstall CUDA (Windows)

Reinstall GPU driver (Linux)

The driver versions provided by NAVER Cloud Platform can be reinstalled through scripts.
If you plan to use a separate version, follow the manual reinstallation procedure.

Reinstall through scripts

To reinstall the GPU driver through scripts:

1. Enter the wget http://init.ncloud.com/gpu/ncp_gpu_reinstall.sh commands to download the script file.
2. Enter the ./ncp_gpu_reinstall.sh commands to delete the existing GPU driver.
3. Reboot the server.
4. Re-enter the ./ncp_gpu_reinstall.sh commands to reinstall the GPU driver.

Manual reinstallation

If you fail to reinstall the driver through scripts, or if you want to change and install the GPU driver version, follow these steps:

1. Download the driver file of the version you wish to reinstall or upgrade the driver to.
   • Access the NVIDIA Driver download website.
2. Enter the following command to delete the existing GPU driver:
   • Example: Default version 535.161.08 provided by NAVER Cloud Platform

   # ./NVIDIA-Linux-x86_64-535.161.08.run -s
   Verifying archive integrity... OK
   Uncompressing NVIDIA Accelerated Graphics Driver for Linux-x86_64    535.161.08..........................................................................................................
   

3. Reboot the server.
4. Enter the following commands to install the new GPU driver:

   # ./NVIDIA-Linux-x86_64-535.161.08.run -a --ui=none --no-questions --accept-license
   Verifying archive integrity... OK
   Uncompressing NVIDIA Accelerated Graphics Driver for Linux-x86_64 535.161.08............................................................................................................................................................
   
   Welcome to the NVIDIA Software Installer for Unix/Linux
   
   (Omitted)
   
   Installation of the kernel module for the NVIDIA Accelerated Graphics Driver for Linux-x86_64 (version 535.161.08) is now complete.
   

5. Reboot the server.
6. Enter the nvidia-smi commands to check the version of the successfully installed driver and the model and number of recognized GPU cards.

Reinstall CUDA (Linux)

CUDA operates properly only if cuDNN is reinstalled as well. To install it:

1. Access the CUDA Toolkit download website.
2. Select the CUDA Runtime installation file for the version to install to bring up the download link.
   • For the installation type, select runfile (local), which does not depend on the OS.
3. Check the symbolic link of the existing CUDA path, then delete the actual path directory of the existing version.
   • The existing CUDA Toolkit and cuDNN are deleted.

   # ll /usr/local/cuda
   # lrwxrwxrwx 1 root root 21 Apr 16 15:42 /usr/local/cuda -> /usr/local/cuda-12.2/
   # rm -rf /usr/local/cuda-12.2
   

4. Enter the following command to reinstall CUDA Toolkit:
   • Example: Default version 12.2 provided by NAVER Cloud Platform

   # ./cuda_12.2.2_535.104.05_linux.run --toolkit --toolkitpath=/usr/local/cuda-12.2 --samples --samplespath=/usr/local/cuda-12.2/samples --silent
   

5. Check the version of the reinstalled CUDA.

   # nvcc --version
   

6. Access the cuDNN download website to bring up the download link.
7. Download cuDNN from the link.
8. cuDNN installation does not bring up any installer but is completed simply when the file is unzipped in the directory where CUDA is installed. See the following to install:
   • Example: Default version 8.9.7 provided by NAVER Cloud Platform

   # cd /root
   # tar -xvf cudnn-linux-x86_64-8.9.7.29_cuda12-archive.tar.xz
   # mv cudnn-linux-x86_64-8.9.7.29_cuda12-archive cuda
   # cp cuda/include/cudnn* /usr/local/cuda/include
   # cp cuda/lib64/libcudnn* /usr/local/cuda/lib64
   # chmod a+r /usr/local/cuda/include/cudnn.h /usr/local/cuda/lib64/libcudnn*
   

9. Check the version of the cuDNN installed.
   • How to check cuDNN 8.x criteria

   # cat /usr/local/cuda/include/cudnn_version.h | grep -A2 MAJOR
   #define CUDNN_MAJOR 8
   #define CUDNN_MINOR 9
   #define CUDNN_PATCHLEVEL 7
   

Reinstall GPU driver (Windows)

To reinstall the GPU driver, you can simply run the script for auto installation.
If automatic reinstallation fails, you can reinstall the driver manually.

Automatic reinstallation

To download and run a script file for automatic reinstallation of the GPU driver:

1. Enter the following command to download the script file:

   Start-BitsTransfer -Source "http://init.ncloud.com/win_gpu/install_gpu.exe" -Destination "c:\install_gpu.exe"
   

2. Run the install_gpu.exe file.
   • The Nvidia GPU driver install popup window appears, and installation takes about 10 to 15 minutes.
3. When the installation complete popup window appears, reboot the server.
4. Enter the run - devmgmt.msc command to open the device manager console.
5. In the device manager console, double click the NVIDIA graphics card under Display Adapters.
6. Under the [Driver] tab on the properties popup window, check the driver version.
7. Open the cmd window and enter cd C:\Program Files\NVIDIA Corporation\NVSMI to relocate the driver, then enter nvidia-smi.
   • You can see that the graphics card has been recognized.

Manual reinstallation

If you are unable to run automatic reinstallation using the script, to reinstall the GPU driver manually, follow these steps:

1. Download the driver file of the version you wish to reinstall or upgrade the driver to from the GPU driver download website.
   • Example: Default version 461.33 provided by NAVER Cloud Platform
2. Run the downloaded GPU driver EXE file to install the driver.
   • Follow the instructions on the installer popup window.
   • You must agree to the software's terms of service to use it.
   • For the Installation option, select Express.
3. Reboot the server.
4. Enter the run - devmgmt.msc command to open the device manager console.
5. In the device manager console, double click the NVIDIA graphics card under Display Adapters.
6. Under the [Driver] tab on the properties popup window, check the driver version.

Reinstall CUDA (Windows)

CUDA operates properly only if cuDNN is reinstalled as well. To install it:

1. Access the CUDA Toolkit download website.
2. Set the platform, then click the link to download the EXE file.
3. Run the downloaded CUDA EXE file to install CUDA.
   • Follow the instructions on the installer popup window.
   • You must agree to the software's terms of service to use it.
   • For the Installation option, select Express.
4. Log in to the cuDNN download website, then download cuDNN file of the desired version.
   Note

   Only members can download cuDNN. If you have no account, sign up as a member, then log in.

5. Unzip the downloaded ZIP file, then replace the bin, include, and lib folders in the CUDA 11.2.2 installation path with folders of the same names from the ZIP file.
6. Open the cmd window and enter cd C:\Program Files\NVIDIA Corporation\NVSMI to relocate the driver, then enter nvidia-smi.
   • You can see that the graphics card has been recognized.

Collect/forward diagnostic data through NTK

You can collect and forward the NVIDIA debug logs of GPU VM through Ncloud Tool Kit (NTK).
The process of collecting and forwarding the debug logs is as follows:

1. Executing NTK
2. Collect GPU debug logs

1. Executing NTK

To run NTK on a Linux server:

1. Enter the cd /usr/local/etc command.
   • Move to the path where NTK is located.
2. Enter the tar zxvf ntk.tar.gz command.
   • The NTK file is unzipped.
   • If no ntk.tar.gz file exists or if you wish to replace the existing file with the latest version, enter wget -P /usr/local/etc http://init.ncloud.com/server/ntk/linux/xen/ntk.tar.gz to download the file.
3. Enter the /usr/local/etc/ntk/ntk commands to run NTK.

2. Collect GPU debug logs

To collect GPU debug logs in NTK:

1. On the main interface of NTK, select E EXECUTE - << Run System Apps >>.
   

2. Select G GPU DEBUG COLLECTING - FOR LOG COLLECT >>.
   

3. Select Yes to run the log collection script.
   

4. When a log collection success message and the log file storage path are displayed, check the details, then select OK.
   

5. Select whether to transfer the log file to NAVER Cloud's technical support center.

• If you want to transfer the log file, select Yes. The file transfer starts right away. If the file is transferred, a success message and the ShortURL where you can download the log are displayed.
• If you do not want to transfer the log file, select No to end it.
  

Transfer created logs

To transfer the created logs to NAVER Cloud's technical support center:

1. On the main interface of NTK, select V VIEW - << View & Upload Logs >>.
   

2. Select G - GPU DEBUG FILES.
   

3. Check the list of log files created, then select the log files to transfer to NAVER Cloud's technical support center.
   

4. Select Yes.

   • The file transfer starts right away. If the file is transferred, a success message and the ShortURL where you can download the log are displayed.
     

GPU debug log file types

The following are the types of GPU log files created through NTK: