{"id":18955,"date":"2024-07-29T10:29:57","date_gmt":"2024-07-29T14:29:57","guid":{"rendered":"https:\/\/carleton.ca\/scs\/?page_id=18955"},"modified":"2026-06-10T16:11:47","modified_gmt":"2026-06-10T20:11:47","slug":"scs-gpu-vm-2024-5","status":"publish","type":"page","link":"https:\/\/carleton.ca\/scs\/tech-support\/cuda-gpu-computing\/scs-gpu-vm-2024-5\/","title":{"rendered":"SCS GPU VM 2024-5"},"content":{"rendered":"\n<section class=\"w-screen px-6 cu-section cu-section--white ml-offset-center md:px-8 lg:px-14\">\n    <div class=\"space-y-6 cu-max-w-child-5xl  md:space-y-10 cu-prose-first-last\">\n\n            <div class=\"cu-textmedia flex flex-col lg:flex-row mx-auto gap-6 md:gap-10 my-6 md:my-12 first:mt-0 max-w-5xl\">\n        <div class=\"justify-start cu-textmedia-content cu-prose-first-last\" style=\"flex: 0 0 100%;\">\n            <header class=\"font-light prose-xl cu-pageheader md:prose-2xl cu-component-updated cu-prose-first-last\">\n                                    <h1 class=\"cu-prose-first-last font-semibold !mt-2 mb-4 md:mb-6 relative after:absolute after:h-px after:bottom-0 after:bg-cu-red after:left-px text-3xl md:text-4xl lg:text-5xl lg:leading-[3.5rem] pb-5 after:w-10 text-cu-black-700 not-prose\">\n                        SCS GPU VM 2024-5\n                    <\/h1>\n                \n                                \n                            <\/header>\n\n                    <\/div>\n\n            <\/div>\n\n    <\/div>\n<\/section>\n\n\n\n<p><a href=\"#details\">GPU VM Account Details<\/a><br><a href=\"#testing\">Testing the GPU VM software<\/a><br><a href=\"#troubleshooting\">Troubleshooting<\/a><\/p>\n\n\n\n<p>This page will show you how to test your virtual machine&#8217;s GPU and access and test the software that is pre-installed on it. Even though Ubuntu 24.04 is the current long release version we chose Ubuntu 22.04 because some of the dependent libraries were not available for 24.04 at the time of this installation.<\/p>\n\n\n\n<h2 id=\"gpu-vm-account-details\" class=\"wp-block-heading\"><a id=\"details\"><\/a>GPU VM Account Details<\/h2>\n\n\n\n<section class=\"w-screen px-6 cu-section cu-section--white ml-offset-center md:px-8 lg:px-14\">\n    <div class=\"space-y-6 cu-max-w-child-5xl  md:space-y-10 cu-prose-first-last\">\n\n        \n    \n    <dl class=\"cu-description cu-component-updated\">\n        \n    <div class=\"grid pt-4 pb-3 border-b accordion border-cu-black-100 md:pt-6 md:pb-5 first:border-t\">\n        <dt class=\"font-semibold not-prose\">\n            <button class=\"flex items-center justify-between w-full text-left accordion__button\" aria-expanded=\"false\" aria-controls=\"accordion-image-information\">\n                <span class=\"flex-1 ml-auto text-left break-words whitespace-normal cu-icon\">\n                    Image Information\n                <\/span>\n                <svg xmlns=\"http:\/\/www.w3.org\/2000\/svg\" fill=\"none\" viewbox=\"0 0 24 24\" stroke-width=\"1.5\" stroke=\"currentColor\" aria-hidden=\"true\" data-slot=\"icon\" class=\"w-5 h-5 ml-auto transition-transform rotate-0 accordion__icon text-cu-black-500\">\n                    <path stroke-linecap=\"round\" stroke-linejoin=\"round\" d=\"M8.25 4.5l7.5 7.5-7.5 7.5\"><\/path>\n                <\/svg>\n            <\/button>\n        <\/dt>\n        <dd class=\"p-0 mt-0 cu-prose cu-prose-first-last accordion__content md:p-0 md:mt-0\" hidden=\"\" id=\"accordion-image-information\">\n            \n\n<p><strong>Image Name<\/strong>: SCS-GPU-tensorflow-2024-08-19<br>\n<strong>Creation Date<\/strong>: August 19, 2024 (TBD)<br>\n<strong>Operating System<\/strong>: Ubuntu 22.04<br>\n<strong>Window Manager<\/strong>: XFCE<br>\n<strong>Intended usage<\/strong>: Openstack GPU virtual machine with AI programming support<\/p>\n\n\n        <\/dd>\n    <\/div>\n\n\n    <div class=\"grid pt-4 pb-3 border-b accordion border-cu-black-100 md:pt-6 md:pb-5 first:border-t\">\n        <dt class=\"font-semibold not-prose\">\n            <button class=\"flex items-center justify-between w-full text-left accordion__button\" aria-expanded=\"false\" aria-controls=\"accordion-account\">\n                <span class=\"flex-1 ml-auto text-left break-words whitespace-normal cu-icon\">\n                    Account\n                <\/span>\n                <svg xmlns=\"http:\/\/www.w3.org\/2000\/svg\" fill=\"none\" viewbox=\"0 0 24 24\" stroke-width=\"1.5\" stroke=\"currentColor\" aria-hidden=\"true\" data-slot=\"icon\" class=\"w-5 h-5 ml-auto transition-transform rotate-0 accordion__icon text-cu-black-500\">\n                    <path stroke-linecap=\"round\" stroke-linejoin=\"round\" d=\"M8.25 4.5l7.5 7.5-7.5 7.5\"><\/path>\n                <\/svg>\n            <\/button>\n        <\/dt>\n        <dd class=\"p-0 mt-0 cu-prose cu-prose-first-last accordion__content md:p-0 md:mt-0\" hidden=\"\" id=\"accordion-account\">\n            \n\n<p>Accessing your GPU Virtual Machine. You will be given a username and password once your VM is ready.<\/p>\n\n\n\n<p>&#8220;Please change your password as soon as the VM is provisioned for you. This can be done by logging into your VM and then opening a terminal window and typing \u2018passwd\u2019.&#8221;<\/p>\n\n\n\n<p>Please note:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>Change the default password for your account<\/li>\n\n\n\n<li>Your account does not have Openstack dashboard access. Access is by IP address only.<\/li>\n\n\n\n<li>There are no system backups for your VM, that is, you are responsible for your own backups!<\/li>\n<\/ul>\n\n\n        <\/dd>\n    <\/div>\n\n\n    <div class=\"grid pt-4 pb-3 border-b accordion border-cu-black-100 md:pt-6 md:pb-5 first:border-t\">\n        <dt class=\"font-semibold not-prose\">\n            <button class=\"flex items-center justify-between w-full text-left accordion__button\" aria-expanded=\"false\" aria-controls=\"accordion-accessing-your-gpu-virtual-machine\">\n                <span class=\"flex-1 ml-auto text-left break-words whitespace-normal cu-icon\">\n                    Accessing your GPU Virtual Machine\n                <\/span>\n                <svg xmlns=\"http:\/\/www.w3.org\/2000\/svg\" fill=\"none\" viewbox=\"0 0 24 24\" stroke-width=\"1.5\" stroke=\"currentColor\" aria-hidden=\"true\" data-slot=\"icon\" class=\"w-5 h-5 ml-auto transition-transform rotate-0 accordion__icon text-cu-black-500\">\n                    <path stroke-linecap=\"round\" stroke-linejoin=\"round\" d=\"M8.25 4.5l7.5 7.5-7.5 7.5\"><\/path>\n                <\/svg>\n            <\/button>\n        <\/dt>\n        <dd class=\"p-0 mt-0 cu-prose cu-prose-first-last accordion__content md:p-0 md:mt-0\" hidden=\"\" id=\"accordion-accessing-your-gpu-virtual-machine\">\n            \n\n<p>1. From outside of Carleton you will need to VPN to Carleton in order to access the VM<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li><strong>VPN<\/strong>:&nbsp;<a href=\"https:\/\/carleton.ca\/its\/help-centre\/remote-access\/\" target=\"_blank\" rel=\"noopener noreferrer\">Carleton VPN<\/a>&nbsp;when connecting from outside of the campus<\/li>\n<\/ul>\n\n\n\n<p>2. Listed are the ways you can connect to your VM:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li><strong>TurboVNC <\/strong>(graphical desktop):<a href=\"https:\/\/github.com\/TurboVNC\/turbovnc\/releases\" target=\"_blank\" rel=\"noopener\"> download the TurboVNC client<\/a> and start it and enter &#8216;student@134.117.26.XXX&#8217; where XXX is the IP that was assigned to your VM. <a href=\"https:\/\/carleton.ca\/scs\/2024\/ssh-connection-with-turbovnc\/\">Detailed TurboVNC instructions are here<\/a><br><br><figure><a href=\"https:\/\/carleton.ca\/scs\/wp-content\/uploads\/sites\/260\/turboVNC-login.jpg\"><img loading=\"lazy\" decoding=\"async\" class=\"size-full wp-image-19069 alignnone\" src=\"https:\/\/carleton.ca\/scs\/wp-content\/uploads\/sites\/260\/turboVNC-login.jpg\" alt=\"TurboVNC Login\" width=\"486\" height=\"131\" srcset=\"https:\/\/carleton.ca\/scs\/wp-content\/uploads\/sites\/260\/turboVNC-login.jpg 486w, https:\/\/carleton.ca\/scs\/wp-content\/uploads\/sites\/260\/turboVNC-login-160x43.jpg 160w, https:\/\/carleton.ca\/scs\/wp-content\/uploads\/sites\/260\/turboVNC-login-240x65.jpg 240w, https:\/\/carleton.ca\/scs\/wp-content\/uploads\/sites\/260\/turboVNC-login-400x108.jpg 400w, https:\/\/carleton.ca\/scs\/wp-content\/uploads\/sites\/260\/turboVNC-login-360x97.jpg 360w\" sizes=\"auto, (max-width: 486px) 100vw, 486px\" \/><\/a><\/figure><\/li>\n\n\n\n<li><strong>ssh<\/strong> (command line): <a href=\"https:\/\/carleton.ca\/scs\/2021\/connecting-to-an-openstack-instance-using-ssh-putty\/\" target=\"_blank\" rel=\"noopener noreferrer\">use a terminal window to gain ssh access<\/a><\/li>\n<\/ul>\n\n\n        <\/dd>\n    <\/div>\n\n\n    <div class=\"grid pt-4 pb-3 border-b accordion border-cu-black-100 md:pt-6 md:pb-5 first:border-t\">\n        <dt class=\"font-semibold not-prose\">\n            <button class=\"flex items-center justify-between w-full text-left accordion__button\" aria-expanded=\"false\" aria-controls=\"accordion-system-administration\">\n                <span class=\"flex-1 ml-auto text-left break-words whitespace-normal cu-icon\">\n                    System Administration\n                <\/span>\n                <svg xmlns=\"http:\/\/www.w3.org\/2000\/svg\" fill=\"none\" viewbox=\"0 0 24 24\" stroke-width=\"1.5\" stroke=\"currentColor\" aria-hidden=\"true\" data-slot=\"icon\" class=\"w-5 h-5 ml-auto transition-transform rotate-0 accordion__icon text-cu-black-500\">\n                    <path stroke-linecap=\"round\" stroke-linejoin=\"round\" d=\"M8.25 4.5l7.5 7.5-7.5 7.5\"><\/path>\n                <\/svg>\n            <\/button>\n        <\/dt>\n        <dd class=\"p-0 mt-0 cu-prose cu-prose-first-last accordion__content md:p-0 md:mt-0\" hidden=\"\" id=\"accordion-system-administration\">\n            \n\n<ul class=\"wp-block-list\">\n<li>You have full root\/sudo privileges on your GPU VM.<\/li>\n\n\n\n<li>You can restart your VM using the &#8216;reboot&#8217; command<\/li>\n\n\n\n<li>If you shutdown your VM then you need to contact an SCS Sysadmin to Start the VM for you<\/li>\n\n\n\n<li>If your VM is in an unusable state or it is difficult to fix errors then you have the option to re-launch your VM. Please contact the SCS System Administrator to re-launch the VM for you. Re-launching it means terminating the VM (you lose all local data) and launching a new instance.<\/li>\n\n\n\n<li>Sometimes the VM is not accessible via TurboVNC but you can access it using an <a href=\"https:\/\/carleton.ca\/scs\/2021\/connecting-to-an-openstack-instance-using-ssh-putty\/\">ssh terminal like putty<\/a><\/li>\n\n\n\n<li>run the command &#8216;passwd&#8217; to change your local Ubuntu password<\/li>\n<\/ul>\n\n\n        <\/dd>\n    <\/div>\n\n\n    <div class=\"grid pt-4 pb-3 border-b accordion border-cu-black-100 md:pt-6 md:pb-5 first:border-t\">\n        <dt class=\"font-semibold not-prose\">\n            <button class=\"flex items-center justify-between w-full text-left accordion__button\" aria-expanded=\"false\" aria-controls=\"accordion-software\">\n                <span class=\"flex-1 ml-auto text-left break-words whitespace-normal cu-icon\">\n                    Software\n                <\/span>\n                <svg xmlns=\"http:\/\/www.w3.org\/2000\/svg\" fill=\"none\" viewbox=\"0 0 24 24\" stroke-width=\"1.5\" stroke=\"currentColor\" aria-hidden=\"true\" data-slot=\"icon\" class=\"w-5 h-5 ml-auto transition-transform rotate-0 accordion__icon text-cu-black-500\">\n                    <path stroke-linecap=\"round\" stroke-linejoin=\"round\" d=\"M8.25 4.5l7.5 7.5-7.5 7.5\"><\/path>\n                <\/svg>\n            <\/button>\n        <\/dt>\n        <dd class=\"p-0 mt-0 cu-prose cu-prose-first-last accordion__content md:p-0 md:mt-0\" hidden=\"\" id=\"accordion-software\">\n            \n\n<p>This is the tested software installed on this virtual machine.<\/p>\n\n\n\n<figure class=\"wp-block-table\"><table class=\"has-fixed-layout\"><thead><tr><td><strong>Software<\/strong><\/td><td><strong>Version<\/strong><\/td><\/tr><\/thead><tbody><tr><td>NVIDIA Driver Ver.<\/td><td>550.90.07<\/td><\/tr><tr><td>CUDA Driver Version<\/td><td>12.4<\/td><\/tr><tr><td>CUDA Runtime Version<\/td><td>12.3<\/td><\/tr><tr><td>cuDNN<\/td><td>8.9.7<\/td><\/tr><tr><td>GCC<\/td><td>9.5.0 \/ 11.4.0 \/ 12.3.0<\/td><\/tr><tr><td>Bazel<\/td><td>6.5.0<\/td><\/tr><tr><td>OpenCV<\/td><td>4.5.4<\/td><\/tr><\/tbody><\/table><\/figure>\n\n\n\n<p>Python software:<\/p>\n\n\n\n<figure class=\"wp-block-table\"><table class=\"has-fixed-layout\"><thead><tr><td><strong>Software<\/strong><\/td><td><strong>Version<\/strong><\/td><\/tr><\/thead><tbody><tr><td>Python<\/td><td>3.10.12<\/td><\/tr><tr><td>Pip3<\/td><td>24.2<\/td><\/tr><tr><td>Tensorflow<\/td><td>2.16.1<\/td><\/tr><tr><td>Python-torch<\/td><td>2.4.0+cu118<\/td><\/tr><tr><td>Keras<\/td><td>3.4.1<\/td><\/tr><tr><td>Pandas<\/td><td>2.2.2<\/td><\/tr><tr><td>Numpy<\/td><td>1.26.4<\/td><\/tr><\/tbody><\/table><\/figure>\n\n\n\n<p>&nbsp;<\/p>\n\n\n        <\/dd>\n    <\/div>\n\n\n    <\/dl>\n\n\n    <\/div>\n<\/section>\n\n\n\n<p>&nbsp;<\/p>\n\n\n\n<h2 id=\"testing-the-gpu-vm-software\" class=\"wp-block-heading\"><a id=\"testing\"><\/a>Testing the GPU VM software<\/h2>\n\n\n\n<p>Here are some helpful tests to see if your software is running correctly.<\/p>\n\n\n\n<p>This image has a script that tests all the AI software:<\/p>\n\n\n\n<p><code>python3 \/home\/student\/os-scripts\/ai-software-test.bash<\/code><\/p>\n\n\n\n<section class=\"w-screen px-6 cu-section cu-section--white ml-offset-center md:px-8 lg:px-14\">\n    <div class=\"space-y-6 cu-max-w-child-5xl  md:space-y-10 cu-prose-first-last\">\n\n        \n    \n    <dl class=\"cu-description cu-component-updated\">\n        \n    <div class=\"grid pt-4 pb-3 border-b accordion border-cu-black-100 md:pt-6 md:pb-5 first:border-t\">\n        <dt class=\"font-semibold not-prose\">\n            <button class=\"flex items-center justify-between w-full text-left accordion__button\" aria-expanded=\"false\" aria-controls=\"accordion-probing-your-gpu\">\n                <span class=\"flex-1 ml-auto text-left break-words whitespace-normal cu-icon\">\n                    Probing your GPU\n                <\/span>\n                <svg xmlns=\"http:\/\/www.w3.org\/2000\/svg\" fill=\"none\" viewbox=\"0 0 24 24\" stroke-width=\"1.5\" stroke=\"currentColor\" aria-hidden=\"true\" data-slot=\"icon\" class=\"w-5 h-5 ml-auto transition-transform rotate-0 accordion__icon text-cu-black-500\">\n                    <path stroke-linecap=\"round\" stroke-linejoin=\"round\" d=\"M8.25 4.5l7.5 7.5-7.5 7.5\"><\/path>\n                <\/svg>\n            <\/button>\n        <\/dt>\n        <dd class=\"p-0 mt-0 cu-prose cu-prose-first-last accordion__content md:p-0 md:mt-0\" hidden=\"\" id=\"accordion-probing-your-gpu\">\n            \n\n<p>This command allows you test if the GPU is being detected, identifies the GPU and shows any running jobs, utilisation, and memory usage in real time:<\/p>\n\n\n\n<p>nvidia-smi -l<\/p>\n\n\n\n<p>You should be able to view a realtime command prompt window that shows:<\/p>\n\n\n\n<p>CUDA version<br>\nGPU name<br>\nWhat job is running on your GPU<br>\nStats about your GPU: realtime heat, load and memory usage<\/p>\n\n\n        <\/dd>\n    <\/div>\n\n\n    <div class=\"grid pt-4 pb-3 border-b accordion border-cu-black-100 md:pt-6 md:pb-5 first:border-t\">\n        <dt class=\"font-semibold not-prose\">\n            <button class=\"flex items-center justify-between w-full text-left accordion__button\" aria-expanded=\"false\" aria-controls=\"accordion-testing-cuda\">\n                <span class=\"flex-1 ml-auto text-left break-words whitespace-normal cu-icon\">\n                    Testing CUDA\n                <\/span>\n                <svg xmlns=\"http:\/\/www.w3.org\/2000\/svg\" fill=\"none\" viewbox=\"0 0 24 24\" stroke-width=\"1.5\" stroke=\"currentColor\" aria-hidden=\"true\" data-slot=\"icon\" class=\"w-5 h-5 ml-auto transition-transform rotate-0 accordion__icon text-cu-black-500\">\n                    <path stroke-linecap=\"round\" stroke-linejoin=\"round\" d=\"M8.25 4.5l7.5 7.5-7.5 7.5\"><\/path>\n                <\/svg>\n            <\/button>\n        <\/dt>\n        <dd class=\"p-0 mt-0 cu-prose cu-prose-first-last accordion__content md:p-0 md:mt-0\" hidden=\"\" id=\"accordion-testing-cuda\">\n            \n\n<p>There are CUDA samples that you can download, compile and run for your version of CUDA. These samples have been compiled for you in your account. One of the samples probes your GPU and gives you detailed spec&#8217;s about it. You can try to run this sample code in the student account&#8217;s xterm shell:<\/p>\n\n\n\n<p><code>\/home\/student\/cuda-samples\/Samples\/1_Utilities\/deviceQuery\/deviceQuery<\/code><\/p>\n\n\n\n<p>This is an excellent test to check:<\/p>\n\n\n\n<ol class=\"wp-block-list\">\n<li>if your GPU is detected<\/li>\n\n\n\n<li>if CUDA is installed correctly<\/li>\n\n\n\n<li>the hardware and software details of your GPU<\/li>\n<\/ol>\n\n\n\n<p>The output for in this instance looks like:<\/p>\n\n\n\n<p><code><br>\nCUDA Device Query (Runtime API) version (CUDART static linking)<\/code><\/p>\n\n\n\n<p>Detected 1 CUDA Capable device(s)<\/p>\n\n\n\n<p>Device 0: &#8220;NVIDIA A16&#8221;<br>\nCUDA Driver Version \/ Runtime Version 12.4 \/ 12.3<br>\nCUDA Capability Major\/Minor version number: 8.6<br>\nTotal amount of global memory: 14878 MBytes (15600910336 bytes)<br>\n(010) Multiprocessors, (128) CUDA Cores\/MP: 1280 CUDA Cores<br>\nGPU Max Clock rate: 1755 MHz (1.75 GHz)<br>\nMemory Clock rate: 6251 Mhz<br>\nMemory Bus Width: 128-bit<br>\nL2 Cache Size: 2097152 bytes<br>\nMaximum Texture Dimension Size (x,y,z) 1D=(131072), 2D=(131072, 65536), 3D=(16384, 16384, 16384)<br>\nMaximum Layered 1D Texture Size, (num) layers 1D=(32768), 2048 layers<br>\nMaximum Layered 2D Texture Size, (num) layers 2D=(32768, 32768), 2048 layers<br>\nTotal amount of constant memory: 65536 bytes<br>\nTotal amount of shared memory per block: 49152 bytes<br>\nTotal shared memory per multiprocessor: 102400 bytes<br>\nTotal number of registers available per block: 65536<br>\nWarp size: 32<br>\nMaximum number of threads per multiprocessor: 1536<br>\nMaximum number of threads per block: 1024<br>\nMax dimension size of a thread block (x,y,z): (1024, 1024, 64)<br>\nMax dimension size of a grid size (x,y,z): (2147483647, 65535, 65535)<br>\nMaximum memory pitch: 2147483647 bytes<br>\nTexture alignment: 512 bytes<br>\nConcurrent copy and kernel execution: Yes with 2 copy engine(s)<br>\nRun time limit on kernels: No<br>\nIntegrated GPU sharing Host Memory: No<br>\nSupport host page-locked memory mapping: Yes<br>\nAlignment requirement for Surfaces: Yes<br>\nDevice has ECC support: Enabled<br>\nDevice supports Unified Addressing (UVA): Yes<br>\nDevice supports Managed Memory: Yes<br>\nDevice supports Compute Preemption: Yes<br>\nSupports Cooperative Kernel Launch: Yes<br>\nSupports MultiDevice Co-op Kernel Launch: Yes<br>\nDevice PCI Domain ID \/ Bus ID \/ location ID: 0 \/ 0 \/ 5<br>\nCompute Mode:<br>\n&lt; Default (multiple host threads can use ::cudaSetDevice() with device simultaneously) &gt;<\/p>\n\n\n\n<p>deviceQuery, CUDA Driver = CUDART, CUDA Driver Version = 12.4, CUDA Runtime Version = 12.3, NumDevs = 1<br>\nResult = PASS<\/p>\n\n\n\n<p>&nbsp;<\/p>\n\n\n        <\/dd>\n    <\/div>\n\n\n    <\/dl>\n\n\n    <\/div>\n<\/section>\n\n\n\n<p>&nbsp;<\/p>\n\n\n\n<section class=\"w-screen px-6 cu-section cu-section--white ml-offset-center md:px-8 lg:px-14\">\n    <div class=\"space-y-6 cu-max-w-child-5xl  md:space-y-10 cu-prose-first-last\">\n\n        \n    \n    <dl class=\"cu-description cu-component-updated\">\n        \n    <div class=\"grid pt-4 pb-3 border-b accordion border-cu-black-100 md:pt-6 md:pb-5 first:border-t\">\n        <dt class=\"font-semibold not-prose\">\n            <button class=\"flex items-center justify-between w-full text-left accordion__button\" aria-expanded=\"false\" aria-controls=\"accordion-test-cudnn\">\n                <span class=\"flex-1 ml-auto text-left break-words whitespace-normal cu-icon\">\n                    Test CuDNN \n                <\/span>\n                <svg xmlns=\"http:\/\/www.w3.org\/2000\/svg\" fill=\"none\" viewbox=\"0 0 24 24\" stroke-width=\"1.5\" stroke=\"currentColor\" aria-hidden=\"true\" data-slot=\"icon\" class=\"w-5 h-5 ml-auto transition-transform rotate-0 accordion__icon text-cu-black-500\">\n                    <path stroke-linecap=\"round\" stroke-linejoin=\"round\" d=\"M8.25 4.5l7.5 7.5-7.5 7.5\"><\/path>\n                <\/svg>\n            <\/button>\n        <\/dt>\n        <dd class=\"p-0 mt-0 cu-prose cu-prose-first-last accordion__content md:p-0 md:mt-0\" hidden=\"\" id=\"accordion-test-cudnn\">\n            \n\n<p>The following will test:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>If your NVIDIA driver and CUDA install is working<\/li>\n\n\n\n<li>that your CUDNN libraries are working<\/li>\n<\/ul>\n\n\n\n<p>To verify you have the CuDNN installed run:<\/p>\n\n\n\n<p><code>sudo apt search cudnn | grep installed<\/code><\/p>\n\n\n\n<p>It also requires environment variables that are already set for the student user in this default VM. See the CuDNN installation guide how to set the environment variables for CuDNN.<\/p>\n\n\n\n<p>The sample code is already compiled in the &#8216;student&#8217; user account. Run the sample code as follows in the shell:<\/p>\n\n\n\n<p>&nbsp;<\/p>\n\n\n\n<p><code>\u200b\/home\/student\/cudnn-samples\/mnistCUDNN\/mnistCUDNN<\/code><\/p>\n\n\n\n<p>&nbsp;<\/p>\n\n\n\n<p><strong>CuDNN Sample code output should look like this:<\/strong><\/p>\n\n\n\n<p><code><br>\nExecuting: mnistCUDNN<br>\ncudnnGetVersion() : 8907 , CUDNN_VERSION from cudnn.h : 8907 (8.9.7)<br>\nHost compiler version : GCC 11.4.0<\/code><\/p>\n\n\n\n<p>There are 1 CUDA capable devices on your machine :<br>\ndevice 0 : sms 10 Capabilities 8.6, SmClock 1755.0 Mhz, MemSize (Mb) 14878, MemClock 6251.0 Mhz, Ecc=1, boardGroupID=0<br>\nUsing device 0<\/p>\n\n\n\n<p>Testing single precision<br>\nLoading binary file data\/conv1.bin<br>\nLoading binary file data\/conv1.bias.bin<br>\nLoading binary file data\/conv2.bin<br>\nLoading binary file data\/conv2.bias.bin<br>\nLoading binary file data\/ip1.bin<br>\nLoading binary file data\/ip1.bias.bin<br>\nLoading binary file data\/ip2.bin<br>\nLoading binary file data\/ip2.bias.bin<br>\nLoading image data\/one_28x28.pgm<br>\nPerforming forward propagation &#8230;<br>\nTesting cudnnGetConvolutionForwardAlgorithm_v7 &#8230;<br>\n^^^^ CUDNN_STATUS_SUCCESS for Algo 1: -1.000000 time requiring 0 memory<br>\n^^^^ CUDNN_STATUS_SUCCESS for Algo 0: -1.000000 time requiring 0 memory<br>\n^^^^ CUDNN_STATUS_SUCCESS for Algo 2: -1.000000 time requiring 0 memory<\/p>\n\n\n\n<p>\/\/\/\/\/\/\/ more output cut for brevity \/\/\/\/\/\/\/<\/p>\n\n\n\n<p>Resulting weights from Softmax:<br>\n0.0000000 0.0000000 0.0000000 1.0000000 0.0000000 0.0000714 0.0000000 0.0000000 0.0000000 0.0000000<br>\nLoading image data\/five_28x28.pgm<br>\nPerforming forward propagation &#8230;<br>\nResulting weights from Softmax:<br>\n0.0000000 0.0000008 0.0000000 0.0000002 0.0000000 1.0000000 0.0000154 0.0000000 0.0000012 0.0000006<\/p>\n\n\n\n<p>Result of classification: 1 3 5<\/p>\n\n\n\n<p>Test passed!<\/p>\n\n\n        <\/dd>\n    <\/div>\n\n\n    <div class=\"grid pt-4 pb-3 border-b accordion border-cu-black-100 md:pt-6 md:pb-5 first:border-t\">\n        <dt class=\"font-semibold not-prose\">\n            <button class=\"flex items-center justify-between w-full text-left accordion__button\" aria-expanded=\"false\" aria-controls=\"accordion-check-tensorflow\">\n                <span class=\"flex-1 ml-auto text-left break-words whitespace-normal cu-icon\">\n                    Check Tensorflow\n                <\/span>\n                <svg xmlns=\"http:\/\/www.w3.org\/2000\/svg\" fill=\"none\" viewbox=\"0 0 24 24\" stroke-width=\"1.5\" stroke=\"currentColor\" aria-hidden=\"true\" data-slot=\"icon\" class=\"w-5 h-5 ml-auto transition-transform rotate-0 accordion__icon text-cu-black-500\">\n                    <path stroke-linecap=\"round\" stroke-linejoin=\"round\" d=\"M8.25 4.5l7.5 7.5-7.5 7.5\"><\/path>\n                <\/svg>\n            <\/button>\n        <\/dt>\n        <dd class=\"p-0 mt-0 cu-prose cu-prose-first-last accordion__content md:p-0 md:mt-0\" hidden=\"\" id=\"accordion-check-tensorflow\">\n            \n\n<p>Tensorflow version:<\/p>\n\n\n\n<p><code>python3 -c 'import tensorflow as tf; print(tf.__version__)'<\/code><code dir=\"ltr\"><\/code><\/p>\n\n\n\n<p>Test tensorflow GPU support:<\/p>\n\n\n\n<p><code dir=\"ltr\"><span class=\"pln\">python3 -c \"import tensorflow as tf; print(tf.config.list_physical_devices('GPU'))\"<\/span><\/code><\/p>\n\n\n\n<p>Tensorflow benchmark test that tests GPU and performance:<\/p>\n\n\n\n<p><code>python3 \/home\/student\/os-scripts\/tensor-bench.py<\/code><\/p>\n\n\n        <\/dd>\n    <\/div>\n\n\n    <div class=\"grid pt-4 pb-3 border-b accordion border-cu-black-100 md:pt-6 md:pb-5 first:border-t\">\n        <dt class=\"font-semibold not-prose\">\n            <button class=\"flex items-center justify-between w-full text-left accordion__button\" aria-expanded=\"false\" aria-controls=\"accordion-test-pytorch-keras-and-pandas\">\n                <span class=\"flex-1 ml-auto text-left break-words whitespace-normal cu-icon\">\n                    Test pyTorch, keras and pandas \n                <\/span>\n                <svg xmlns=\"http:\/\/www.w3.org\/2000\/svg\" fill=\"none\" viewbox=\"0 0 24 24\" stroke-width=\"1.5\" stroke=\"currentColor\" aria-hidden=\"true\" data-slot=\"icon\" class=\"w-5 h-5 ml-auto transition-transform rotate-0 accordion__icon text-cu-black-500\">\n                    <path stroke-linecap=\"round\" stroke-linejoin=\"round\" d=\"M8.25 4.5l7.5 7.5-7.5 7.5\"><\/path>\n                <\/svg>\n            <\/button>\n        <\/dt>\n        <dd class=\"p-0 mt-0 cu-prose cu-prose-first-last accordion__content md:p-0 md:mt-0\" hidden=\"\" id=\"accordion-test-pytorch-keras-and-pandas\">\n            \n\n<p>The following programs will test if the software is installed correctly on your VM<\/p>\n\n\n\n<p>pyTorch<\/p>\n\n\n\n<p><code>python3 \/home\/student\/os-scripts\/torch-test.py<\/code><\/p>\n\n\n\n<p>keras<\/p>\n\n\n\n<p><code>python3 \/home\/student\/os-scripts\/keras-test.py<\/code><\/p>\n\n\n\n<p>pandas<\/p>\n\n\n\n<p><code>python3 \/home\/student\/os-scripts\/pandas-test.py<\/code><\/p>\n\n\n        <\/dd>\n    <\/div>\n\n\n    <div class=\"grid pt-4 pb-3 border-b accordion border-cu-black-100 md:pt-6 md:pb-5 first:border-t\">\n        <dt class=\"font-semibold not-prose\">\n            <button class=\"flex items-center justify-between w-full text-left accordion__button\" aria-expanded=\"false\" aria-controls=\"accordion-tensorrt\">\n                <span class=\"flex-1 ml-auto text-left break-words whitespace-normal cu-icon\">\n                    TensorRT\n                <\/span>\n                <svg xmlns=\"http:\/\/www.w3.org\/2000\/svg\" fill=\"none\" viewbox=\"0 0 24 24\" stroke-width=\"1.5\" stroke=\"currentColor\" aria-hidden=\"true\" data-slot=\"icon\" class=\"w-5 h-5 ml-auto transition-transform rotate-0 accordion__icon text-cu-black-500\">\n                    <path stroke-linecap=\"round\" stroke-linejoin=\"round\" d=\"M8.25 4.5l7.5 7.5-7.5 7.5\"><\/path>\n                <\/svg>\n            <\/button>\n        <\/dt>\n        <dd class=\"p-0 mt-0 cu-prose cu-prose-first-last accordion__content md:p-0 md:mt-0\" hidden=\"\" id=\"accordion-tensorrt\">\n            \n\n<p>NVIDIA TensorRT is a high-performance inference optimizer and runtime that delivers low latency and high throughput for deep learning inference applications.<\/p>\n\n\n\n<p>TensorRT is installed on this image and you can check the samples here:<\/p>\n\n\n\n<p>\/usr\/src\/tensorrt\/samples<\/p>\n\n\n\n<p>Unfortunately the tensorflow integration is not working. Most likely this version of tensorflow is not enabled for TensorRT support. Probably the easiest way to run tensorflow with tensorRT support is to load the docker image. Note: you need to change the default docker networking, conflicts with the Carleton wireless network.<\/p>\n\n\n\n<p>&nbsp;<\/p>\n\n\n\n<p>&nbsp;<\/p>\n\n\n        <\/dd>\n    <\/div>\n\n\n    <\/dl>\n\n\n    <\/div>\n<\/section>\n\n\n\n<p>&nbsp;<\/p>\n\n\n\n<h2 id=\"troubleshooting\" class=\"wp-block-heading\"><a id=\"troubleshooting\"><\/a>Troubleshooting<\/h2>\n\n\n\n<section class=\"w-screen px-6 cu-section cu-section--white ml-offset-center md:px-8 lg:px-14\">\n    <div class=\"space-y-6 cu-max-w-child-5xl  md:space-y-10 cu-prose-first-last\">\n\n        \n    \n    <dl class=\"cu-description cu-component-updated\">\n        \n    <div class=\"grid pt-4 pb-3 border-b accordion border-cu-black-100 md:pt-6 md:pb-5 first:border-t\">\n        <dt class=\"font-semibold not-prose\">\n            <button class=\"flex items-center justify-between w-full text-left accordion__button\" aria-expanded=\"false\" aria-controls=\"accordion-extend-the-lvm-filesystem\">\n                <span class=\"flex-1 ml-auto text-left break-words whitespace-normal cu-icon\">\n                    Extend the LVM filesystem \n                <\/span>\n                <svg xmlns=\"http:\/\/www.w3.org\/2000\/svg\" fill=\"none\" viewbox=\"0 0 24 24\" stroke-width=\"1.5\" stroke=\"currentColor\" aria-hidden=\"true\" data-slot=\"icon\" class=\"w-5 h-5 ml-auto transition-transform rotate-0 accordion__icon text-cu-black-500\">\n                    <path stroke-linecap=\"round\" stroke-linejoin=\"round\" d=\"M8.25 4.5l7.5 7.5-7.5 7.5\"><\/path>\n                <\/svg>\n            <\/button>\n        <\/dt>\n        <dd class=\"p-0 mt-0 cu-prose cu-prose-first-last accordion__content md:p-0 md:mt-0\" hidden=\"\" id=\"accordion-extend-the-lvm-filesystem\">\n            \n\n<p>Usually the file system is using all the allocated space assigned to it.&nbsp; When Openstack assigns disk space it will allocate the same amount as your disk mage and sometimes that disk image will have far less space than what is allocated for you. To expand your disk space to the total amount that was allocated to you can run the following command:<\/p>\n\n\n\n<p><code>sudo \/home\/student\/os-scripts\/extend-lvm.sh \/dev\/vda<\/code><\/p>\n\n\n\n<p>LVM is the logical volume manager that allows &#8216;dynamic&#8217; allocation of disk space.<\/p>\n\n\n        <\/dd>\n    <\/div>\n\n\n    <div class=\"grid pt-4 pb-3 border-b accordion border-cu-black-100 md:pt-6 md:pb-5 first:border-t\">\n        <dt class=\"font-semibold not-prose\">\n            <button class=\"flex items-center justify-between w-full text-left accordion__button\" aria-expanded=\"false\" aria-controls=\"accordion-numa-node-read-from-sysfs\">\n                <span class=\"flex-1 ml-auto text-left break-words whitespace-normal cu-icon\">\n                    NUMA node read from SysFS&#8230;\n                <\/span>\n                <svg xmlns=\"http:\/\/www.w3.org\/2000\/svg\" fill=\"none\" viewbox=\"0 0 24 24\" stroke-width=\"1.5\" stroke=\"currentColor\" aria-hidden=\"true\" data-slot=\"icon\" class=\"w-5 h-5 ml-auto transition-transform rotate-0 accordion__icon text-cu-black-500\">\n                    <path stroke-linecap=\"round\" stroke-linejoin=\"round\" d=\"M8.25 4.5l7.5 7.5-7.5 7.5\"><\/path>\n                <\/svg>\n            <\/button>\n        <\/dt>\n        <dd class=\"p-0 mt-0 cu-prose cu-prose-first-last accordion__content md:p-0 md:mt-0\" hidden=\"\" id=\"accordion-numa-node-read-from-sysfs\">\n            \n\n<p>Because this is &#8216;bleeding&#8217; edge software you can expect some software issues. This one in particular is concerning NUMA node error reading from memory. If you want to fix this particular &#8216;warning&#8217; there is a bash script you can run:<\/p>\n\n\n\n<p><code>sudo \/home\/student\/os-scripts\/numa-node-fix.bash<\/code><\/p>\n\n\n\n<p><strong>Reference<\/strong>: <a href=\"https:\/\/gist.github.com\/zrruziev\/b93e1292bf2ee39284f834ec7397ee9f\" target=\"_blank\" rel=\"noopener noreferrer\">https:\/\/gist.github.com\/zrruziev\/b93e1292bf2ee39284f834ec7397ee9f<\/a><\/p>\n\n\n        <\/dd>\n    <\/div>\n\n\n    <div class=\"grid pt-4 pb-3 border-b accordion border-cu-black-100 md:pt-6 md:pb-5 first:border-t\">\n        <dt class=\"font-semibold not-prose\">\n            <button class=\"flex items-center justify-between w-full text-left accordion__button\" aria-expanded=\"false\" aria-controls=\"accordion-need-to-use-another-version-of-gcc\">\n                <span class=\"flex-1 ml-auto text-left break-words whitespace-normal cu-icon\">\n                    Need to use another version of gcc?\n                <\/span>\n                <svg xmlns=\"http:\/\/www.w3.org\/2000\/svg\" fill=\"none\" viewbox=\"0 0 24 24\" stroke-width=\"1.5\" stroke=\"currentColor\" aria-hidden=\"true\" data-slot=\"icon\" class=\"w-5 h-5 ml-auto transition-transform rotate-0 accordion__icon text-cu-black-500\">\n                    <path stroke-linecap=\"round\" stroke-linejoin=\"round\" d=\"M8.25 4.5l7.5 7.5-7.5 7.5\"><\/path>\n                <\/svg>\n            <\/button>\n        <\/dt>\n        <dd class=\"p-0 mt-0 cu-prose cu-prose-first-last accordion__content md:p-0 md:mt-0\" hidden=\"\" id=\"accordion-need-to-use-another-version-of-gcc\">\n            \n\n<p>There are two versions of gcc installed on this VM. You can use the update-alternatives to switch between the versions:<br>sudo update-alternatives &#8211;config gcc<\/p>\n\n\n        <\/dd>\n    <\/div>\n\n\n    <\/dl>\n\n\n    <\/div>\n<\/section>\n","protected":false},"excerpt":{"rendered":"<p>GPU VM Account DetailsTesting the GPU VM softwareTroubleshooting This page will show you how to test your virtual machine&#8217;s GPU and access and test the software that is pre-installed on it. Even though Ubuntu 24.04 is the current long release version we chose Ubuntu 22.04 because some of the dependent libraries were not available for [&hellip;]<\/p>\n","protected":false},"author":2,"featured_media":0,"parent":808,"menu_order":0,"comment_status":"closed","ping_status":"closed","template":"","meta":{"_acf_changed":false,"_cu_dining_location_slug":"","footnotes":"","_links_to":"","_links_to_target":""},"cu_page_type":[75],"class_list":["post-18955","page","type-page","status-publish","hentry","cu_page_type-technical-support"],"acf":{"cu_post_thumbnail":""},"_links":{"self":[{"href":"https:\/\/carleton.ca\/scs\/wp-json\/wp\/v2\/pages\/18955","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/carleton.ca\/scs\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/carleton.ca\/scs\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/carleton.ca\/scs\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/carleton.ca\/scs\/wp-json\/wp\/v2\/comments?post=18955"}],"version-history":[{"count":5,"href":"https:\/\/carleton.ca\/scs\/wp-json\/wp\/v2\/pages\/18955\/revisions"}],"predecessor-version":[{"id":24774,"href":"https:\/\/carleton.ca\/scs\/wp-json\/wp\/v2\/pages\/18955\/revisions\/24774"}],"up":[{"embeddable":true,"href":"https:\/\/carleton.ca\/scs\/wp-json\/wp\/v2\/pages\/808"}],"wp:attachment":[{"href":"https:\/\/carleton.ca\/scs\/wp-json\/wp\/v2\/media?parent=18955"}],"wp:term":[{"taxonomy":"cu_page_type","embeddable":true,"href":"https:\/\/carleton.ca\/scs\/wp-json\/wp\/v2\/cu_page_type?post=18955"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}