{"id":808,"date":"2016-07-21T14:25:55","date_gmt":"2016-07-21T18:25:55","guid":{"rendered":"http:\/\/carleton.ca\/scs\/?page_id=808"},"modified":"2026-06-10T11:49:30","modified_gmt":"2026-06-10T15:49:30","slug":"cuda-gpu-computing","status":"publish","type":"page","link":"https:\/\/carleton.ca\/scs\/tech-support\/cuda-gpu-computing\/","title":{"rendered":"SCS GPU Computing with Openstack"},"content":{"rendered":"\n<section class=\"w-screen px-6 cu-section cu-section--white ml-offset-center md:px-8 lg:px-14\">\n    <div class=\"space-y-6 cu-max-w-child-5xl  md:space-y-10 cu-prose-first-last\">\n\n            <div class=\"cu-textmedia flex flex-col lg:flex-row mx-auto gap-6 md:gap-10 my-6 md:my-12 first:mt-0 max-w-5xl\">\n        <div class=\"justify-start cu-textmedia-content cu-prose-first-last\" style=\"flex: 0 0 100%;\">\n            <header class=\"font-light prose-xl cu-pageheader md:prose-2xl cu-component-updated cu-prose-first-last\">\n                                    <h1 class=\"cu-prose-first-last font-semibold !mt-2 mb-4 md:mb-6 relative after:absolute after:h-px after:bottom-0 after:bg-cu-red after:left-px text-3xl md:text-4xl lg:text-5xl lg:leading-[3.5rem] pb-5 after:w-10 text-cu-black-700 not-prose\">\n                        SCS GPU Computing with Openstack\n                    <\/h1>\n                \n                                \n                            <\/header>\n\n                    <\/div>\n\n            <\/div>\n\n    <\/div>\n<\/section>\n\n\n\n<h2 id=\"gpu-computing-introduction\" class=\"wp-block-heading\">GPU Computing Introduction<\/h2>\n\n\n\n<p>The SCS GPU allow you to program using its CUDA (Compute Unified Device Architecture) cores. CUDA is a parallel computing platform and application programming interface (API) model created by Nvidia. The CUDA platform is accessible to software developers through CUDA-accelerated libraries, compiler directives, and extensions to industry-standard programming languages.<\/p>\n\n\n\n<p>GPU programming has been widely used in the area of Deep learning and have been applied to fields such as:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>computer vision,<\/li>\n\n\n\n<li>machine vision,<\/li>\n\n\n\n<li>speech recognition,<\/li>\n\n\n\n<li>natural language processing,<\/li>\n\n\n\n<li>audio recognition,<\/li>\n\n\n\n<li>social network filtering,<\/li>\n\n\n\n<li>machine translation,<\/li>\n\n\n\n<li>bioinformatics,<\/li>\n\n\n\n<li>drug design,<\/li>\n\n\n\n<li>medical image analysis,<\/li>\n\n\n\n<li>material inspection,<\/li>\n\n\n\n<li>board game programs.<\/li>\n<\/ul>\n\n\n\n<p>Deep learning have produced results comparable to and in some cases surpassing human expert performance.<\/p>\n\n\n\n<section class=\"w-screen px-6 cu-section cu-section--white ml-offset-center md:px-8 lg:px-14\">\n    <div class=\"space-y-6 cu-max-w-child-5xl  md:space-y-10 cu-prose-first-last\">\n\n        \n    \n    <dl class=\"cu-description cu-component-updated\">\n        \n    <div class=\"grid pt-4 pb-3 border-b accordion border-cu-black-100 md:pt-6 md:pb-5 first:border-t\">\n        <dt class=\"font-semibold not-prose\">\n            <button class=\"flex items-center justify-between w-full text-left accordion__button\" aria-expanded=\"false\" aria-controls=\"accordion-gpu-hardware\">\n                <span class=\"flex-1 ml-auto text-left break-words whitespace-normal cu-icon\">\n                    GPU Hardware\n                <\/span>\n                <svg xmlns=\"http:\/\/www.w3.org\/2000\/svg\" fill=\"none\" viewbox=\"0 0 24 24\" stroke-width=\"1.5\" stroke=\"currentColor\" aria-hidden=\"true\" data-slot=\"icon\" class=\"w-5 h-5 ml-auto transition-transform rotate-0 accordion__icon text-cu-black-500\">\n                    <path stroke-linecap=\"round\" stroke-linejoin=\"round\" d=\"M8.25 4.5l7.5 7.5-7.5 7.5\"><\/path>\n                <\/svg>\n            <\/button>\n        <\/dt>\n        <dd class=\"p-0 mt-0 cu-prose cu-prose-first-last accordion__content md:p-0 md:mt-0\" hidden=\"\" id=\"accordion-gpu-hardware\">\n            \n\n<p>The School has the following GPU hardware (January 2024):<\/p>\n\n\n\n<figure class=\"wp-block-table\"><table class=\"has-fixed-layout\"><tbody><tr><td><strong>NVIDIA GPU<\/strong><\/td><td><strong>VRAM<\/strong><\/td><td><strong>CUDA Cores<\/strong><\/td><td><strong>Tensor Cores<\/strong><\/td><td><strong>Ray Tracing Cores<\/strong><\/td><\/tr><tr><td>RTX 4090<\/td><td>24<\/td><td>16,384<\/td><td>512<\/td><td>176<\/td><\/tr><tr><td>RTX 4070 Ti Super<\/td><td>16<\/td><td>8,448<\/td><td>264<\/td><td>66<\/td><\/tr><tr><td>A16<\/td><td>16<\/td><td>1,280<\/td><td>40<\/td><td>10<\/td><\/tr><tr><td>RTX 3060 Ti<\/td><td>8<\/td><td>4,864<\/td><td>152<\/td><td>38<\/td><\/tr><tr><td>RTX 3060<\/td><td>12<\/td><td>3,584<\/td><td>112<\/td><td>28<\/td><\/tr><tr><td>Titan V<\/td><td>12<\/td><td>5,120<\/td><td>640<\/td><td>0<\/td><\/tr><tr><td>RTX 2080 SUPER<\/td><td>8<\/td><td>3,072<\/td><td>384<\/td><td>48<\/td><\/tr><\/tbody><\/table><\/figure>\n\n\n\n<p>&nbsp;<\/p>\n\n\n\n<p>The school has various VM flavors that assign the number of vCPU&#8217;s, memory and disk space. Virtual machines are provisioned using the school&#8217;s Openstack cloud.<\/p>\n\n\n        <\/dd>\n    <\/div>\n\n\n    <div class=\"grid pt-4 pb-3 border-b accordion border-cu-black-100 md:pt-6 md:pb-5 first:border-t\">\n        <dt class=\"font-semibold not-prose\">\n            <button class=\"flex items-center justify-between w-full text-left accordion__button\" aria-expanded=\"false\" aria-controls=\"accordion-request-a-gpu-virtual-machine\">\n                <span class=\"flex-1 ml-auto text-left break-words whitespace-normal cu-icon\">\n                    Request a GPU virtual machine\n                <\/span>\n                <svg xmlns=\"http:\/\/www.w3.org\/2000\/svg\" fill=\"none\" viewbox=\"0 0 24 24\" stroke-width=\"1.5\" stroke=\"currentColor\" aria-hidden=\"true\" data-slot=\"icon\" class=\"w-5 h-5 ml-auto transition-transform rotate-0 accordion__icon text-cu-black-500\">\n                    <path stroke-linecap=\"round\" stroke-linejoin=\"round\" d=\"M8.25 4.5l7.5 7.5-7.5 7.5\"><\/path>\n                <\/svg>\n            <\/button>\n        <\/dt>\n        <dd class=\"p-0 mt-0 cu-prose cu-prose-first-last accordion__content md:p-0 md:mt-0\" hidden=\"\" id=\"accordion-request-a-gpu-virtual-machine\">\n            \n\n<p>Students currently taking a course that requires a GPU account can fill out this form to request a GPU VM:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li><a href=\"https:\/\/carleton.ca\/scs\/tech-support\/scs-open-stack\/scs-gpu-request-form\/\" target=\"_blank\" rel=\"noopener noreferrer\">SCS GPU Request Form<\/a><\/li>\n<\/ul>\n\n\n        <\/dd>\n    <\/div>\n\n\n    <div class=\"grid pt-4 pb-3 border-b accordion border-cu-black-100 md:pt-6 md:pb-5 first:border-t\">\n        <dt class=\"font-semibold not-prose\">\n            <button class=\"flex items-center justify-between w-full text-left accordion__button\" aria-expanded=\"false\" aria-controls=\"accordion-accounts\">\n                <span class=\"flex-1 ml-auto text-left break-words whitespace-normal cu-icon\">\n                    Accounts\n                <\/span>\n                <svg xmlns=\"http:\/\/www.w3.org\/2000\/svg\" fill=\"none\" viewbox=\"0 0 24 24\" stroke-width=\"1.5\" stroke=\"currentColor\" aria-hidden=\"true\" data-slot=\"icon\" class=\"w-5 h-5 ml-auto transition-transform rotate-0 accordion__icon text-cu-black-500\">\n                    <path stroke-linecap=\"round\" stroke-linejoin=\"round\" d=\"M8.25 4.5l7.5 7.5-7.5 7.5\"><\/path>\n                <\/svg>\n            <\/button>\n        <\/dt>\n        <dd class=\"p-0 mt-0 cu-prose cu-prose-first-last accordion__content md:p-0 md:mt-0\" hidden=\"\" id=\"accordion-accounts\">\n            \n\n<p>You will need the following accounts to use the SCS GPU VM\u2019s:<\/p>\n\n\n\n<ol class=\"wp-block-list\">\n<li>MyCarletonOne account account (university wide or ITS account) \u2013 needed to<a href=\"https:\/\/carleton.ca\/its\/help-centre\/remote-access\/\" target=\"_blank\" rel=\"noreferrer noopener\">\u00a0VPN<\/a><\/li>\n\n\n\n<li>GPU VM account \u2013 created by the SCS Tech Staff<\/li>\n<\/ol>\n\n\n\n<p><em>Please note the GPU account is a local account and you are responsible for your own backups!<\/em><\/p>\n\n\n\n<p><strong>More Account information:<\/strong><\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li><a href=\"https:\/\/carleton.ca\/scs\/tech-support\/accounts\/\">SCS Accounts<\/a><\/li>\n<\/ul>\n\n\n        <\/dd>\n    <\/div>\n\n\n    <div class=\"grid pt-4 pb-3 border-b accordion border-cu-black-100 md:pt-6 md:pb-5 first:border-t\">\n        <dt class=\"font-semibold not-prose\">\n            <button class=\"flex items-center justify-between w-full text-left accordion__button\" aria-expanded=\"false\" aria-controls=\"accordion-change-your-default-password\">\n                <span class=\"flex-1 ml-auto text-left break-words whitespace-normal cu-icon\">\n                    Change your default Password\n                <\/span>\n                <svg xmlns=\"http:\/\/www.w3.org\/2000\/svg\" fill=\"none\" viewbox=\"0 0 24 24\" stroke-width=\"1.5\" stroke=\"currentColor\" aria-hidden=\"true\" data-slot=\"icon\" class=\"w-5 h-5 ml-auto transition-transform rotate-0 accordion__icon text-cu-black-500\">\n                    <path stroke-linecap=\"round\" stroke-linejoin=\"round\" d=\"M8.25 4.5l7.5 7.5-7.5 7.5\"><\/path>\n                <\/svg>\n            <\/button>\n        <\/dt>\n        <dd class=\"p-0 mt-0 cu-prose cu-prose-first-last accordion__content md:p-0 md:mt-0\" hidden=\"\" id=\"accordion-change-your-default-password\">\n            \n\n<p>Please change your default GPU VM password once you login. The simplest way to do that in Linux is to:<\/p>\n\n\n\n<ol class=\"wp-block-list\">\n<li>login to your Linux VM<\/li>\n\n\n\n<li>start an xterminal or command windows<\/li>\n\n\n\n<li>at the command prompt type &#8216;passwd&#8217; and follow the instructions<\/li>\n<\/ol>\n\n\n        <\/dd>\n    <\/div>\n\n\n    <div class=\"grid pt-4 pb-3 border-b accordion border-cu-black-100 md:pt-6 md:pb-5 first:border-t\">\n        <dt class=\"font-semibold not-prose\">\n            <button class=\"flex items-center justify-between w-full text-left accordion__button\" aria-expanded=\"false\" aria-controls=\"accordion-openstack-gpu-virtual-machine-images\">\n                <span class=\"flex-1 ml-auto text-left break-words whitespace-normal cu-icon\">\n                    Openstack GPU Virtual Machine Images\n                <\/span>\n                <svg xmlns=\"http:\/\/www.w3.org\/2000\/svg\" fill=\"none\" viewbox=\"0 0 24 24\" stroke-width=\"1.5\" stroke=\"currentColor\" aria-hidden=\"true\" data-slot=\"icon\" class=\"w-5 h-5 ml-auto transition-transform rotate-0 accordion__icon text-cu-black-500\">\n                    <path stroke-linecap=\"round\" stroke-linejoin=\"round\" d=\"M8.25 4.5l7.5 7.5-7.5 7.5\"><\/path>\n                <\/svg>\n            <\/button>\n        <\/dt>\n        <dd class=\"p-0 mt-0 cu-prose cu-prose-first-last accordion__content md:p-0 md:mt-0\" hidden=\"\" id=\"accordion-openstack-gpu-virtual-machine-images\">\n            \n\n<p>Specific help for an Open Stack image:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li><a href=\"https:\/\/carleton.ca\/scs\/tech-support\/cuda-gpu-computing\/scs-gpu-vm-2024-5\/\" target=\"_blank\" rel=\"noopener noreferrer\">SCS GPU VM Fall 2024-5<\/a><\/li>\n<\/ul>\n\n\n        <\/dd>\n    <\/div>\n\n\n    <div class=\"grid pt-4 pb-3 border-b accordion border-cu-black-100 md:pt-6 md:pb-5 first:border-t\">\n        <dt class=\"font-semibold not-prose\">\n            <button class=\"flex items-center justify-between w-full text-left accordion__button\" aria-expanded=\"false\" aria-controls=\"accordion-accessing-the-gpu-servers\">\n                <span class=\"flex-1 ml-auto text-left break-words whitespace-normal cu-icon\">\n                    Accessing the GPU Servers\n                <\/span>\n                <svg xmlns=\"http:\/\/www.w3.org\/2000\/svg\" fill=\"none\" viewbox=\"0 0 24 24\" stroke-width=\"1.5\" stroke=\"currentColor\" aria-hidden=\"true\" data-slot=\"icon\" class=\"w-5 h-5 ml-auto transition-transform rotate-0 accordion__icon text-cu-black-500\">\n                    <path stroke-linecap=\"round\" stroke-linejoin=\"round\" d=\"M8.25 4.5l7.5 7.5-7.5 7.5\"><\/path>\n                <\/svg>\n            <\/button>\n        <\/dt>\n        <dd class=\"p-0 mt-0 cu-prose cu-prose-first-last accordion__content md:p-0 md:mt-0\" hidden=\"\" id=\"accordion-accessing-the-gpu-servers\">\n            \n\n<p><em>Note that you require VPN for remote accessing your instances! \u2013\u00a0<\/em><a href=\"https:\/\/carleton.ca\/its\/help-centre\/remote-access\/\" target=\"_blank\" rel=\"noreferrer noopener\">Remote Access \u2013 VPN<\/a><\/p>\n\n\n\n<p>You can access the GPU\u2019s as follows:<\/p>\n\n\n\n<ol class=\"wp-block-list\">\n<li>Using a remote desktop<\/li>\n\n\n\n<li>using a command line ssh client<\/li>\n<\/ol>\n\n\n\n<p>Logging in using x2go (remote desktop)<br>The preferred way to access the GPU server is to VPN to Carleton or use a lab on campus such as the\u00a0<a href=\"https:\/\/carleton.ca\/scs\/technical-support\/computer-laboratories\/\">SCS Computer labs\u00a0<\/a>and then remote desktop (x2go) directly to the server (see diagram). The x2go session will give you a full GUI desktop. Detailed x2go instructions are here:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li><a href=\"https:\/\/carleton.ca\/scs\/tech-support\/scs-open-stack\/openstack-technical-support\/x2go\/\" target=\"_blank\" rel=\"noreferrer noopener\">x2go Remote Desktop Client<\/a><\/li>\n<\/ul>\n\n\n\n<p><strong class=\"myprefix-text-bold\">Logging in using ssh (command line)<\/strong><\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li><a href=\"https:\/\/carleton.ca\/scs\/2019\/connecting-to-openstack-instances-ssh-with-putty\/\">Openstack \u2013 Connecting to an Instance \u2013 SSH (putty)<\/a><\/li>\n\n\n\n<li><a href=\"https:\/\/carleton.ca\/scs\/tech-support\/secure-shell-ssh\/\" target=\"_blank\" rel=\"noreferrer noopener\">Secure Shell (ssh)<\/a><\/li>\n<\/ul>\n\n\n        <\/dd>\n    <\/div>\n\n\n    <div class=\"grid pt-4 pb-3 border-b accordion border-cu-black-100 md:pt-6 md:pb-5 first:border-t\">\n        <dt class=\"font-semibold not-prose\">\n            <button class=\"flex items-center justify-between w-full text-left accordion__button\" aria-expanded=\"false\" aria-controls=\"accordion-backing-up-files\">\n                <span class=\"flex-1 ml-auto text-left break-words whitespace-normal cu-icon\">\n                    Backing up Files\n                <\/span>\n                <svg xmlns=\"http:\/\/www.w3.org\/2000\/svg\" fill=\"none\" viewbox=\"0 0 24 24\" stroke-width=\"1.5\" stroke=\"currentColor\" aria-hidden=\"true\" data-slot=\"icon\" class=\"w-5 h-5 ml-auto transition-transform rotate-0 accordion__icon text-cu-black-500\">\n                    <path stroke-linecap=\"round\" stroke-linejoin=\"round\" d=\"M8.25 4.5l7.5 7.5-7.5 7.5\"><\/path>\n                <\/svg>\n            <\/button>\n        <\/dt>\n        <dd class=\"p-0 mt-0 cu-prose cu-prose-first-last accordion__content md:p-0 md:mt-0\" hidden=\"\" id=\"accordion-backing-up-files\">\n            \n\n<p>Once the VM is shut down it no longer exists so its important to backup your files especially once you have completed your experiments.<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li><a href=\"https:\/\/carleton.ca\/scs\/technical-support\/backups\/\" target=\"_blank\" rel=\"noopener noreferrer\">Backing up files<\/a><\/li>\n<\/ul>\n\n\n        <\/dd>\n    <\/div>\n\n\n    <div class=\"grid pt-4 pb-3 border-b accordion border-cu-black-100 md:pt-6 md:pb-5 first:border-t\">\n        <dt class=\"font-semibold not-prose\">\n            <button class=\"flex items-center justify-between w-full text-left accordion__button\" aria-expanded=\"false\" aria-controls=\"accordion-when-you-are-finished\">\n                <span class=\"flex-1 ml-auto text-left break-words whitespace-normal cu-icon\">\n                    When you are finished\n                <\/span>\n                <svg xmlns=\"http:\/\/www.w3.org\/2000\/svg\" fill=\"none\" viewbox=\"0 0 24 24\" stroke-width=\"1.5\" stroke=\"currentColor\" aria-hidden=\"true\" data-slot=\"icon\" class=\"w-5 h-5 ml-auto transition-transform rotate-0 accordion__icon text-cu-black-500\">\n                    <path stroke-linecap=\"round\" stroke-linejoin=\"round\" d=\"M8.25 4.5l7.5 7.5-7.5 7.5\"><\/path>\n                <\/svg>\n            <\/button>\n        <\/dt>\n        <dd class=\"p-0 mt-0 cu-prose cu-prose-first-last accordion__content md:p-0 md:mt-0\" hidden=\"\" id=\"accordion-when-you-are-finished\">\n            \n\n<p>Every GPU VM has an expiry date.\u00a0Once you completed your GPU experiments and you have\u00a0<strong>backed up your files<\/strong>\u00a0your VM can be terminated. Please note once your VM is terminated it cannot be recovered.<\/p>\n\n\n\n<p><em>If you finish your experiments before your VM expiry date please let us know. This will allow another student the opportunity to use your GPU.<\/em><\/p>\n\n\n\n<p>To help us improve our service, please fill out this exit questionnaire once you are finished:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li><a href=\"https:\/\/carleton.ca\/scs\/scs-forms\/scs-gpu-exit-questionnaire\/\" target=\"_blank\" rel=\"noreferrer noopener\">SCS GPU Exit Questionnaire<\/a><\/li>\n<\/ul>\n\n\n        <\/dd>\n    <\/div>\n\n\n    <\/dl>\n\n\n    <\/div>\n<\/section>\n\n\n\n<p><a href=\"https:\/\/youtu.be\/h9Z4oGN89MU?si=EiKgLPC7Nl7SdTEv\" type=\"link\" id=\"https:\/\/youtu.be\/h9Z4oGN89MU?si=EiKgLPC7Nl7SdTEv\">How do Graphics Cards Work? Exploring GPU Architecture (YouTube)<\/a><\/p>\n","protected":false},"excerpt":{"rendered":"<p>GPU Computing Introduction The SCS GPU allow you to program using its CUDA (Compute Unified Device Architecture) cores. CUDA is a parallel computing platform and application programming interface (API) model created by Nvidia. The CUDA platform is accessible to software developers through CUDA-accelerated libraries, compiler directives, and extensions to industry-standard programming languages. GPU programming has [&hellip;]<\/p>\n","protected":false},"author":2,"featured_media":0,"parent":6535,"menu_order":0,"comment_status":"closed","ping_status":"closed","template":"","meta":{"_acf_changed":false,"_cu_dining_location_slug":"","footnotes":"","_links_to":"","_links_to_target":""},"cu_page_type":[],"class_list":["post-808","page","type-page","status-publish","hentry"],"acf":{"cu_post_thumbnail":""},"_links":{"self":[{"href":"https:\/\/carleton.ca\/scs\/wp-json\/wp\/v2\/pages\/808","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/carleton.ca\/scs\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/carleton.ca\/scs\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/carleton.ca\/scs\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/carleton.ca\/scs\/wp-json\/wp\/v2\/comments?post=808"}],"version-history":[{"count":4,"href":"https:\/\/carleton.ca\/scs\/wp-json\/wp\/v2\/pages\/808\/revisions"}],"predecessor-version":[{"id":24709,"href":"https:\/\/carleton.ca\/scs\/wp-json\/wp\/v2\/pages\/808\/revisions\/24709"}],"up":[{"embeddable":true,"href":"https:\/\/carleton.ca\/scs\/wp-json\/wp\/v2\/pages\/6535"}],"wp:attachment":[{"href":"https:\/\/carleton.ca\/scs\/wp-json\/wp\/v2\/media?parent=808"}],"wp:term":[{"taxonomy":"cu_page_type","embeddable":true,"href":"https:\/\/carleton.ca\/scs\/wp-json\/wp\/v2\/cu_page_type?post=808"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}