in pytorch, cuda.is_availbale(), but every operation fails with out of memory










1















I've set up a new virtual machine (on GCP) with a K80 GPU on Ubuntu 16.
Followed installation instructions for the CUDA toolkit 9.1



nvidia-smi returns correctly:
NVIDIA-SMI 390.12 Driver Version: 390.12
...



in pytorch, cuda.is_available() returns True,
but any operation fails:



torch.randn(10).cuda() ==>

RuntimeError: cuda runtime error (2) : out of memory at /opt/conda/conda-
bld/pytorch_1512378422383/work/torch/lib/THC/generic/THCStorage.cu:58


What am I missing in the installation?










share|improve this question




























    1















    I've set up a new virtual machine (on GCP) with a K80 GPU on Ubuntu 16.
    Followed installation instructions for the CUDA toolkit 9.1



    nvidia-smi returns correctly:
    NVIDIA-SMI 390.12 Driver Version: 390.12
    ...



    in pytorch, cuda.is_available() returns True,
    but any operation fails:



    torch.randn(10).cuda() ==>

    RuntimeError: cuda runtime error (2) : out of memory at /opt/conda/conda-
    bld/pytorch_1512378422383/work/torch/lib/THC/generic/THCStorage.cu:58


    What am I missing in the installation?










    share|improve this question


























      1












      1








      1








      I've set up a new virtual machine (on GCP) with a K80 GPU on Ubuntu 16.
      Followed installation instructions for the CUDA toolkit 9.1



      nvidia-smi returns correctly:
      NVIDIA-SMI 390.12 Driver Version: 390.12
      ...



      in pytorch, cuda.is_available() returns True,
      but any operation fails:



      torch.randn(10).cuda() ==>

      RuntimeError: cuda runtime error (2) : out of memory at /opt/conda/conda-
      bld/pytorch_1512378422383/work/torch/lib/THC/generic/THCStorage.cu:58


      What am I missing in the installation?










      share|improve this question
















      I've set up a new virtual machine (on GCP) with a K80 GPU on Ubuntu 16.
      Followed installation instructions for the CUDA toolkit 9.1



      nvidia-smi returns correctly:
      NVIDIA-SMI 390.12 Driver Version: 390.12
      ...



      in pytorch, cuda.is_available() returns True,
      but any operation fails:



      torch.randn(10).cuda() ==>

      RuntimeError: cuda runtime error (2) : out of memory at /opt/conda/conda-
      bld/pytorch_1512378422383/work/torch/lib/THC/generic/THCStorage.cu:58


      What am I missing in the installation?







      linux gpu pytorch






      share|improve this question















      share|improve this question













      share|improve this question




      share|improve this question








      edited Jan 28 '18 at 13:06









      talonmies

      59.4k17128197




      59.4k17128197










      asked Jan 28 '18 at 12:34









      PaulPaul

      9021721




      9021721






















          2 Answers
          2






          active

          oldest

          votes


















          0














          Oh.. Never mind I had to restart the machine for the drivers to reload.






          share|improve this answer


















          • 1





            I am using google colaboratory. I have restarted runtime many times but still facing the same issue. RuntimeError: cuda runtime error (2) : out of memory at

            – Mayur Patel
            Feb 14 '18 at 11:38


















          0














          1. sometimes the GPU memory is occupied by the previous operation to free up the memory the IDE kernel (spyder/spyder3) can be restarted or restart your PC.

          2. try the code with sudo command if you are using Ubuntu.

          hope it works for you as well.






          share|improve this answer
























            Your Answer






            StackExchange.ifUsing("editor", function ()
            StackExchange.using("externalEditor", function ()
            StackExchange.using("snippets", function ()
            StackExchange.snippets.init();
            );
            );
            , "code-snippets");

            StackExchange.ready(function()
            var channelOptions =
            tags: "".split(" "),
            id: "1"
            ;
            initTagRenderer("".split(" "), "".split(" "), channelOptions);

            StackExchange.using("externalEditor", function()
            // Have to fire editor after snippets, if snippets enabled
            if (StackExchange.settings.snippets.snippetsEnabled)
            StackExchange.using("snippets", function()
            createEditor();
            );

            else
            createEditor();

            );

            function createEditor()
            StackExchange.prepareEditor(
            heartbeatType: 'answer',
            autoActivateHeartbeat: false,
            convertImagesToLinks: true,
            noModals: true,
            showLowRepImageUploadWarning: true,
            reputationToPostImages: 10,
            bindNavPrevention: true,
            postfix: "",
            imageUploader:
            brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
            contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
            allowUrls: true
            ,
            onDemand: true,
            discardSelector: ".discard-answer"
            ,immediatelyShowMarkdownHelp:true
            );



            );













            draft saved

            draft discarded


















            StackExchange.ready(
            function ()
            StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f48486408%2fin-pytorch-cuda-is-availbale-but-every-operation-fails-with-out-of-memory%23new-answer', 'question_page');

            );

            Post as a guest















            Required, but never shown

























            2 Answers
            2






            active

            oldest

            votes








            2 Answers
            2






            active

            oldest

            votes









            active

            oldest

            votes






            active

            oldest

            votes









            0














            Oh.. Never mind I had to restart the machine for the drivers to reload.






            share|improve this answer


















            • 1





              I am using google colaboratory. I have restarted runtime many times but still facing the same issue. RuntimeError: cuda runtime error (2) : out of memory at

              – Mayur Patel
              Feb 14 '18 at 11:38















            0














            Oh.. Never mind I had to restart the machine for the drivers to reload.






            share|improve this answer


















            • 1





              I am using google colaboratory. I have restarted runtime many times but still facing the same issue. RuntimeError: cuda runtime error (2) : out of memory at

              – Mayur Patel
              Feb 14 '18 at 11:38













            0












            0








            0







            Oh.. Never mind I had to restart the machine for the drivers to reload.






            share|improve this answer













            Oh.. Never mind I had to restart the machine for the drivers to reload.







            share|improve this answer












            share|improve this answer



            share|improve this answer










            answered Jan 28 '18 at 13:03









            PaulPaul

            9021721




            9021721







            • 1





              I am using google colaboratory. I have restarted runtime many times but still facing the same issue. RuntimeError: cuda runtime error (2) : out of memory at

              – Mayur Patel
              Feb 14 '18 at 11:38












            • 1





              I am using google colaboratory. I have restarted runtime many times but still facing the same issue. RuntimeError: cuda runtime error (2) : out of memory at

              – Mayur Patel
              Feb 14 '18 at 11:38







            1




            1





            I am using google colaboratory. I have restarted runtime many times but still facing the same issue. RuntimeError: cuda runtime error (2) : out of memory at

            – Mayur Patel
            Feb 14 '18 at 11:38





            I am using google colaboratory. I have restarted runtime many times but still facing the same issue. RuntimeError: cuda runtime error (2) : out of memory at

            – Mayur Patel
            Feb 14 '18 at 11:38













            0














            1. sometimes the GPU memory is occupied by the previous operation to free up the memory the IDE kernel (spyder/spyder3) can be restarted or restart your PC.

            2. try the code with sudo command if you are using Ubuntu.

            hope it works for you as well.






            share|improve this answer





























              0














              1. sometimes the GPU memory is occupied by the previous operation to free up the memory the IDE kernel (spyder/spyder3) can be restarted or restart your PC.

              2. try the code with sudo command if you are using Ubuntu.

              hope it works for you as well.






              share|improve this answer



























                0












                0








                0







                1. sometimes the GPU memory is occupied by the previous operation to free up the memory the IDE kernel (spyder/spyder3) can be restarted or restart your PC.

                2. try the code with sudo command if you are using Ubuntu.

                hope it works for you as well.






                share|improve this answer















                1. sometimes the GPU memory is occupied by the previous operation to free up the memory the IDE kernel (spyder/spyder3) can be restarted or restart your PC.

                2. try the code with sudo command if you are using Ubuntu.

                hope it works for you as well.







                share|improve this answer














                share|improve this answer



                share|improve this answer








                edited Nov 14 '18 at 6:28

























                answered Nov 12 '18 at 10:36









                KhanKhan

                14215




                14215



























                    draft saved

                    draft discarded
















































                    Thanks for contributing an answer to Stack Overflow!


                    • Please be sure to answer the question. Provide details and share your research!

                    But avoid


                    • Asking for help, clarification, or responding to other answers.

                    • Making statements based on opinion; back them up with references or personal experience.

                    To learn more, see our tips on writing great answers.




                    draft saved


                    draft discarded














                    StackExchange.ready(
                    function ()
                    StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f48486408%2fin-pytorch-cuda-is-availbale-but-every-operation-fails-with-out-of-memory%23new-answer', 'question_page');

                    );

                    Post as a guest















                    Required, but never shown





















































                    Required, but never shown














                    Required, but never shown












                    Required, but never shown







                    Required, but never shown

































                    Required, but never shown














                    Required, but never shown












                    Required, but never shown







                    Required, but never shown







                    Popular posts from this blog

                    Top Tejano songwriter Luis Silva dead of heart attack at 64

                    ReactJS Fetched API data displays live - need Data displayed static

                    Evgeni Malkin