Day 2 TensorFlow voter data project environment setup

Things are moving along. Right now I have 23 days left to submit my current project to the ⚡#PoweredByTF 2.0 Challenge!. That should not be a problem, but you never know what is going to happen. Right now I am fully registered and I setup a new GitHub project just for this effort.

  • My environment setup is going to be twofold for this project. My primary efforts will occur on the Google Cloud Platform and my secondary effort will occur on Colaboratory. If you have not heard of Colaboratory, then you are missing out on something awesome. It is a very easy to use free Jupyter notebook environment run by Google.
  • My initial build out included the following efforts on GCP:
    • GCP –> Artificial Intelligence –>  AI Platform –> Notebooks –> TensorFlow –> with GPU (us-west1-b, 4 vCPUs, 15 GB RAM, 1 NVIDIA Tesla K80, 100 GB Disk)
    • That yielded a strange error,  “Quota ‘GPUS_ALL_REGIONS’ exceeded. Limit: 0.0”.
    • The solution was to head out to the IAM & admin section of GCP and look up the quotas for my GPUS_ALL_REGIONS and request access to another GPU
    • I found the right global quota to change: GLOBAL Attribute | GPUS_ALL_REGIONS and asked for a quote increase using the handy dandy edit quotas button at the top of the IAM & admin –> Quotas screen
    • I got help from Julia over at Google support in the matter of a couple hours and then went back and made the notebook environment setup request again
    • Keep in mind that using this setup requires the commitment of funds to work on the project, but I wanted a dedicated GPU all to myself for the stretch run and it seemed like something that would bring me joy
      • The alternative here would be to use Colaboratory instead of paying for a dedicated GPU on GCP
    • Everything is now setup to run TensorFlow in a notebook on my own VM with a sweet NVIDIA Tesla K80 GPU
    • You can grab the instructions I used to true it up to 2.0.0-alpha0 here
  • Setting up on Colaboratory took a matter of seconds
    • Go check out
    • I’m going to be running a parallel set of notebooks throughout the whole process. My primary development will occur over on GCP and I’ll test every one of the notebooks on Colaboratory and use the export to GitHub from that environment to save the project off for submission

This site uses Akismet to reduce spam. Learn how your comment data is processed.