GPU - minimum requirements?

#1

Hi,

I’m running the gpu-x3-beta container and I get 400 errors from the API when an image is posted. If I use the CPU version, it works fine and returns results as expected. But, the CPU version is slow for my hardware and I was hoping I could use the GPU.

Is there a minimum GPU or version of CUDA that is required for this? I’m running a Geforce 710 and I am able to run the nvidia cuda runtime through docker and get an output from nvidia-smi. But, I have to run version 10 and not version 11.

 docker run --runtime=nvidia --rm nvidia/cuda:10.1-runtime nvidia-smi
Tue Sep 15 22:37:11 2020
+-----------------------------------------------------------------------------+
| NVIDIA-SMI 440.59       Driver Version: 440.59       CUDA Version: 10.2     |
|-------------------------------+----------------------+----------------------+
| GPU  Name        Persistence-M| Bus-Id        Disp.A | Volatile Uncorr. ECC |
| Fan  Temp  Perf  Pwr:Usage/Cap|         Memory-Usage | GPU-Util  Compute M. |
|===============================+======================+======================|
|   0  GeForce GT 710      Off  | 00000000:01:00.0 N/A |                  N/A |
| 40%   36C    P0    N/A /  N/A |      0MiB /  2001MiB |     N/A      Default |
+-------------------------------+----------------------+----------------------+

+-----------------------------------------------------------------------------+
| Processes:                                                       GPU Memory |
|  GPU       PID   Type   Process name                             Usage      |
|=============================================================================|
|    0                    Not Supported                                       |
+-----------------------------------------------------------------------------+

So - is there a minimum GPU or CUDA version that is needed for this to work?

#2

Hello, I tested the same config many times with a gt 710 with 2gb of ram, never worked.

#3

Thanks for chiming in and letting me know. Ok, I guess I’ll try another GPU. Cheers!

#4

Welcome, but I am still looking for a solution, I am not an expert, I hope a solution /confirmation from deepstack team…, maybe it is possible to run it with gt710…

#5

Well, based on what you said, i swapped out the GT 710 with a spare GTX 970 that I had around. I put that in just now and it works well. So, it seems the minimum version GPU required is Maxwell. The GT 710 is the generation before it, Kepler. :frowning:

My previous times were 3 seconds for object analysis. With GPU, it is now max about 300ms. WOW!