Page 1 of 1
how does it work with multiple GPU devices?
Posted: Wed Jun 19, 2013 9:57 am
by bravegag
Hello,
I'm building a system using not one but four GPU cards each in a separate PCI-e slot e.g. nVidia 680 GTX. Will Magma automatically load balance across all these four cards? I guess they will show up with different device Id's by calling cudaGetDeviceProperties.
TIA,
Best regards,
Giovanni
Re: how does it work with multiple GPU devices?
Posted: Wed Jun 19, 2013 7:57 pm
by mgates3
Yes, some MAGMA routines are written for multiple GPUs. Specifically,
magma_xgetrf( ... )
magma_xgeqrf( ... )
magma_xpotrf( ... )
where x is the precision. In the forthcoming release, there will also be multi-GPU eigenvalue solvers.
You need to set MAGMA_NUM_GPUS in your environment to the number of GPUs that you want to use. E.g. with csh,
setenv MAGMA_NUM_GPUS 4
Is there particular functionality that you are interested in?
-mark
Re: how does it work with multiple GPU devices?
Posted: Thu Jun 20, 2013 12:27 am
by bravegag
Hello mark,
Thank you very much! I'm interested in speeding up computation for a machine learning framework, I think the main factorizations which you named are already covered, other than that I am trying to leverage magma into Eigen, since the function signatures are not that different from MKL I think it is very doable to run magma behind the Eigen abstractions where possible.
Best regards,
Giovanni