Page 1 of 1

Disabling OpenMP, gaining speedup

Posted: Fri Apr 25, 2014 3:35 am
by ehsan
Hi Rich,
I am totally aware that GYRE uses multi-threading in an efficient way, but I prefer to assign only one CPU to each job, and instead submit a series of jobs using SLURM.
For that, I always set OMP_NUM_THREADS=1
Our IT admin here at IvS noticed a run-time overhead due to the system calling FUTEX a lot of time. Thus, I turned OpenMP off, and recompiled gyre version 2.3, and retried the same jobs. I can tell that I did gain a factor of ~25% speedup.

The reason of this post is only to provide a feedback.

Cheers
Ehsan.

Re: Disabling OpenMP, gaining speedup

Posted: Fri Apr 25, 2014 1:19 pm
by rhtownsend
ehsan wrote:Hi Rich,
I am totally aware that GYRE uses multi-threading in an efficient way, but I prefer to assign only one CPU to each job, and instead submit a series of jobs using SLURM.
For that, I always set OMP_NUM_THREADS=1
Our IT admin here at IvS noticed a run-time overhead due to the system calling FUTEX a lot of time. Thus, I turned OpenMP off, and recompiled gyre version 2.3, and retried the same jobs. I can tell that I did gain a factor of ~25% speedup.

The reason of this post is only to provide a feedback.

Cheers
Ehsan.
Hi Ehsan --

Interesting! What system is this running on? I just tried reproducing the problem on Linux (Gentoo, kernel 3.12), and I find no significant difference in runtimes.

cheers,

Rich

Re: Disabling OpenMP, gaining speedup

Posted: Sat Apr 26, 2014 12:10 pm
by ehsan
Hello Rich,
I logged into one of the compute nodes, and

Code: Select all

-bash-4.2$ uname -a
Linux pleiad02.ster.kuleuven.be 3.11.7-200.fc19.x86_64 #1 SMP Mon Nov 4 14:09:03 UTC 2013 x86_64 x86_64 x86_64 GNU/Linux
Tell me exactly what specifications you'd like to know and I help you with that.

Cheers
Ehsan.