Disabling OpenMP, gaining speedup

General discussion of all things GYRE-related (e.g., results, talks, ideas, tips)

Disabling OpenMP, gaining speedup

Postby ehsan » Fri Apr 25, 2014 3:35 am

Hi Rich,
I am totally aware that GYRE uses multi-threading in an efficient way, but I prefer to assign only one CPU to each job, and instead submit a series of jobs using SLURM.
For that, I always set OMP_NUM_THREADS=1
Our IT admin here at IvS noticed a run-time overhead due to the system calling FUTEX a lot of time. Thus, I turned OpenMP off, and recompiled gyre version 2.3, and retried the same jobs. I can tell that I did gain a factor of ~25% speedup.

The reason of this post is only to provide a feedback.

Cheers
Ehsan.
ehsan
 
Posts: 64
Joined: Sun Jun 16, 2013 11:31 am

Re: Disabling OpenMP, gaining speedup

Postby rhtownsend » Fri Apr 25, 2014 1:19 pm

ehsan wrote:Hi Rich,
I am totally aware that GYRE uses multi-threading in an efficient way, but I prefer to assign only one CPU to each job, and instead submit a series of jobs using SLURM.
For that, I always set OMP_NUM_THREADS=1
Our IT admin here at IvS noticed a run-time overhead due to the system calling FUTEX a lot of time. Thus, I turned OpenMP off, and recompiled gyre version 2.3, and retried the same jobs. I can tell that I did gain a factor of ~25% speedup.

The reason of this post is only to provide a feedback.

Cheers
Ehsan.


Hi Ehsan --

Interesting! What system is this running on? I just tried reproducing the problem on Linux (Gentoo, kernel 3.12), and I find no significant difference in runtimes.

cheers,

Rich
User avatar
rhtownsend
Site Admin
 
Posts: 146
Joined: Sun Mar 31, 2013 4:22 pm

Re: Disabling OpenMP, gaining speedup

Postby ehsan » Sat Apr 26, 2014 12:10 pm

Hello Rich,
I logged into one of the compute nodes, and
Code: Select all
-bash-4.2$ uname -a
Linux pleiad02.ster.kuleuven.be 3.11.7-200.fc19.x86_64 #1 SMP Mon Nov 4 14:09:03 UTC 2013 x86_64 x86_64 x86_64 GNU/Linux

Tell me exactly what specifications you'd like to know and I help you with that.

Cheers
Ehsan.
ehsan
 
Posts: 64
Joined: Sun Jun 16, 2013 11:31 am


Return to General Discussion

Who is online

Users browsing this forum: No registered users and 1 guest

cron