DESY specifics and 'must-knows'¶
This page is trying to list all you need to know about the NAF setup in order to use it successfully. Make sure you understand everything and contact us if you have questions !
Job classes¶
we automatically class your job depending on the ressources you request, there are only two classes of jobs:
lite jobs¶
this is also the default job class, hence the class your job ends up in if you do not request any additional ressources. Lite jobs are limited to the following ressources: - 3h runtime - 1 core - 1.5 GB memory
Lite jobs can use surplus quota
Lite jobs can largely profit from overcommittment of ressources and run outside of the much smaller bide job quota. If possible try to use this job class as it gives you the chance to take over 80% of the pool in case you are lucky and ressources are available !
bide jobs¶
any ressource request above the limits of a lite job files your job into this category the request syntax is request_<ressource> = <value> e.g. request_cpus = 2. Requestable ressources are:
- Runtime (in seconds)
- CPUs (in cores)
- Memory (in MB or GB)
Ressource requests are limited to machine boundaries, use condor_status if in doubt what kind of ressources are available !
General limits¶
- Job submits are limited to 5.000 jobs per user on the scheduler including running, idle and held jobs (see here if you plan to submit larger amounts of jobs: Submit large number of jobs )
Quotas and priorities¶
we run a couple of negotiators with different purposes in the NAF which currently leads to a messed up table arrangement if you use the default command condor_userprio you need to specify the negotiator you want to query. In order to make life easier we mapped the default batch negotiator to the command condor_userprio.desy and the GPU negotiator to condor_userprio.gpu
Here is an example output:
[chbeyer@naf-belle22]~% condor_userprio.desy
Last Priority Update: 12/18 15:35
Group Config Use Effective Priority Wghted Total Usage Time Since Weighted Submitter
User Name Quota Surplus Priority Factor In Use (wghted-hrs) Last Usage Requested Ceiling
---------------------- --------- ------- ------------ --------- ------ ------------ ---------- ---------- ---------
BIRD_luxe.bide 774.19 no 1000.00 0 1.47 0+00:26 0
BIRD_belle.lite 1548.39 ByQuota 1000.00 1 33599.65 <now> 1
glazov@desy.de 500.08 1000.00 0 0.03 0+00:16
tiacrane@desy.de 505.74 1000.00 1 8.22 <now>
BIRD_ilc.lite 1548.39 ByQuota 1000.00 1 9.40 <now> 2
anna22@desy.de 503.20 1000.00 1 0.67 <now>
BIRD_it.lite 7741.94 ByQuota 1000.00 18 2037.81 <now> 0
BIRD_atlas.lite 5806.45 ByQuota 1000.00 78 34834.90 <now> 411
heim@desy.de 628.27 1000.00 1 15.26 <now>
tadej@desy.de 1357.43 1000.00 77 32194.82 <now>
BIRD_ilc.bide 774.19 no 1000.00 11 333.23 <now> 11
anna22@desy.de 503.36 1000.00 1 0.72 <now>
jtorndal@desy.de 3541.29 1000.00 10 332.51 <now>
BIRD_atlas.bide 2903.23 no 1000.00 89 7645.33 <now> 340
sitnikov@desy.de 510.76 1000.00 0 2.88 0+00:10
glinghua@desy.de 1073.66 1000.00 10 161.92 <now>
bayerluk@desy.de 1915.46 1000.00 53 153.97 <now>
appelt@desy.de 4593.68 1000.00 26 440.75 <now>
BIRD_cms.lite 7741.94 ByQuota 1000.00 824 76244.33 <now> 520
taheri@desy.de 622.13 1000.00 2 16.19 <now>
malchowj@desy.de 642.87 1000.00 7 15.13 0+00:07
matthiej@desy.de 880.49 1000.00 1 44.12 <now>
kleinboe@desy.de 902.83 1000.00 16 43.89 <now>
milee@desy.de 919.73 1000.00 65 1053.40 <now>
diwang@desy.de 999.14 1000.00 9 56.58 <now>
kadamowi@desy.de 2743.29 1000.00 189 235.20 <now>
sanjrani@desy.de 3611.58 1000.00 5 330.80 <now>
abelvede@desy.de 4082.36 1000.00 38 734.98 0+00:12
jung@desy.de 15969.39 1000.00 31 9594.53 <now>
gmilella@desy.de 30506.06 1000.00 506 3216.05 <now>
BIRD_cms.bide 3870.97 no 1000.00 880 100069.91 <now> 1101
hemohamm@desy.de 500.00 1000.00 1 0.73 0+01:45
kleinboe@desy.de 501.20 1000.00 1 1.07 0+00:02
malchowj@desy.de 501.84 1000.00 1 0.47 0+00:15
jipark@desy.de 587.40 1000.00 2 12.47 <now>
rrafeek@desy.de 873.80 1000.00 4 39.52 <now>
lauridsj@desy.de 1328.38 1000.00 100 3484.30 <now>
haddadan@desy.de 1828.14 1000.00 3 140.59 <now>
wolfmor@desy.de 3608.18 1000.00 51 6157.97 <now>
pkeicher@desy.de 4931.34 1000.00 223 465.52 <now>
baxtersa@desy.de 13747.54 1000.00 5 1440.69 <now>
riegerma@desy.de 16081.13 1000.00 25 1683.62 <now>
abelvede@desy.de 16320.63 1000.00 1 13967.07 <now>
bachjoer@desy.de 18848.27 1000.00 446 1972.49 <now>
beinsam@desy.de 66054.05 1000.00 3 7130.84 0+00:01
BIRD_jupyter.bide 120.00 no 1000.00 30 5451.43 <now> 0
BIRD_belle.bide 774.19 no 1000.00 646 12563.47 <now> 1830
feichtip@desy.de 538.04 1000.00 4 6.48 <now>
dajaco@desy.de 620.18 1000.00 9 81.24 <now>
csantos@desy.de 976.75 1000.00 2 54.74 0+00:11
glazov@desy.de 1410.50 1000.00 118 98.09 <now>
khanmuni@desy.de 10372.70 1000.00 404 1106.23 <now>
niharika@desy.de 24051.17 1000.00 111 2520.54 <now>
<none> 0.00 yes 1000.00 3 18.21 <now> 3
fasseltl@desy.de 527.13 1000.00 1 6.02 0+00:01
tanxiaoz@desy.de 527.89 1000.00 1 6.10 <now>
condor@desy.de 528.15 1000.00 1 6.09 <now>
---------------------- --------- ------- ------------ --------- ------ ------------ ---------- ---------- ---------
Number of users: 45 ByQuota 2566 89035.48 0+23:59
The user_priorities are calculated in an interval and do not get updated every couple of seconds - please do not poll them with any kind of automate !
Here is an example on how to read the above table: Belle could run 1.548 lite jobs by quota and is currently running 1 job of this type. At the same time Belle user could run 774 bide jobs and are currently running 646 jobs in bide quota. Under the quota you can see the descending list of users priorities with the weighted usage on the right hand of the table. The so called 'fairshare' is based on the usage of the last 7 days.
Scheme of the NAF setup¶
