log in

BOINC pentathlon

Message boards : NFS Discussion : BOINC pentathlon
Message board moderation

To post messages, you must log in.

AuthorMessage
Kiska

Send message
Joined: 13 Apr 12
Posts: 6
Credit: 1,649,025
RAC: 0
Message 2161 - Posted: 13 May 2021, 4:22:25 UTC

Well... that is very exponential looking graph
ID: 2161 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Kiska

Send message
Joined: 13 Apr 12
Posts: 6
Credit: 1,649,025
RAC: 0
Message 2163 - Posted: 13 May 2021, 16:12:21 UTC

yep this is starting to look like someone put 2^x into the work generator limit
ID: 2163 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
xii5ku

Send message
Joined: 26 Jul 17
Posts: 4
Credit: 79,160,094
RAC: 0
Message 2167 - Posted: 15 May 2021, 6:39:15 UTC

To summarize the observations during the first hours after May 12 18:00 UTC (contest announcement), and the first hours after May 15 00:00 UTC (contest start):

  • Work generator speed was a bottleneck during the first hour, but not later anymore.
  • There was so much work generated subsequently, that work generator speed is not going to be a bottleneck anytime soon.
  • However, with more than 250,000 results returned during the first five hours of May 15, first the validator, then the assimilator was maxed out.
  • For several hours now, the server is not assigning new tasks to hosts.

Is the assimilator backlog the reason for the server's refusal to send new work?

ID: 2167 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Kiska

Send message
Joined: 13 Apr 12
Posts: 6
Credit: 1,649,025
RAC: 0
Message 2168 - Posted: 15 May 2021, 6:51:15 UTC - in response to Message 2167.  

To summarize the observations during the first hours after May 12 18:00 UTC (contest announcement), and the first hours after May 15 00:00 UTC (contest start):

  • Work generator speed was a bottleneck during the first hour, but not later anymore.
  • There was so much work generated subsequently, that work generator speed is not going to be a bottleneck anytime soon.
  • However, with more than 250,000 results returned during the first five hours of May 15, first the validator, then the assimilator was maxed out.
  • For several hours now, the server is not assigning new tasks to hosts.

Is the assimilator backlog the reason for the server's refusal to send new work?



Feeders inability to keep tasks in memory for when requests come in.

From memory the scheduler only looks in memory to see if there is any tasks to be issued when its looking for work to send. It is the feeders job to keep said memory full(well cached), this way it doesn't issue lots of tiny database queries for work.
ID: 2168 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Greg
Project administrator

Send message
Joined: 26 Jun 08
Posts: 645
Credit: 470,593,468
RAC: 269,449
Message 2169 - Posted: 15 May 2021, 7:44:06 UTC - in response to Message 2168.  

Background results processing on top of the sprint load was overwhelming the server. I've turned that off. Hopefully the server will catch up soon. Thanks for your patience!
ID: 2169 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
MindCrime

Send message
Joined: 26 Mar 14
Posts: 1
Credit: 2,199,686
RAC: 0
Message 2172 - Posted: 15 May 2021, 9:39:06 UTC - in response to Message 2163.  

do your stats exports tax the servers even more?
ID: 2172 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Chooka

Send message
Joined: 24 Jun 18
Posts: 8
Credit: 51,520,616
RAC: 340
Message 2173 - Posted: 15 May 2021, 14:03:56 UTC

Shame I have received any NFS work all day :(
ID: 2173 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Greg
Project administrator

Send message
Joined: 26 Jun 08
Posts: 645
Credit: 470,593,468
RAC: 269,449
Message 2175 - Posted: 15 May 2021, 16:06:04 UTC - in response to Message 2173.  

Work has been going out, but it gets immediately gobbled up. It seems nearly everyone wants work from the lasieve_5f queue, so I've temporarily stopped feeding work from the other queues until those clients are full.
ID: 2175 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
[P3D] Crashtest
Avatar

Send message
Joined: 25 May 14
Posts: 1
Credit: 49,045,210
RAC: 578
Message 2176 - Posted: 15 May 2021, 17:50:36 UTC

I got over 9000 Wu in 1h so it looks like it worked
ID: 2176 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Kiska

Send message
Joined: 13 Apr 12
Posts: 6
Credit: 1,649,025
RAC: 0
Message 2177 - Posted: 16 May 2021, 2:44:11 UTC - in response to Message 2175.  
Last modified: 16 May 2021, 2:45:27 UTC

Work has been going out, but it gets immediately gobbled up. It seems nearly everyone wants work from the lasieve_5f queue, so I've temporarily stopped feeding work from the other queues until those clients are full.


It looks like you're efforts are rewarded:


PS: Are you able to reduce the time between server status page updates? xD

PPS: https://munin.kiska.pw/munin/static/dynazoom.html?cgiurl_graph=/munin-cgi/munin-cgi-graph&plugin_name=Munin-Node/Munin-Node/results_nfs&size_x=800&size_y=400&start_epoch=1620441730&stop_epoch=1621132930
ID: 2177 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Greg
Project administrator

Send message
Joined: 26 Jun 08
Posts: 645
Credit: 470,593,468
RAC: 269,449
Message 2178 - Posted: 16 May 2021, 4:16:40 UTC - in response to Message 2177.  

PS: Are you able to reduce the time between server status page updates? xD

The server is stable right now. I'm not touching it! :-)
ID: 2178 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Kiska

Send message
Joined: 13 Apr 12
Posts: 6
Credit: 1,649,025
RAC: 0
Message 2179 - Posted: 16 May 2021, 6:18:45 UTC - in response to Message 2178.  

PS: Are you able to reduce the time between server status page updates? xD

The server is stable right now. I'm not touching it! :-)


*pokes server with long stick*
ID: 2179 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Greg
Project administrator

Send message
Joined: 26 Jun 08
Posts: 645
Credit: 470,593,468
RAC: 269,449
Message 2180 - Posted: 16 May 2021, 16:23:53 UTC - in response to Message 2179.  

Ok Kiska, no more sticks!

It's always fun to wake up and discover Apache PHP crashed shortly after I went to bed. We're back and I'll keep an eye on it.
ID: 2180 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
10esseeTony

Send message
Joined: 23 Mar 15
Posts: 1
Credit: 25,051,874
RAC: 0
Message 2182 - Posted: 16 May 2021, 17:38:15 UTC
Last modified: 16 May 2021, 17:40:49 UTC

Dammit Kiska! :D :D :D

@Greg, well done sir, comms are a bit spotty but that the server is generally handling a massive inflow well is a testament to you and your team! Let's hope you have no more surprises.
ID: 2182 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Kiska

Send message
Joined: 13 Apr 12
Posts: 6
Credit: 1,649,025
RAC: 0
Message 2183 - Posted: 17 May 2021, 3:43:56 UTC - in response to Message 2180.  

Ok Kiska, no more sticks!

It's always fun to wake up and discover Apache PHP crashed shortly after I went to bed. We're back and I'll keep an eye on it.


Sorry not sorry :p



PS: My thing polls the page once per 5 minutes :D
ID: 2183 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile yoyo_rkn
Avatar

Send message
Joined: 5 Sep 09
Posts: 2
Credit: 708,996
RAC: 0
Message 2184 - Posted: 17 May 2021, 5:38:42 UTC - in response to Message 2183.  

And this is not the problem as the page is cached on BOINC server side.
ID: 2184 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Speedy51

Send message
Joined: 16 Oct 09
Posts: 46
Credit: 833,166
RAC: 1
Message 2192 - Posted: 23 May 2021, 2:56:14 UTC

Out of complete curiosity what percentage of the current lasieve_5f number was processed thanks to the pentathlon?
ID: 2192 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote

Message boards : NFS Discussion : BOINC pentathlon


Home | My Account | Message Boards