<html xmlns="http://www.w3.org/1999/xhtml">
<head>
<title></title>
</head>
<body>
<div name="messageBodySection">
<div dir="auto"><span style="font-family:Arial;font-size: medium">Thanks Dirk. Here’s the important part of a top command with 873 users connected.</span><span style="font-size: medium"><br /></span><span style="font-size: medium"><br /></span><img style="max-width:100%;height:auto" src="cid:8FA497A6743045369118BC783E0ED6B6" /><span style="font-size: medium"><br /></span><span style="font-family:Arial;font-size: medium">The Pi is bored, it’s got almost nothing to do whatsoever! The only time there’s any load is if someone does a historical lookup command. I ran up a DO droplet and reproduced my setup there but the Pi5 was quicker to respond to searches so I didn’t switch over.</span><span style="font-size: medium"><br /></span><span style="font-size: medium"><br /></span><span style="font-family:Arial;font-size: 16px">As this has never happened before (and I’ve had more users on), I’m not going to worry about it now but it happens again then I’ll look further. Spider runs as a service though, would it be possible to add the ulimit command in as part of the service commands?</span><span style="font-size: 16px"><br /></span><span style="font-size: 16px"><br /></span><span style="font-family:Arial;font-size: 16px">73 Keith</span></div>
</div>
<div name="messageReplySection">On 23 Mar 2025 at 23:08 +0000, djk via Dxspider-support <dxspider-support@tobit.co.uk>, wrote:<br />
<blockquote type="cite" style="border-left-color: grey; border-left-width: thin; border-left-style: solid; margin: 5px 5px;padding-left: 10px;">
<p>There is standard limit of 1024 files open at once per process. You can change this in a shell with 'ulimit -n 2048' (for example). There is also way of changing it system wide in systemd (<spit>) but you'll have to research that yourself or start the node in a shell script like:</p>
#!/bin/sh<br />
ulimit -n 2048<br />
/spider/perl/cluster.pl
<p>Personally, 900+ users on a 4GB RPi x is going some, especially considering power required to run some windows cluster software (and then still not keeping).</p>
<p>What does your 'top' say when you are running it at this sort of usage?</p>
<p>Dirk G1TLH<br /></p>
<div class="moz-cite-prefix">On 23/03/2025 18:54, Keith, G6NHU via Dxspider-support wrote:<br /></div>
<blockquote type="cite" cite="mid:2133a6f9-b6b6-459c-b65f-8964ac3fc45a@Spark">
<meta http-equiv="content-type" content="text/html; charset=UTF-8" />
<div name="messageBodySection">
<div dir="auto">I suppose this really is for Dirk.<br />
<br />
This has never happened before - I came into the shack with a freshly poured shackbeer and noticed my ssh session had closed so I logged back in and saw my uptime was just 21 minutes.<br />
<br />
Checking the debug log (attached as a .zip), this is what happened in the same timestamp with the actual error that caused the crash being at the end.<br />
<br />
My cluster is running on a Pi5 with 4Gb RAM and an external Samsung SSD. I don’t know the exact number of connected users but when I logged back on, there were 938 so I’d imagine the number prior to the crash was around the same. The node had been up for about a month.<br />
<br />
“Too many open files” ?<br />
<br />
73 Keith<br />
<br />
1742753087^###<br />
1742753087^### RINGBUFFER END 501 debug lines written<br />
1742753087^###<br />
1742753087^(trace) writing /spider/local_data/rbn_cache Too many open files<br />
1742753087^(trace) Stack (2): RBN::DXDebug::confess in /spider/perl/RBN.pm line: 926<br />
1742753087^(trace) Stack (3): RBN::RBN::write_cache in /spider/perl/RBN.pm line: 871<br />
1742753087^(trace) Stack (4): main::RBN::per_minute in /spider/perl/<a href="http://cluster.pl" target="_blank" moz-do-not-send="true">cluster.pl</a> line: 892<br />
1742753087^(*) DXSpider Ceasing<br />
1742753087^(*) DXQSL finished<br />
1742753087^(*) RBN:WRITE_CACHE size: 423.804KB time to write: 26 mS<br />
1742753087^(*) DXDupe finishing<br />
1742753087^(*) DXUser finished<br />
1742753087^(cluster) DXSpider v1.57 build 568 (git: mojo/0920a333[r]) using perl v5.36.0 on linux ended<br />
1742753087^(*) bye bye everyone - bye bye<br />
1742753087^###<br />
1742753087^### RINGBUFFER START at line 0 (zero base)<br />
1742753087^###<br />
<br />
Then it repeats<br />
<br />
1742753087^RING: 18:04:47^(trace) writing /spider/local_data/rbn_cache Too many open files<br />
1742753087^RING: 18:04:47^(trace) Stack (2): RBN::DXDebug::confess in /spider/perl/RBN.pm line: 926<br />
1742753087^RING: 18:04:47^(trace) Stack (3): RBN::RBN::write_cache in /spider/perl/RBN.pm line: 871<br />
1742753087^RING: 18:04:47^(trace) Stack (4): main::RBN::per_minute in /spider/perl/<a href="http://cluster.pl" target="_blank" moz-do-not-send="true">cluster.pl</a> line: 892<br />
1742753087^RING: 18:04:47^(*) DXSpider Ceasing<br />
1742753087^RING: 18:04:47^(*) DXQSL finished<br />
1742753087^RING: 18:04:47^(*) RBN:WRITE_CACHE size: 423.804KB time to write: 26 mS<br />
1742753087^RING: 18:04:47^(*) DXDupe finishing<br />
1742753087^RING: 18:04:47^(*) DXUser finished<br />
1742753087^RING: 18:04:47^(cluster) DXSpider v1.57 build 568 (git: mojo/0920a333[r]) using perl v5.36.0 on linux ended<br />
1742753087^RING: 18:04:47^(*) bye bye everyone - bye bye<br />
1742753087^###<br />
1742753087^### RINGBUFFER END 501 debug lines written<br />
1742753087^###</div>
</div>
<br />
<fieldset class="moz-mime-attachment-header"></fieldset>
<pre wrap="" class="moz-quote-pre">_______________________________________________
Dxspider-support mailing list
<a class="moz-txt-link-abbreviated" href="mailto:Dxspider-support@tobit.co.uk">Dxspider-support@tobit.co.uk</a>
<a class="moz-txt-link-freetext" href="https://mailman.tobit.co.uk/mailman/listinfo/dxspider-support">https://mailman.tobit.co.uk/mailman/listinfo/dxspider-support</a>
</pre></blockquote>
_______________________________________________<br />
Dxspider-support mailing list<br />
Dxspider-support@tobit.co.uk<br />
https://mailman.tobit.co.uk/mailman/listinfo/dxspider-support<br /></blockquote>
</div>
</body>
</html>