<html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
</head>
<body text="#000000" bgcolor="#FFFFFF">
<div class="moz-cite-prefix">Andy<br>
<br>
I am a bit concerned about this, because the way that sh/dx (or
any of show/<something that is stored in files like spots>
cmds) only read in one file at a time and then will filter each
line, one at a time, and only store a maximum of the number of
spots asked for (default: 10 spots / 25 lines). It was
deliberately designed to run on hardware that was secondhand
and/or old in 1997 so should (and has) work(ed) on machines with
only 10s or 100s of MB of RAM.<br>
<br>
Also, as default, it will only search the last 3 months worth of
spots.<br>
<br>
My spot directory is 3.3GB and my RAM usage after 3 days (odd) of
running is ~146KB (virtual) - even after having searched for
non-existent callsigns like G1TLH :-).<br>
<br>
Finally, I would expect perl programs to exit fairly gracefully
(actually.. just exit) on running out of user memory. In any case,
it isn't something that the program(mer) has any control over.
There are not any "out of ram" hooks that I can use to do
something more elegant.<br>
<br>
This suggestion may sound off the wall and irrelevant to spots,
but would you try blowing away your user file and then recreating
it (stop the node then: cd /spider/data; rm data.v3; perl user_asc
then restart the node). Also, if you are using an SD card for your
filesystem, consider replacing it. It may be worn out. Going into
swap on a old SD card is probably erm... sub-optimal.<br>
<br>
Dirk<br>
<br>
<br>
6/09/18 10:47, Andy Cook, G4PIQ via Dxspider-support wrote:<br>
</div>
<blockquote type="cite"
cite="mid:b6a101d44da2$4ba59310$e2f0b930$@btinternet.com">
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
<meta name="Generator" content="Microsoft Word 15 (filtered
medium)">
<style><!--
/* Font Definitions */
@font-face
{font-family:"Cambria Math";
panose-1:2 4 5 3 5 4 6 3 2 4;}
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0cm;
margin-bottom:.0001pt;
font-size:11.0pt;
font-family:"Calibri",sans-serif;}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:blue;
text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
{mso-style-priority:99;
color:purple;
text-decoration:underline;}
p.msonormal0, li.msonormal0, div.msonormal0
{mso-style-name:msonormal;
mso-margin-top-alt:auto;
margin-right:0cm;
mso-margin-bottom-alt:auto;
margin-left:0cm;
font-size:11.0pt;
font-family:"Calibri",sans-serif;}
span.EmailStyle19
{mso-style-type:personal-reply;
font-family:"Calibri",sans-serif;
color:windowtext;}
.MsoChpDefault
{mso-style-type:export-only;
font-size:10.0pt;}
@page WordSection1
{size:612.0pt 792.0pt;
margin:72.0pt 72.0pt 72.0pt 72.0pt;}
div.WordSection1
{page:WordSection1;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]-->
<div class="WordSection1">
<p class="MsoNormal">I’ve been running a node for contests
(GB7DXM) where it receives a feed from the RBN network – so
lots of spots over a period. It’s been running on small
hardware, Raspberry Pi 3 and more recently an AWS t2.micro
instance – both with only 1 GB of RAM. Currently running v
1.55 Build 0.197.<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">Once there are plenty of spots in the
database (spots directory is currently 578 Mb – but the crash
still happened when it was smaller), if you run a sh/dx on a
call which is nowhere in the database, or a long way back, the
cluster.pl process quickly consumes all free memory and after
a few seconds the whole host freezes and needs a hard re-boot.<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">Now – I know I could (and will) just try
this with more memory – but the full crash of the host is a
bit nasty. Have I missed some memory management controls
somewhere? Forgive my Linux skills – they are basic!<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">73,<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">Andy, G4PIQ<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<br>
<fieldset class="mimeAttachmentHeader"></fieldset>
<br>
<pre wrap="">_______________________________________________
Dxspider-support mailing list
<a class="moz-txt-link-abbreviated" href="mailto:Dxspider-support@tobit.co.uk">Dxspider-support@tobit.co.uk</a>
<a class="moz-txt-link-freetext" href="https://mailman.tobit.co.uk/mailman/listinfo/dxspider-support">https://mailman.tobit.co.uk/mailman/listinfo/dxspider-support</a>
</pre>
</blockquote>
<br>
</body>
</html>