<html><head></head><body><div style="font-family: Verdana;font-size: 12.0px;"><div>Jim, with the command "apt-get clean" you may have cleaned a few kilobytes or a small size of megabytes. This command just purges the cache in /var/cache/apt/archives/</div>
<div> </div>
<div>Obviously your root filesystem (is indicated with the slash '/' ) has reached 100% and is full. This is the most important file system, because main system folders are subordinated on it. If there is no more free memory there, then a running process cannot write its log files, or create temporary files for the process, etc. Then the process terminates and reports the error.</div>
<div> </div>
<div>You have to check your filesystem and see what folder has filled up your space in /</div>
<div>You can do this by this command:</div>
<div> </div>
<div>du -sh /* 2>/dev/null | sort -rh</div>
<div> </div>
<div>this may take some time, depending on the size of your hard disk, as it shows your total disk space usage from view of the top root. As a result you get a sorted output list and see which directories on the root have the highest usage.</div>
<div> </div>
<div>Example output:</div>
<div><br/>
9,5G /var<br/>
986M /usr<br/>
429M /lib<br/>
61M /boot<br/>
31M /run<br/>
8,7M /bin<br/>
7,7M /sbin<br/>
6,5M /etc<br/>
1,1M /root<br/>
104K /dev<br/>
56K /home</div>
<div>
<div> </div>
<div>Here you don't see any more information about the partition of the harddisk, eg. if the home directory is also mounted under root or if it has its own partition, but most of the time you will find the memory hogs by this procedure.</div>
</div>
<div> </div>
<div>In the next step you can run the command again, but this time with the folder name that was shown as the largest in the first step. In my example this is /var folder. Now you need to execute the command with the /var folder specified, like this:</div>
<div>
<div> </div>
<div>du -sh /var/* 2>/dev/null | sort -rh</div>
<div>
<div> </div>
<div>This can output something like:</div>
<div> </div>
<div>
<div>8,2G /var/log</div>
<div>1,7G /var/lib<br/>
65M /var/cache<br/>
2,0M /var/backups<br/>
948K /var/spool<br/>
20K /var/tmp<br/>
16K /var/lost+found<br/>
8,0K /var/mail<br/>
4,0K /var/opt<br/>
4,0K /var/local<br/>
0 /var/run<br/>
0 /var/lock</div>
<div> </div>
<div>Now I know that my /var/log fills up 8,2G and I can look into that directory and go on with this procedure to find out the memory hog.</div>
<div> </div>
<div>Check your harddisk space, free up some memory and you're done. Good luck!</div>
<div> </div>
<div>73</div>
<div>Saki, DD5XX</div>
</div>
<div name="quote" style="margin:10px 5px 5px 10px; padding: 10px 0 10px 10px; border-left:2px solid #C3D9E5; word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;">
<div style="margin:0 0 10px 0;"><b>Gesendet:</b> Mittwoch, 28. April 2021 um 02:39 Uhr<br/>
<b>Von:</b> "James Snider via Dxspider-support" <dxspider-support@tobit.co.uk><br/>
<b>An:</b> "The DXSpider Support list" <dxspider-support@tobit.co.uk><br/>
<b>Cc:</b> "James Snider" <jim@lexiann.com><br/>
<b>Betreff:</b> Re: [Dxspider-support] cluster quit running</div>
<div name="quoted-content">
<div>OK, I did a
<div>sudo apt-get clean and opened up some space</div>
<div> </div>
<div>
<div>pi@raspberrypi:/spider/perl $ df</div>
<div>Filesystem 1K-blocks Used Available Use% Mounted on</div>
<div>/dev/root 8191416 7687128 68476 100% /</div>
<div>devtmpfs 469544 0 469544 0% /dev</div>
<div>tmpfs 474152 0 474152 0% /dev/shm</div>
<div>tmpfs 474152 47904 426248 11% /run</div>
<div>tmpfs 5120 4 5116 1% /run/lock</div>
<div>tmpfs 474152 0 474152 0% /sys/fs/cgroup</div>
<div>/dev/mmcblk0p1 42702 23054 19648 54% /boot</div>
<div>tmpfs 94828 0 94828 0% /run/user/1000</div>
<div> </div>
<div> </div>
<div>How do I look over in /dev/root and clean up more junk?</div>
<div> </div>
<div>ps. dx spider came up and is running again.</div>
<div> </div>
<div> </div>
<div>Jim W8BS</div>
<div> </div>
<div>
<div>James Snider</div>
<div><a href="mailto:jim@lexiann.com" onclick="parent.window.location.href='mailto:jim@lexiann.com'; return false;" target="_blank">jim@lexiann.com</a></div>
<div> </div>
</div>
<div>
<blockquote>
<div>On Apr 27, 2021, at 8:07 PM, James Snider via Dxspider-support <<a href="mailto:dxspider-support@tobit.co.uk" onclick="parent.window.location.href='mailto:dxspider-support@tobit.co.uk'; return false;" target="_blank">dxspider-support@tobit.co.uk</a>> wrote:</div>
<div>
<div>Well tried some other things tonight when I got in. So if I do a df, here’s what I get
<div> </div>
<div>
<div>pi@raspberrypi:~ $ df</div>
<div>Filesystem 1K-blocks Used Available Use% Mounted on</div>
<div>/dev/root 8191416 8175032 0 100% /</div>
<div>devtmpfs 469544 0 469544 0% /dev</div>
<div>tmpfs 474152 0 474152 0% /dev/shm</div>
<div>tmpfs 474152 47860 426292 11% /run</div>
<div>tmpfs 5120 4 5116 1% /run/lock</div>
<div>tmpfs 474152 0 474152 0% /sys/fs/cgroup</div>
<div>/dev/mmcblk0p1 42702 23054 19648 54% /boot</div>
<div>tmpfs 94828 0 94828 0% /run/user/1000</div>
<div>pi@raspberrypi:~ $ </div>
<div> </div>
<div>So I tried to update my spider stuff, here’s the response</div>
<div> </div>
<div>
<div>pi@raspberrypi:/spider $ sudo git reset --hard</div>
<div>fatal: Could not write new index file.</div>
<div>pi@raspberrypi:/spider $ </div>
</div>
<div> </div>
<div>Interesting. So I tried to update the pi system, here’s the text</div>
<div> </div>
<div>
<div>pi@raspberrypi:~ $ sudo apt update</div>
<div>Hit:1 <a href="http://archive.raspberrypi.org/debian" target="_blank">http://archive.raspberrypi.org/debian</a> stretch InRelease</div>
<div>Err:1 <a href="http://archive.raspberrypi.org/debian" target="_blank">http://archive.raspberrypi.org/debian</a> stretch InRelease</div>
<div> Splitting up /var/lib/apt/lists/archive.raspberrypi.org_debian_dists_stretch_InRelease into data and signature failed</div>
<div>Get:2 <a href="http://raspbian.raspberrypi.org/raspbian" target="_blank">http://raspbian.raspberrypi.org/raspbian</a> stretch InRelease [15.0 kB]</div>
<div>Ign:2 <a href="http://raspbian.raspberrypi.org/raspbian" target="_blank">http://raspbian.raspberrypi.org/raspbian</a> stretch InRelease</div>
<div>Get:3 <a href="http://raspbian.raspberrypi.org/raspbian" target="_blank">http://raspbian.raspberrypi.org/raspbian</a> stretch Release [14.4 kB]</div>
<div>Err:3 <a href="http://raspbian.raspberrypi.org/raspbian" target="_blank">http://raspbian.raspberrypi.org/raspbian</a> stretch Release</div>
<div> Error writing to output file - write (28: No space left on device) Error writing to file - write (28: No space left on device) [IP: 93.93.128.193 80]</div>
<div>Reading package lists... Error!</div>
<div>W: An error occurred during the signature verification. The repository is not updated and the previous index files will be used. GPG error: <a href="http://archive.raspberrypi.org/debian" target="_blank">http://archive.raspberrypi.org/debian</a> stretch InRelease: Splitting up /var/lib/apt/lists/archive.raspberrypi.org_debian_dists_stretch_InRelease into data and signature failed</div>
<div>E: The repository '<a href="http://raspbian.raspberrypi.org/raspbian%20stretch%20Release" target="_blank">http://raspbian.raspberrypi.org/raspbian stretch Release</a>' does no longer have a Release file.</div>
<div>N: Updating from such a repository can't be done securely, and is therefore disabled by default.</div>
<div>N: See apt-secure(8) manpage for repository creation and user configuration details.</div>
<div>E: Write error - write (28: No space left on device)</div>
<div>E: IO Error saving source cache</div>
<div>E: The package lists or status file could not be parsed or opened.</div>
<div>pi@raspberrypi:~ $ </div>
</div>
<div> </div>
<div> </div>
<div>So anyone know where I need to look now?</div>
<div> </div>
<div> </div>
<div>Thanks</div>
<div> </div>
<div>Jim W8BS</div>
<div> </div>
<div>
<div>James Snider</div>
<div><a href="mailto:jim@lexiann.com" onclick="parent.window.location.href='mailto:jim@lexiann.com'; return false;" target="_blank">jim@lexiann.com</a></div>
<div> </div>
</div>
<div>
<blockquote>
<div>On Apr 26, 2021, at 8:56 PM, James Snider via Dxspider-support <<a href="mailto:dxspider-support@tobit.co.uk" onclick="parent.window.location.href='mailto:dxspider-support@tobit.co.uk'; return false;" target="_blank">dxspider-support@tobit.co.uk</a>> wrote:</div>
<div>
<div>Well I finally got back to the hotel. I stopped the dxspider service and tried to start the cluster from my terminal. Here’s all it is doing:
<div> </div>
<div> </div>
<div>
<div>$ ./cluster.pl</div>
<div>(*) Perl path: .:/spider/local:/spider/perl:/spider/perl5lib:/spider/perl5lib/lib/perl5/5.24.1/arm-linux-gnueabihf-thread-multi-64int:/spider/perl5lib/lib/perl5/5.24.1:/spider/perl5lib/lib/perl5/arm-linux-gnueabihf-thread-multi-64int:/spider/perl5lib/lib/perl5:/etc/perl:/usr/local/lib/arm-linux-gnueabihf/perl/5.24.1:/usr/local/share/perl/5.24.1:/usr/lib/arm-linux-gnueabihf/perl5/5.24:/usr/share/perl5:/usr/lib/arm-linux-gnueabihf/perl/5.24:/usr/share/perl/5.24:/usr/local/lib/site_perl:/usr/lib/arm-linux-gnueabihf/perl-base</div>
<div>(*) DXSpider V1.57, build 344 (git: mojo/5bbe803f[r]) started</div>
<div>(*) Copyright (c) 1998-2021 Dirk Koopman G1TLH</div>
<div>(*) loading prefixes ...</div>
<div>(*) US Database loaded</div>
<div> </div>
<div> </div>
<div> </div>
<div>Jim W8BS</div>
<div> </div>
<div> </div>
<div>
<div>James Snider</div>
<div><a href="mailto:jim@lexiann.com" onclick="parent.window.location.href='mailto:jim@lexiann.com'; return false;" target="_blank">jim@lexiann.com</a></div>
<div> </div>
</div>
<div>
<blockquote>
<div>On Apr 26, 2021, at 11:02 AM, jim <a href="http://lexiann.com/" target="_blank">lexiann.com</a> via Dxspider-support <<a href="mailto:dxspider-support@tobit.co.uk" onclick="parent.window.location.href='mailto:dxspider-support@tobit.co.uk'; return false;" target="_blank">dxspider-support@tobit.co.uk</a>> wrote:</div>
<div>
<div style="font-style: normal;font-weight: normal;letter-spacing: normal;text-indent: 0.0px;text-transform: none;white-space: normal;word-spacing: 0.0px;text-decoration: none;font-family: Calibri , Arial , Helvetica , sans-serif;font-size: 12.0pt;">Disk space is fine. I'm running it on a 1 TB USB drive. DX Spider is the only thing running on this Pi.</div>
<div style="font-style: normal;font-weight: normal;letter-spacing: normal;text-indent: 0.0px;text-transform: none;white-space: normal;word-spacing: 0.0px;text-decoration: none;font-family: Calibri , Arial , Helvetica , sans-serif;font-size: 12.0pt;"> </div>
<div style="font-style: normal;font-weight: normal;letter-spacing: normal;text-indent: 0.0px;text-transform: none;white-space: normal;word-spacing: 0.0px;text-decoration: none;font-family: Calibri , Arial , Helvetica , sans-serif;font-size: 12.0pt;">I'll pull some of the logs tonight when I get back to the hotel and see what clues they may show.</div>
<div style="font-style: normal;font-weight: normal;letter-spacing: normal;text-indent: 0.0px;text-transform: none;white-space: normal;word-spacing: 0.0px;text-decoration: none;font-family: Calibri , Arial , Helvetica , sans-serif;font-size: 12.0pt;"> </div>
<div style="font-style: normal;font-weight: normal;letter-spacing: normal;text-indent: 0.0px;text-transform: none;white-space: normal;word-spacing: 0.0px;text-decoration: none;font-family: Calibri , Arial , Helvetica , sans-serif;font-size: 12.0pt;"> </div>
<div style="font-style: normal;font-weight: normal;letter-spacing: normal;text-indent: 0.0px;text-transform: none;white-space: normal;word-spacing: 0.0px;text-decoration: none;font-family: Calibri , Arial , Helvetica , sans-serif;font-size: 12.0pt;">Jim W8BS</div>
<div id="appendonsend" style="font-family: Helvetica;font-size: 12.0px;font-style: normal;font-weight: normal;letter-spacing: normal;text-indent: 0.0px;text-transform: none;white-space: normal;word-spacing: 0.0px;text-decoration: none;"> </div>
<hr style="font-family: Helvetica;font-size: 12.0px;font-style: normal;font-weight: normal;letter-spacing: normal;text-indent: 0.0px;text-transform: none;white-space: normal;word-spacing: 0.0px;text-decoration: none;display: inline-block;width: 469.40625px;"/>
<div id="divRplyFwdMsg" style="font-family: Helvetica;font-size: 12.0px;font-style: normal;font-weight: normal;letter-spacing: normal;text-indent: 0.0px;text-transform: none;white-space: normal;word-spacing: 0.0px;text-decoration: none;"><font face="Calibri, sans-serif" style="font-size: 11.0pt;"><b>From:</b><span class="Apple-converted-space"> </span>Dxspider-support <<a href="mailto:dxspider-support-bounces@tobit.co.uk" onclick="parent.window.location.href='mailto:dxspider-support-bounces@tobit.co.uk'; return false;" target="_blank">dxspider-support-bounces@tobit.co.uk</a>> on behalf of Mike McCarthy, W1NR via Dxspider-support <<a href="mailto:dxspider-support@tobit.co.uk" onclick="parent.window.location.href='mailto:dxspider-support@tobit.co.uk'; return false;" target="_blank">dxspider-support@tobit.co.uk</a>><br/>
<b>Sent:</b><span class="Apple-converted-space"> </span>Monday, April 26, 2021 7:21 AM<br/>
<b>To:</b><span class="Apple-converted-space"> </span><a href="mailto:dxspider-support@tobit.co.uk" onclick="parent.window.location.href='mailto:dxspider-support@tobit.co.uk'; return false;" target="_blank">dxspider-support@tobit.co.uk</a> <<a href="mailto:dxspider-support@tobit.co.uk" onclick="parent.window.location.href='mailto:dxspider-support@tobit.co.uk'; return false;" target="_blank">dxspider-support@tobit.co.uk</a>><br/>
<b>Cc:</b><span class="Apple-converted-space"> </span>Mike McCarthy, W1NR <<a href="mailto:lists@w1nr.net" onclick="parent.window.location.href='mailto:lists@w1nr.net'; return false;" target="_blank">lists@w1nr.net</a>><br/>
<b>Subject:</b><span class="Apple-converted-space"> </span>Re: [Dxspider-support] cluster quit running</font>
<div> </div>
</div>
<div class="BodyFragment" style="font-family: Helvetica;font-size: 12.0px;font-style: normal;font-weight: normal;letter-spacing: normal;text-indent: 0.0px;text-transform: none;white-space: normal;word-spacing: 0.0px;text-decoration: none;">
<div class="PlainText"><font size="2"><span style="font-size: 11.0pt;">Have you checked the most obvious things like running out of disk space<br/>
or are you running this on a flash card and seeing disk i/o or<br/>
filesystem errors on the console?<br/>
<br/>
Mike, W1NR<br/>
<br/>
On 4/25/2021 6:49 PM, James Snider via Dxspider-support wrote:<br/>
> Not sure what happened but my node w8bs has been running for months with no issues and now that I’m out of town working, it’s not running. I restarted it and checked the status and it looks like it’s running but console won’t load. see below<br/>
><span class="Apple-converted-space"> </span><br/>
><span class="Apple-converted-space"> </span><br/>
> Linux raspberrypi 4.19.66-v7+ #1253 SMP Thu Aug 15 11:49:46 BST 2019 armv7l<br/>
><span class="Apple-converted-space"> </span><br/>
> The programs included with the Debian GNU/Linux system are free software;<br/>
> the exact distribution terms for each program are described in the<br/>
> individual files in /usr/share/doc/*/copyright.<br/>
><span class="Apple-converted-space"> </span><br/>
> Debian GNU/Linux comes with ABSOLUTELY NO WARRANTY, to the extent<br/>
> permitted by applicable law.<br/>
> Last login: Sun Apr 25 18:44:06 2021<br/>
> pi@raspberrypi:~ $ /etc/init.d/dxspider status<br/>
> ● dxspider.service - DXSpider DX Cluster node<br/>
> Loaded: loaded (/etc/systemd/system/dxspider.service; enabled; vendor preset: enabled)<br/>
> Active: active (running) since Sun 2021-04-25 18:44:01 EDT; 1min 32s ago<br/>
> Main PID: 491 (perl)<br/>
> CGroup: /system.slice/dxspider.service<br/>
> └─491 perl /spider/perl/cluster.pl > /dev/null<br/>
><span class="Apple-converted-space"> </span><br/>
> Apr 25 18:44:01 raspberrypi systemd[1]: Started DXSpider DX Cluster node.<br/>
> pi@raspberrypi:~ $ /spider/perl/console.pl<br/>
> pi@raspberrypi:~ $<span class="Apple-converted-space"> </span><br/>
><span class="Apple-converted-space"> </span><br/>
><span class="Apple-converted-space"> </span><br/>
><span class="Apple-converted-space"> </span><br/>
> Jim W8BS<br/>
><span class="Apple-converted-space"> </span><br/>
> James Snider<br/>
> <a href="mailto:jim@lexiann.com" onclick="parent.window.location.href='mailto:jim@lexiann.com'; return false;" target="_blank">jim@lexiann.com</a><br/>
><span class="Apple-converted-space"> </span><br/>
><span class="Apple-converted-space"> </span><br/>
><span class="Apple-converted-space"> </span><br/>
><span class="Apple-converted-space"> </span><br/>
> _______________________________________________<br/>
> Dxspider-support mailing list<br/>
> <a href="mailto:Dxspider-support@tobit.co.uk" onclick="parent.window.location.href='mailto:Dxspider-support@tobit.co.uk'; return false;" target="_blank">Dxspider-support@tobit.co.uk</a><br/>
><span class="Apple-converted-space"> </span><a href="https://mailman.tobit.co.uk/mailman/listinfo/dxspider-support" target="_blank">https://mailman.tobit.co.uk/mailman/listinfo/dxspider-support</a><br/>
><span class="Apple-converted-space"> </span><br/>
<br/>
_______________________________________________<br/>
Dxspider-support mailing list<br/>
<a href="mailto:Dxspider-support@tobit.co.uk" onclick="parent.window.location.href='mailto:Dxspider-support@tobit.co.uk'; return false;" target="_blank">Dxspider-support@tobit.co.uk</a><br/>
<a href="https://mailman.tobit.co.uk/mailman/listinfo/dxspider-support" target="_blank">https://mailman.tobit.co.uk/mailman/listinfo/dxspider-support</a></span></font></div>
</div>
<span style="font-family: Helvetica;font-size: 12.0px;font-style: normal;font-weight: normal;letter-spacing: normal;text-indent: 0.0px;text-transform: none;white-space: normal;word-spacing: 0.0px;text-decoration: none;float: none;display: inline;">_______________________________________________</span><br style="font-family: Helvetica;font-size: 12.0px;font-style: normal;font-weight: normal;letter-spacing: normal;text-indent: 0.0px;text-transform: none;white-space: normal;word-spacing: 0.0px;text-decoration: none;"/>
<span style="font-family: Helvetica;font-size: 12.0px;font-style: normal;font-weight: normal;letter-spacing: normal;text-indent: 0.0px;text-transform: none;white-space: normal;word-spacing: 0.0px;text-decoration: none;float: none;display: inline;">Dxspider-support mailing list</span><br style="font-family: Helvetica;font-size: 12.0px;font-style: normal;font-weight: normal;letter-spacing: normal;text-indent: 0.0px;text-transform: none;white-space: normal;word-spacing: 0.0px;text-decoration: none;"/>
<a href="mailto:Dxspider-support@tobit.co.uk" onclick="parent.window.location.href='mailto:Dxspider-support@tobit.co.uk'; return false;" style="font-family: Helvetica;font-size: 12.0px;font-style: normal;font-weight: normal;letter-spacing: normal;text-indent: 0.0px;text-transform: none;white-space: normal;word-spacing: 0.0px;" target="_blank">Dxspider-support@tobit.co.uk</a><br style="font-family: Helvetica;font-size: 12.0px;font-style: normal;font-weight: normal;letter-spacing: normal;text-indent: 0.0px;text-transform: none;white-space: normal;word-spacing: 0.0px;text-decoration: none;"/>
<a href="https://mailman.tobit.co.uk/mailman/listinfo/dxspider-support" style="font-family: Helvetica;font-size: 12.0px;font-style: normal;font-weight: normal;letter-spacing: normal;text-indent: 0.0px;text-transform: none;white-space: normal;word-spacing: 0.0px;" target="_blank">https://mailman.tobit.co.uk/mailman/listinfo/dxspider-support</a></div>
</blockquote>
</div>
</div>
</div>
_______________________________________________<br/>
Dxspider-support mailing list<br/>
<a href="mailto:Dxspider-support@tobit.co.uk" onclick="parent.window.location.href='mailto:Dxspider-support@tobit.co.uk'; return false;" target="_blank">Dxspider-support@tobit.co.uk</a><br/>
<a href="https://mailman.tobit.co.uk/mailman/listinfo/dxspider-support" target="_blank">https://mailman.tobit.co.uk/mailman/listinfo/dxspider-support</a></div>
</blockquote>
</div>
</div>
</div>
_______________________________________________<br/>
Dxspider-support mailing list<br/>
<a href="mailto:Dxspider-support@tobit.co.uk" onclick="parent.window.location.href='mailto:Dxspider-support@tobit.co.uk'; return false;" target="_blank">Dxspider-support@tobit.co.uk</a><br/>
<a href="https://mailman.tobit.co.uk/mailman/listinfo/dxspider-support" target="_blank">https://mailman.tobit.co.uk/mailman/listinfo/dxspider-support</a></div>
</blockquote>
</div>
</div>
_______________________________________________ Dxspider-support mailing list Dxspider-support@tobit.co.uk <a href="https://mailman.tobit.co.uk/mailman/listinfo/dxspider-support" target="_blank">https://mailman.tobit.co.uk/mailman/listinfo/dxspider-support</a></div>
</div>
</div>
</div>
</div></div></body></html>