[Dxspider-support] crontab 'spawn' command will kick all connected users and nodes
David Spoelstra
davids at mediamachine.com
Sat Apr 10 01:27:55 CEST 2021
Joseph-
You may be right. I have very little Perl knowledge.
-David, N9KT
On Fri, Apr 9, 2021 at 7:01 PM JOSEPH REED <joe at n9jr.com> wrote:
> I don’t see it. I was waiting for today when my crontab triggered the
> update and no users or nodes were disconnected and it updated just fine
> like should. My Perl is weak to non existent but the if(!$pid) block looks
> like an exception handler to me.
>
> It works perfect on 1.57 Build 344.
>
> Those with more Perl knowledge can correct me, but it looks like it is
> doing as expected.
>
> Joe N9JR
>
>
>
> On Apr 8, 2021, at 8:42 AM, David Spoelstra via Dxspider-support <
> dxspider-support at tobit.co.uk> wrote:
>
> Saki-
> You are correct! Good catch! I dug into the "spawn" code in DXCron.pm
> (below) and I see that "spawn" does a "DXChannel::closeall();". I don't
> know why, but Dirk must have decided it was needed.
> -David, N9KT
>
> # spawn any old job off
> sub spawn
> {
> my $line = shift;
>
> my $pid = fork();
> if (defined $pid) {
> if (!$pid) {
> # in child, unset warnings, disable debugging and
> general clean up from us
> $^W = 0;
> eval "{ package DB; sub DB {} }";
> DXChannel::closeall();
> for (@main::listeners) {
> $_->close_server;
> }
> unless ($main::is_win) {
> $SIG{HUP} = 'IGNORE';
> $SIG{CHLD} = $SIG{TERM} = $SIG{INT} =
> $SIG{__WARN__} = 'DEFAULT';
> alarm(0);
> }
> exec "$line" or dbg("exec '$line' failed $!") if
> isdbg('cron');
> }
> dbg("spawn of $line started") if isdbg('cron');
> } else {
> dbg("can't fork for $line $!") if isdbg('cron');
> }
>
> # coordinate
> sleep(1);
> }
>
> On Thu, Apr 8, 2021 at 3:32 AM dd5xx--- via Dxspider-support <
> dxspider-support at tobit.co.uk> wrote:
>
>> Hi David et all,
>>
>> thanks for sharing your local crontab script. I have implemented my
>> updates via my own bash script, independent of DXspider. I actually do the
>> exact same thing, however the DXspider process doesn't get anything out of
>> it except at the end when I run the load/prefix.
>>
>> I like to think outside the box and have also tried it via Spiders' local
>> crontab as you suggested. However, while following along using 'watchdbg'
>> and 'set/debug cron', I noticed that *EVERY* 'spawn' command in the crontab
>> causes all connected users and nodes to be disconnected! In the watchdbg
>> output window it looks like this:
>>
>> 06:59:01 DXCommand
>> 06:59:01 DL1ABC disconnected
>> 06:59:01 DXCommand
>> 06:59:01 DL2ABC-5 disconnected
>> 06:59:01 DXCommand
>> 06:59:01 DL3ABC disconnected
>> 06:59:01 DXCommand
>> 06:59:35 DXCommand
>> 06:59:35 DL1ABC connected from 111.222.33.44
>>
>> The documentation for DXspider crontab <
>> http://www.dxcluster.org/main/cron.html> unfortunately does not give a
>> more detailed information.
>>
>> [...]
>> spawn(<command>) - start a <command> as a new process. This is used to do
>> various batch jobs that you may wish to happen at certain times of the day
>> or week that operate on your machine but don't require access to the
>> real-time internals of the cluster daemon. You can execute just about any
>> command you like, but be warned stdin and stdout are still connected to the
>> same terminal (if any) as the cluster daemon. Any unix command and
>> arguments can be used, see exec in the perl documentation.
>> [...]
>>
>> For my needs the spawn event and the resulted disconnects for users/nodes
>> is a no-go as I don't want my connected users+nodes to be disconnected. So
>> I will continue to use my own external bash script for the cty.dat and
>> wpxloc.raw updates as usual.
>>
>> ==> Nevertheless, I'm curious if this is also the case for you, that the
>> currently connected users+nodes are disconnected at the spawn command ?
>> Looking forward to hear some comments.
>>
>> I want to add that I do not use Mojo but still (consciously) running
>> version 1.55
>>
>> 73
>> Saki, DD5XX
>>
>>
>> *Gesendet:* Donnerstag, 04. März 2021 um 04:14 Uhr
>> *Von:* "David Spoelstra via Dxspider-support" <
>> dxspider-support at tobit.co.uk>
>> *An:* "The DXSpider Support list" <dxspider-support at tobit.co.uk>
>> *Cc:* "David Spoelstra" <davids at mediamachine.com>
>> *Betreff:* Re: [Dxspider-support] CTY-3105 Country Files - 03 March 2021
>> OK, found the problem. I was using http vs https when I fetched the file
>> - that made all the difference.
>>
>> If anyone wants to use my DXSpider cron, you are most welcome. Just to
>> make sure everyone understands, you can put a crontab in /spider/local_cmd/
>> and it will run. I put all my DXSpider stuff in there to keep everything
>> dealing with DXSpider in one place.
>>
>> My DXSpider crontab in /spider/local_cmd/:
>>
>> # /spider/local_cmd/crontab
>> # MAKE SURE /spider/cmd_import EXISTS!
>> # min, hour, day-of-month, month, day-of-week (0=Sun)
>> # TIME IS UTC!
>>
>> # Connect to other nodes
>> * * * * * start_connect('w9pa') unless connected('w9pa')
>> * * * * * start_connect('wb3ffv') unless connected('wb3ffv')
>> * * * * * start_connect('ky4xx') unless connected('ky4xx')
>>
>> # Monday 1am local - Get latest FCC data (W1NR updates Sundays)
>> 0 5 * * 1 spawn("cd /tmp && wget -Nq ftp://ftp.w1nr.net/usdbraw.gz &&
>> /spider/perl/create_usdb.pl usdbraw.gz")
>> 2 5 * * 1 run_cmd("load/usdb")
>> 4 5 * * 1 spawn("rm /tmp/usdbraw.gz")
>>
>> # Friday 1am local - Get latest Keps to be ready for any contest
>> 0 5 * * 5 spawn("cd /tmp && wget -Nq
>> https://www.amsat.org/amsat/ftp/keps/current/nasabare.txt &&
>> /spider/perl/convkeps.pl -p nasabare.txt")
>> 2 5 * * 5 run_cmd("load/keps")
>> 4 5 * * 5 spawn("rm /tmp/nasabare.txt")
>>
>> # Friday 1am local - Get latest cty.dat to be ready for any contest
>> 6 5 * * 5 spawn("cd /spider/data && wget -Nq
>> https://www.country-files.com/cty/cty.dat")
>> 8 5 * * 5 spawn("cd /spider/data && wget -Nq
>> https://www.country-files.com/cty/wpxloc.raw")
>> 10 5 * * 5 spawn("cd /spider/data && /spider/perl/create_prefix.pl")
>> 12 5 * * 5 run_cmd("load/prefixes")
>>
>> # Friday 1am local - Update DXSpider to be ready for any contest
>> 14 5 * * 5 spawn("cd /spider && git reset --hard && git pull")
>>
>> -David, N9KT
>> _______________________________________________
>> Dxspider-support mailing list
>> Dxspider-support at tobit.co.uk
>> https://mailman.tobit.co.uk/mailman/listinfo/dxspider-support
>>
> _______________________________________________
> Dxspider-support mailing list
> Dxspider-support at tobit.co.uk
> https://mailman.tobit.co.uk/mailman/listinfo/dxspider-support
>
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://mailman.tobit.co.uk/pipermail/dxspider-support/attachments/20210409/3a194cf7/attachment.htm>
More information about the Dxspider-support
mailing list