<div dir="ltr">Thanks Dirk, much appreciated.<div><br></div><div>Björn SM7IUN</div></div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Sun, Mar 12, 2023 at 10:57 PM Dirk Koopman <<a href="mailto:djk@tobit.co.uk">djk@tobit.co.uk</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex">
<div>
<div>Create_master_badip_file.pl is the
program I use to obtain the date to create the badip.torexit and
.torrelay files. The site from which this data is derived requests
that large numbers of people to do not connect to the site for
bandwidth (and I suspect cost) reasons. They suggest that we do as
we are and have a few sites that obtain, process and then
distribute the result to our community. <br>
<br>
One of the things I need to sort out are 2-4 backup sites that can
that program and then redistribute it (independently) from GB7DJK,
via a web download site. I am getting to an age where I could,
after all, drop dead tomorrow or be run over by a bus. <br>
<br>
I also have to devise a system to merge badip.local files into one
or more copies of badip.global, so that that too can be managed by
the community rather than just me. I feel an 'upload' command
coming on :-)<br>
<br>
But it appears I have still got some more firefighting to do
first...<br>
<br>
73 Dirk G1TLH<br>
<br>
On 12/03/2023 16:58, Björn Ekelund wrote:<br>
</div>
<blockquote type="cite">
<div dir="ltr">Dirk,
<div><br>
</div>
<div>Please forgive my ignorance but I have noticed a file
called <a href="http://create_master_badip_files.pl" target="_blank">create_master_badip_files.pl</a> in
spider/perl. </div>
<div><br>
</div>
<div>The comments in it seem to suggest it is doing what the
download commands you </div>
<div>propose for crontab do. It however does not seem to be in
use, at least not on my installation.</div>
<div>Is it obsolete?</div>
<div><br>
</div>
<div>What are the "conversion programs" you are referring to in
your post? Is there a special command to be added </div>
<div>to the local crontab to add the downloaded data to
badip.local? Or am I just misunderstanding? </div>
<div><br>
</div>
<div>Björn SM7IUN</div>
<div><br>
</div>
<div><br>
</div>
<div><br>
</div>
<div><br>
</div>
<div><br>
</div>
<div><br>
</div>
</div>
<br>
<div class="gmail_quote">
<div dir="ltr" class="gmail_attr">On Sun, Mar 12, 2023 at
12:06 AM Dirk Koopman via Dxspider-support <<a href="mailto:dxspider-support@tobit.co.uk" target="_blank">dxspider-support@tobit.co.uk</a>>
wrote:<br>
</div>
<blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex">
<div>
<div><font size="4">I should add: the 'download' is
non-blocking. As you can see in the example below they
run in parallel:<br>
</font><br>
<font face="monospace">11Mar2023@20:24:00 (cron) cron: UTC
24 20 11 3 6 -> doing 'run_cmd('download <a href="http://www.dxspider.net/download/badip.torexit" target="_blank">http://www.dxspider.net/download/badip.torexit</a>')'<br>
11Mar2023@20:24:00 (cron) DXCron::run_cmd: download <a href="http://www.dxspider.net/download/badip.torexit" target="_blank">http://www.dxspider.net/download/badip.torexit</a><br>
11Mar2023@20:24:00 (*) download: url <a href="http://www.dxspider.net/download/badip.torexit" target="_blank">http://www.dxspider.net/download/badip.torexit</a><br>
11Mar2023@20:24:00 (progress) CMD: 'download <a href="http://www.dxspider.net/download/badip.torexit" target="_blank">http://www.dxspider.net/download/badip.torexit</a>'
by GB7TLH ip: 127.0.0.1 2mS<br>
11Mar2023@20:24:00 (cron) cron: UTC 24 20 11 3 6 ->
doing 'run_cmd('download <a href="http://www.dxspider.net/download/badip.torrelay" target="_blank">http://www.dxspider.net/download/badip.torrelay</a>')'<br>
11Mar2023@20:24:00 (cron) DXCron::run_cmd: download <a href="http://www.dxspider.net/download/badip.torrelay" target="_blank">http://www.dxspider.net/download/badip.torrelay</a><br>
11Mar2023@20:24:00 (*) download: url <a href="http://www.dxspider.net/download/badip.torrelay" target="_blank">http://www.dxspider.net/download/badip.torrelay</a><br>
11Mar2023@20:24:00 (progress) CMD: 'download <a href="http://www.dxspider.net/download/badip.torrelay" target="_blank">http://www.dxspider.net/download/badip.torrelay</a>'
by GB7TLH ip: 127.0.0.1 1mS<br>
11Mar2023@20:24:00 (cron) cron: UTC 24 20 11 3 6 ->
doing 'run_cmd('download <a href="http://www.dxspider.net/download/badip.global" target="_blank">http://www.dxspider.net/download/badip.global</a>')'<br>
11Mar2023@20:24:00 (cron) DXCron::run_cmd: download <a href="http://www.dxspider.net/download/badip.global" target="_blank">http://www.dxspider.net/download/badip.global</a><br>
11Mar2023@20:24:00 (*) download: url <a href="http://www.dxspider.net/download/badip.global" target="_blank">http://www.dxspider.net/download/badip.global</a><br>
11Mar2023@20:24:00 (progress) CMD: 'download <a href="http://www.dxspider.net/download/badip.global" target="_blank">http://www.dxspider.net/download/badip.global</a>'
by GB7TLH ip: 127.0.0.1 1mS<br>
11Mar2023@20:24:00 (progress) download:
/spider/local_data/badip.global successfully downloaded<br>
11Mar2023@20:24:00 (progress) download:
/spider/local_data/badip.torexit successfully downloaded<br>
11Mar2023@20:24:00 (progress) download:
/spider/local_data/badip.torrelay successfully
downloaded<br>
</font><br>
<font size="4">Given that sysops are successfully running
the mojo branch on Windows (apart from spawning
commands), I believe this will work identically there as
well.</font><br>
<br>
On 11/03/2023 22:54, Dirk Koopman via Dxspider-support
wrote:<br>
</div>
<blockquote type="cite"> <font size="4">I have just pushed
new DXSpider command 'download', it is a bit
experimental, but I have been using it successfully in a
few places. There may be additional facilities added to
it based on demand. Here is what the Changes file says
(can't be bothered to type it all out again):<br>
<font face="monospace"><br>
1. I am aware that there are windows nodes out there
on mojo (brave, impetuous <br>
that you are) and wget is not an easy option to
download badip files. So, <br>
through the power of mojo I give you the new
'download' command. As it <br>
stands at the moment, it will download a file from
a webserver and place<br>
it in /spider/local_data. If it downloads
successfully, it will overwrite<br>
any file with that name in /spider/local_data.
Needless to say this is a <br>
sysop only command. <br>
<br>
24 * * * * run_cmd('download <a href="http://www.dxspider.net/download/badip.torexit" target="_blank">http://www.dxspider.net/download/badip.torexit</a>')<br>
24 * * * * run_cmd('download <a href="http://www.dxspider.net/download/badip.torrelay" target="_blank">http://www.dxspider.net/download/badip.torrelay</a>')<br>
24 * * * * run_cmd('download <a href="http://www.dxspider.net/download/badip.global" target="_blank">http://www.dxspider.net/download/badip.global</a>')<br>
25 * * * * run_cmd('load/badip')<br>
<br>
would be an obvious use. But it can also be used to
download spot, USDB <br>
and other data as well. If you do use it then you
will still need to <br>
do a spawn_cmd in crontab for the conversion
programs, but that too is <br>
going to change.<br>
</font><br>
You don't need to restart, everything it does is in the
command. <br>
<br>
Enjoy<br>
<br>
Dirk G1TLH<br>
</font> <br>
<fieldset></fieldset>
<pre>_______________________________________________
Dxspider-support mailing list
<a href="mailto:Dxspider-support@tobit.co.uk" target="_blank">Dxspider-support@tobit.co.uk</a>
<a href="https://mailman.tobit.co.uk/mailman/listinfo/dxspider-support" target="_blank">https://mailman.tobit.co.uk/mailman/listinfo/dxspider-support</a>
</pre>
</blockquote>
<br>
</div>
_______________________________________________<br>
Dxspider-support mailing list<br>
<a href="mailto:Dxspider-support@tobit.co.uk" target="_blank">Dxspider-support@tobit.co.uk</a><br>
<a href="https://mailman.tobit.co.uk/mailman/listinfo/dxspider-support" rel="noreferrer" target="_blank">https://mailman.tobit.co.uk/mailman/listinfo/dxspider-support</a><br>
</blockquote>
</div>
</blockquote>
<br>
</div>
</blockquote></div>