<div dir="ltr">Dirk,<div><br></div><div>Please forgive my ignorance but I have noticed a file called <a href="http://create_master_badip_files.pl">create_master_badip_files.pl</a> in spider/perl. </div><div><br></div><div>The comments in it seem to suggest it is doing what the download commands you </div><div>propose for crontab do. It however does not seem to be in use, at least not on my installation.</div><div>Is it obsolete?</div><div><br></div><div>What are the "conversion programs" you are referring to in your post? Is there a special command to be added </div><div>to the local crontab to add the downloaded data to badip.local? Or am I just misunderstanding? </div><div><br></div><div>Björn SM7IUN</div><div><br></div><div><br></div><div><br></div><div><br></div><div><br></div><div><br></div></div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Sun, Mar 12, 2023 at 12:06 AM Dirk Koopman via Dxspider-support <<a href="mailto:dxspider-support@tobit.co.uk">dxspider-support@tobit.co.uk</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex">
<div>
<div><font size="4">I should add: the
'download' is non-blocking. As you can see in the example below
they run in parallel:<br>
</font><br>
<font face="monospace">11Mar2023@20:24:00 (cron) cron: UTC 24 20
11 3 6 -> doing 'run_cmd('download
<a href="http://www.dxspider.net/download/badip.torexit" target="_blank">http://www.dxspider.net/download/badip.torexit</a>')'<br>
11Mar2023@20:24:00 (cron) DXCron::run_cmd: download
<a href="http://www.dxspider.net/download/badip.torexit" target="_blank">http://www.dxspider.net/download/badip.torexit</a><br>
11Mar2023@20:24:00 (*) download: url
<a href="http://www.dxspider.net/download/badip.torexit" target="_blank">http://www.dxspider.net/download/badip.torexit</a><br>
11Mar2023@20:24:00 (progress) CMD: 'download
<a href="http://www.dxspider.net/download/badip.torexit" target="_blank">http://www.dxspider.net/download/badip.torexit</a>' by GB7TLH ip:
127.0.0.1 2mS<br>
11Mar2023@20:24:00 (cron) cron: UTC 24 20 11 3 6 -> doing
'run_cmd('download
<a href="http://www.dxspider.net/download/badip.torrelay" target="_blank">http://www.dxspider.net/download/badip.torrelay</a>')'<br>
11Mar2023@20:24:00 (cron) DXCron::run_cmd: download
<a href="http://www.dxspider.net/download/badip.torrelay" target="_blank">http://www.dxspider.net/download/badip.torrelay</a><br>
11Mar2023@20:24:00 (*) download: url
<a href="http://www.dxspider.net/download/badip.torrelay" target="_blank">http://www.dxspider.net/download/badip.torrelay</a><br>
11Mar2023@20:24:00 (progress) CMD: 'download
<a href="http://www.dxspider.net/download/badip.torrelay" target="_blank">http://www.dxspider.net/download/badip.torrelay</a>' by GB7TLH ip:
127.0.0.1 1mS<br>
11Mar2023@20:24:00 (cron) cron: UTC 24 20 11 3 6 -> doing
'run_cmd('download
<a href="http://www.dxspider.net/download/badip.global" target="_blank">http://www.dxspider.net/download/badip.global</a>')'<br>
11Mar2023@20:24:00 (cron) DXCron::run_cmd: download
<a href="http://www.dxspider.net/download/badip.global" target="_blank">http://www.dxspider.net/download/badip.global</a><br>
11Mar2023@20:24:00 (*) download: url
<a href="http://www.dxspider.net/download/badip.global" target="_blank">http://www.dxspider.net/download/badip.global</a><br>
11Mar2023@20:24:00 (progress) CMD: 'download
<a href="http://www.dxspider.net/download/badip.global" target="_blank">http://www.dxspider.net/download/badip.global</a>' by GB7TLH ip:
127.0.0.1 1mS<br>
11Mar2023@20:24:00 (progress) download:
/spider/local_data/badip.global successfully downloaded<br>
11Mar2023@20:24:00 (progress) download:
/spider/local_data/badip.torexit successfully downloaded<br>
11Mar2023@20:24:00 (progress) download:
/spider/local_data/badip.torrelay successfully downloaded<br>
</font><br>
<font size="4">Given that sysops are successfully running the mojo
branch on Windows (apart from spawning commands), I believe this
will work identically there as well.</font><br>
<br>
On 11/03/2023 22:54, Dirk Koopman via Dxspider-support wrote:<br>
</div>
<blockquote type="cite">
<font size="4">I have just pushed new DXSpider command 'download',
it is a bit experimental, but I have been using it successfully
in a few places. There may be additional facilities added to it
based on demand. Here is what the Changes file says (can't be
bothered to type it all out again):<br>
<font face="monospace"><br>
1. I am aware that there are windows nodes out there on mojo
(brave, impetuous <br>
that you are) and wget is not an easy option to download
badip files. So, <br>
through the power of mojo I give you the new 'download'
command. As it <br>
stands at the moment, it will download a file from a
webserver and place<br>
it in /spider/local_data. If it downloads successfully, it
will overwrite<br>
any file with that name in /spider/local_data. Needless to
say this is a <br>
sysop only command. <br>
<br>
24 * * * * run_cmd('download <a href="http://www.dxspider.net/download/badip.torexit" target="_blank">http://www.dxspider.net/download/badip.torexit</a>')<br>
24 * * * * run_cmd('download <a href="http://www.dxspider.net/download/badip.torrelay" target="_blank">http://www.dxspider.net/download/badip.torrelay</a>')<br>
24 * * * * run_cmd('download <a href="http://www.dxspider.net/download/badip.global" target="_blank">http://www.dxspider.net/download/badip.global</a>')<br>
25 * * * * run_cmd('load/badip')<br>
<br>
would be an obvious use. But it can also be used to
download spot, USDB <br>
and other data as well. If you do use it then you will
still need to <br>
do a spawn_cmd in crontab for the conversion programs, but
that too is <br>
going to change.<br>
</font><br>
You don't need to restart, everything it does is in the command.
<br>
<br>
Enjoy<br>
<br>
Dirk G1TLH<br>
</font> <br>
<fieldset></fieldset>
<pre>_______________________________________________
Dxspider-support mailing list
<a href="mailto:Dxspider-support@tobit.co.uk" target="_blank">Dxspider-support@tobit.co.uk</a>
<a href="https://mailman.tobit.co.uk/mailman/listinfo/dxspider-support" target="_blank">https://mailman.tobit.co.uk/mailman/listinfo/dxspider-support</a>
</pre>
</blockquote>
<br>
</div>
_______________________________________________<br>
Dxspider-support mailing list<br>
<a href="mailto:Dxspider-support@tobit.co.uk" target="_blank">Dxspider-support@tobit.co.uk</a><br>
<a href="https://mailman.tobit.co.uk/mailman/listinfo/dxspider-support" rel="noreferrer" target="_blank">https://mailman.tobit.co.uk/mailman/listinfo/dxspider-support</a><br>
</blockquote></div>