<html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=UTF-8">
</head>
<body>
Hello Dirk,<br>
<br>
I am just now trying to catch up on the emails on the list,
catching Covid for sure knocked me down for a few. That said, if I
can help with replication, or distribution of anything that will
help the cluster network just let me know. My server cluster is all
on 10GE links, and sets on multiple 10GE pathways to the network. I
could probably serve the lists to all the clusters every minute 24/7
and laugh while I did it. The WB3FFV-2 node is a VM on my cluster,
and it would be a piece of cake to build a VM we could use to
distribute anything you desire..<br>
<br>
73's de WB3FFV<br>
<br>
<pre class="moz-signature" cols="72">---
Howard Leadmon - <a class="moz-txt-link-abbreviated" href="mailto:howard@leadmon.net">howard@leadmon.net</a>
PBW Communications, LLC
<a class="moz-txt-link-freetext" href="http://www.pbwcomm.com">http://www.pbwcomm.com</a>
</pre>
<div class="moz-cite-prefix">On 3/12/2023 5:55 PM, Dirk Koopman via
Dxspider-support wrote:<br>
</div>
<blockquote type="cite"
cite="mid:f065e33a-928f-ee31-8e52-c1f8c9a502b8@tobit.co.uk">
<meta http-equiv="Content-Type" content="text/html; charset=UTF-8">
<div class="moz-cite-prefix">Create_master_badip_file.pl is the
program I use to obtain the date to create the badip.torexit and
.torrelay files. The site from which this data is derived
requests that large numbers of people to do not connect to the
site for bandwidth (and I suspect cost) reasons. They suggest
that we do as we are and have a few sites that obtain, process
and then distribute the result to our community. <br>
<br>
One of the things I need to sort out are 2-4 backup sites that
can that program and then redistribute it (independently) from
GB7DJK, via a web download site. I am getting to an age where I
could, after all, drop dead tomorrow or be run over by a bus. <br>
<br>
I also have to devise a system to merge badip.local files into
one or more copies of badip.global, so that that too can be
managed by the community rather than just me. I feel an 'upload'
command coming on :-)<br>
<br>
But it appears I have still got some more firefighting to do
first...<br>
<br>
73 Dirk G1TLH<br>
<br>
On 12/03/2023 16:58, Björn Ekelund wrote:<br>
</div>
<blockquote type="cite"
cite="mid:CABmD_KTCN1vmDPuv3rEiYEssE8PQ51RCNzv2XEb9=5gHD3_naA@mail.gmail.com">
<meta http-equiv="content-type" content="text/html;
charset=UTF-8">
<div dir="ltr">Dirk,
<div><br>
</div>
<div>Please forgive my ignorance but I have noticed a file
called <a href="http://create_master_badip_files.pl"
moz-do-not-send="true">create_master_badip_files.pl</a> in
spider/perl. </div>
<div><br>
</div>
<div>The comments in it seem to suggest it is doing what the
download commands you </div>
<div>propose for crontab do. It however does not seem to be in
use, at least not on my installation.</div>
<div>Is it obsolete?</div>
<div><br>
</div>
<div>What are the "conversion programs" you are referring to
in your post? Is there a special command to be added </div>
<div>to the local crontab to add the downloaded data to
badip.local? Or am I just misunderstanding? </div>
<div><br>
</div>
<div>Björn SM7IUN</div>
<div><br>
</div>
<div><br>
</div>
<div><br>
</div>
<div><br>
</div>
<div><br>
</div>
<div><br>
</div>
</div>
<br>
<div class="gmail_quote">
<div dir="ltr" class="gmail_attr">On Sun, Mar 12, 2023 at
12:06 AM Dirk Koopman via Dxspider-support <<a
href="mailto:dxspider-support@tobit.co.uk"
moz-do-not-send="true" class="moz-txt-link-freetext">dxspider-support@tobit.co.uk</a>>
wrote:<br>
</div>
<blockquote class="gmail_quote" style="margin:0px 0px 0px
0.8ex;border-left:1px solid
rgb(204,204,204);padding-left:1ex">
<div>
<div><font size="4">I should add: the 'download' is
non-blocking. As you can see in the example below they
run in parallel:<br>
</font><br>
<font face="monospace">11Mar2023@20:24:00 (cron) cron:
UTC 24 20 11 3 6 -> doing 'run_cmd('download <a
href="http://www.dxspider.net/download/badip.torexit"
target="_blank" moz-do-not-send="true"
class="moz-txt-link-freetext">http://www.dxspider.net/download/badip.torexit</a>')'<br>
11Mar2023@20:24:00 (cron) DXCron::run_cmd: download <a
href="http://www.dxspider.net/download/badip.torexit" target="_blank"
moz-do-not-send="true" class="moz-txt-link-freetext">http://www.dxspider.net/download/badip.torexit</a><br>
11Mar2023@20:24:00 (*) download: url <a
href="http://www.dxspider.net/download/badip.torexit"
target="_blank" moz-do-not-send="true"
class="moz-txt-link-freetext">http://www.dxspider.net/download/badip.torexit</a><br>
11Mar2023@20:24:00 (progress) CMD: 'download <a
href="http://www.dxspider.net/download/badip.torexit"
target="_blank" moz-do-not-send="true"
class="moz-txt-link-freetext">http://www.dxspider.net/download/badip.torexit</a>'
by GB7TLH ip: 127.0.0.1 2mS<br>
11Mar2023@20:24:00 (cron) cron: UTC 24 20 11 3 6 ->
doing 'run_cmd('download <a
href="http://www.dxspider.net/download/badip.torrelay"
target="_blank" moz-do-not-send="true"
class="moz-txt-link-freetext">http://www.dxspider.net/download/badip.torrelay</a>')'<br>
11Mar2023@20:24:00 (cron) DXCron::run_cmd: download <a
href="http://www.dxspider.net/download/badip.torrelay" target="_blank"
moz-do-not-send="true" class="moz-txt-link-freetext">http://www.dxspider.net/download/badip.torrelay</a><br>
11Mar2023@20:24:00 (*) download: url <a
href="http://www.dxspider.net/download/badip.torrelay"
target="_blank" moz-do-not-send="true"
class="moz-txt-link-freetext">http://www.dxspider.net/download/badip.torrelay</a><br>
11Mar2023@20:24:00 (progress) CMD: 'download <a
href="http://www.dxspider.net/download/badip.torrelay"
target="_blank" moz-do-not-send="true"
class="moz-txt-link-freetext">http://www.dxspider.net/download/badip.torrelay</a>'
by GB7TLH ip: 127.0.0.1 1mS<br>
11Mar2023@20:24:00 (cron) cron: UTC 24 20 11 3 6 ->
doing 'run_cmd('download <a
href="http://www.dxspider.net/download/badip.global"
target="_blank" moz-do-not-send="true"
class="moz-txt-link-freetext">http://www.dxspider.net/download/badip.global</a>')'<br>
11Mar2023@20:24:00 (cron) DXCron::run_cmd: download <a
href="http://www.dxspider.net/download/badip.global"
target="_blank" moz-do-not-send="true"
class="moz-txt-link-freetext">http://www.dxspider.net/download/badip.global</a><br>
11Mar2023@20:24:00 (*) download: url <a
href="http://www.dxspider.net/download/badip.global"
target="_blank" moz-do-not-send="true"
class="moz-txt-link-freetext">http://www.dxspider.net/download/badip.global</a><br>
11Mar2023@20:24:00 (progress) CMD: 'download <a
href="http://www.dxspider.net/download/badip.global"
target="_blank" moz-do-not-send="true"
class="moz-txt-link-freetext">http://www.dxspider.net/download/badip.global</a>'
by GB7TLH ip: 127.0.0.1 1mS<br>
11Mar2023@20:24:00 (progress) download:
/spider/local_data/badip.global successfully
downloaded<br>
11Mar2023@20:24:00 (progress) download:
/spider/local_data/badip.torexit successfully
downloaded<br>
11Mar2023@20:24:00 (progress) download:
/spider/local_data/badip.torrelay successfully
downloaded<br>
</font><br>
<font size="4">Given that sysops are successfully
running the mojo branch on Windows (apart from
spawning commands), I believe this will work
identically there as well.</font><br>
<br>
On 11/03/2023 22:54, Dirk Koopman via Dxspider-support
wrote:<br>
</div>
<blockquote type="cite"> <font size="4">I have just
pushed new DXSpider command 'download', it is a bit
experimental, but I have been using it successfully in
a few places. There may be additional facilities added
to it based on demand. Here is what the Changes file
says (can't be bothered to type it all out again):<br>
<font face="monospace"><br>
1. I am aware that there are windows nodes out there
on mojo (brave, impetuous <br>
that you are) and wget is not an easy option to
download badip files. So, <br>
through the power of mojo I give you the new
'download' command. As it <br>
stands at the moment, it will download a file
from a webserver and place<br>
it in /spider/local_data. If it downloads
successfully, it will overwrite<br>
any file with that name in /spider/local_data.
Needless to say this is a <br>
sysop only command. <br>
<br>
24 * * * * run_cmd('download <a
href="http://www.dxspider.net/download/badip.torexit"
target="_blank" moz-do-not-send="true"
class="moz-txt-link-freetext">http://www.dxspider.net/download/badip.torexit</a>')<br>
24 * * * * run_cmd('download <a
href="http://www.dxspider.net/download/badip.torrelay"
target="_blank" moz-do-not-send="true"
class="moz-txt-link-freetext">http://www.dxspider.net/download/badip.torrelay</a>')<br>
24 * * * * run_cmd('download <a
href="http://www.dxspider.net/download/badip.global"
target="_blank" moz-do-not-send="true"
class="moz-txt-link-freetext">http://www.dxspider.net/download/badip.global</a>')<br>
25 * * * * run_cmd('load/badip')<br>
<br>
would be an obvious use. But it can also be used
to download spot, USDB <br>
and other data as well. If you do use it then you
will still need to <br>
do a spawn_cmd in crontab for the conversion
programs, but that too is <br>
going to change.<br>
</font><br>
You don't need to restart, everything it does is in
the command. <br>
<br>
Enjoy<br>
<br>
Dirk G1TLH<br>
</font> <br>
<fieldset></fieldset>
<pre>_______________________________________________
Dxspider-support mailing list
<a href="mailto:Dxspider-support@tobit.co.uk" target="_blank" moz-do-not-send="true" class="moz-txt-link-freetext">Dxspider-support@tobit.co.uk</a>
<a href="https://mailman.tobit.co.uk/mailman/listinfo/dxspider-support" target="_blank" moz-do-not-send="true" class="moz-txt-link-freetext">https://mailman.tobit.co.uk/mailman/listinfo/dxspider-support</a>
</pre>
</blockquote>
<br>
</div>
_______________________________________________<br>
Dxspider-support mailing list<br>
<a href="mailto:Dxspider-support@tobit.co.uk"
target="_blank" moz-do-not-send="true"
class="moz-txt-link-freetext">Dxspider-support@tobit.co.uk</a><br>
<a
href="https://mailman.tobit.co.uk/mailman/listinfo/dxspider-support"
rel="noreferrer" target="_blank" moz-do-not-send="true"
class="moz-txt-link-freetext">https://mailman.tobit.co.uk/mailman/listinfo/dxspider-support</a><br>
</blockquote>
</div>
</blockquote>
<br>
<br>
<fieldset class="moz-mime-attachment-header"></fieldset>
<pre class="moz-quote-pre" wrap="">_______________________________________________
Dxspider-support mailing list
<a class="moz-txt-link-abbreviated" href="mailto:Dxspider-support@tobit.co.uk">Dxspider-support@tobit.co.uk</a>
<a class="moz-txt-link-freetext" href="https://mailman.tobit.co.uk/mailman/listinfo/dxspider-support">https://mailman.tobit.co.uk/mailman/listinfo/dxspider-support</a>
</pre>
</blockquote>
<br>
</body>
</html>