[Dxspider-support] Some examples. Very personal

Thu Feb 27 16:50:22 GMT 2025

Hi Kin,

Very interesting, honestly I didn’t remember the download command, and
almost all the examples I've seen refer to wget. So, this means I can
safely replace these commands in my crontab, right?

Here are the current entries I'm looking to modify:

*AutoUpdate USDB*
0 1 * * * spawn("cd /tmp; wget -qN http://ftp.w1nr.net/usdbraw.gz;
/spider/perl/create_usdb.pl usdbraw.gz")
5 1 * * * run_cmd("load/usdb")
10 1 * * * spawn("rm /tmp/usdbraw.gz")

*Update KEPS*
00 05 * * 1 spawn('wget -qN
http://www.amsat.org/amsat/ftp/keps/current/nasa.all -P /spider/data')
02 05 * * 1 spawn('/spider/perl/convkeps.pl -c -p /spider/data/nasa.all')
03 05 * * 1 run_cmd('load/keps')

*Update PREFIXES*
05 05 * * 5 spawn('wget -qN www://www.country-files.com/cty/cty.dat -P
/spider/data')
06 05 * * 5 spawn('/spider/perl/create_prefix.pl')
07 05 * * 5 run_cmd('load/prefix')

*AutoUpdate CTY.DAT*
0 2 * * * spawn("cd /spider/local_data; wget -qN
http://www.country-files.com/cty/cty.dat")
0 2 * * * spawn("cd /spider/local_data; wget -qN
http://www.country-files.com/cty/wpxloc.raw")
2 2 * * * spawn("/spider/perl/create_prefix.pl")
3 2 * * * run_cmd("load/prefix")

*Blacklist. TOR & Others*
30 * * * * spawn('cd /spider/local_data; wget -qN
http://www.dxspider.net/download/badip.torexit')
30 * * * * spawn('cd /spider/local_data; wget -qN
http://www.dxspider.net/download/badip.torrelay')
30 * * * * spawn('cd /spider/local_data; wget -qN
http://www.dxspider.net/download/badip.global')
31 * * * * run_cmd('load/badip')

I'm trying to tidy things up based on the topic :)
Thanks a lot!

HB9DHG Fulvio

On Thu, Feb 27, 2025 at 5:39 PM Kin <ea3cv at cronux.net> wrote:

> By the way, I guess you remember that Dirk implemented a ‘download’
> command two years ago.
>
> You can make the substitution in this way:
>
>
>
> spawn('cd /spider/local_data; wget -qN
>
> can be replaced by this:
>
> run_cmd('download
>
>
>
> In other words:
>
>
>
> Before:
>
> 32 * * * * spawn('cd /spider/local_data; wget -qN
> http://www.dxspider.net/download/badip.torexit')
>
> After:
>
> 32 * * * * run_cmd('download
> http://www.dxspider.net/download/badip.torexit')
>
>
>
> Kin EA3CV
>
>
>
> *De:* HB9DHG Fulvio <hb9dhg at gmail.com>
> *Enviado el:* jueves, 27 de febrero de 2025 17:33
> *Para:* Kin <ea3cv at cronux.net>
> *CC:* The DXSpider Support list <dxspider-support at tobit.co.uk>
> *Asunto:* Re: [Dxspider-support] Some examples. Very personal
>
>
>
> Thanks Kin,
>
> I’ll check if the issue is related to a specific firewall configuration on
> my side that might be blocking file downloads when interpreting the ftp://
>  protocol (in fact, wget uses port 21 when an ftp:// address is provided).
>
> Sorry for the traffic :)
>
> 73 de HB9DHG Fulvio
>
>
>
>
>
> On Thu, Feb 27, 2025 at 5:15 PM Kin <ea3cv at cronux.net> wrote:
>
> Both work without problem.
>
> It only affects the server, it should not fail on the client.
>
> I just verified on my Debian 12 that they both work exactly the same.
>
>
>
> Thanks for the info Fulvio.
>
>
>
> Kin EA3CV
>
>
>
> *De:* Dxspider-support <dxspider-support-bounces at tobit.co.uk> *En nombre
> de *HB9DHG Fulvio via Dxspider-support
> *Enviado el:* jueves, 27 de febrero de 2025 17:09
> *Para:* The DXSpider Support list <dxspider-support at tobit.co.uk>
> *CC:* HB9DHG Fulvio <hb9dhg at gmail.com>
> *Asunto:* Re: [Dxspider-support] Some examples. Very personal
>
>
>
> Dear All,
>
> I believe this line is incorrect:
>
> 0 1 * * * spawn("cd /tmp; wget -qN *ftp:*//ftp.w1nr.net/usdbraw.gz;
> /spider/perl/create_usdb.pl usdbraw.gz")
>
>
>
> Here is the corrected version using *http://* instead of *ftp://* (at
> least on my Fedora 43):
>
> 0 1 * * * spawn("cd /tmp; wget -qN *http:*//ftp.w1nr.net/usdbraw.gz
> <http://ftp.w1nr.net/usdbraw.gz>; /spider/perl/create_usdb.pl usdbraw.gz")
>
> Best regards,
>
> HB9DHG Fulvio
>
>
>
> On Thu, Feb 27, 2025 at 2:12 PM Tony K1AX via Dxspider-support <
> dxspider-support at tobit.co.uk> wrote:
>
> Hi Kin,
>
>
>
> Just looking over your file, did you mean to comment out "set/var
> $DXProt::senderverify 2"? I thought we were supposed to include this?
>
>
>
> Also, does the "Download updates tools" section automatically update
> DXSpider to the latest version? If so, does it ever break and require a
> manual fix?
>
>
>
> 73,
>
>
>
> Tony K1AX
>
>
> ------------------------------
>
> *From:* Dxspider-support <dxspider-support-bounces at tobit.co.uk> on behalf
> of Kin via Dxspider-support <dxspider-support at tobit.co.uk>
> *Sent:* Tuesday, February 18, 2025 12:53 PM
> *To:* 'The DXSpider Support list' <dxspider-support at tobit.co.uk>
> *Cc:* Kin <ea3cv at cronux.net>
> *Subject:* [Dxspider-support] Some examples. Very personal
>
>
>
> I have received several direct enquiries about an ‘ideal’ configuration.
>
> I get quite a few emails asking the same question, what better place for
> all of us to find out, than our support list.
>
>
>
> First, there is no magic or ideal configuration, every sysop can customise
> their spider to suit their needs, but I understand that it can be
> overwhelming with so many variables, so many messages.
>
> What I can do is to share what I think should be in all nodes at least.
>
>
>
> Let everyone modify it according to their needs:
>
>
>
> **** local_cmd/crontab*
>
>
>
> # Connections Partners
>
> 05,15,25,35,45,55 * * * * start_connect('<partner_1>') unless
> connected('<partner_1>')
>
> 00,10,20,30,40,50 * * * * start_connect('<partner_2>') unless
> connected('<partner_2>')
>
>
>
> # Connections RBNs
>
> * * * * * start_connect('SK0MMR') unless connected('SK0MMR')
>
> * * * * * start_connect('SK1MMR') unless connected('SK1MMR')
>
>
>
> # Check new build
>
> 0 3 * * * run_cmd("check_build Y 4")
>
>
>
> # Check dynamic IP
>
> 00,10,20,30,40,50 * * * * run_cmd("update_ip")
>
>
>
> # Download updates tools
>
> 50 0 * * * spawn('cd /spider/local_cmd; wget -N
> https://raw.githubusercontent.com/EA3CV/dxspider_info/main/check_build.pl
> -O /spider/local_cmd/check_build.pl')
>
> 52 0 * * * spawn('cd /spider/local_cmd; wget -N
> https://raw.githubusercontent.com/EA3CV/dxspider_info/main/update_ip.pl
> -O /spider/local_cmd/update_ip.pl/')
>
> 55 0 * * * run_cmd('load/cmd')
>
>
>
> # AutoUpdate USDB
>
> 0 1 * * *  spawn("cd /tmp; wget -qN ftp://ftp.w1nr.net/usdbraw.gz;
> /spider/perl/create_usdb.pl usdbraw.gz")
>
> 5 1 * * *  run_cmd("load/usdb")
>
> 10 1 * * * spawn("rm /tmp/usdbraw.gz")
>
>
>
> # AutoUpdate Keps
>
> 0 1 * * *  spawn("cd /tmp; wget -qN
> http://www.amsat.org/amsat/ftp/keps/current/nasabare.txt; /spider/perl/
> convkeps.pl -p nasabare.txt")
>
> 5 1 * * *  run_cmd("load/keps")
>
> 10 1 * * * spawn("rm /tmp/nasabare.txt")
>
>
>
> # AutoUpdate CTY.DAT
>
> 0 2 * * * spawn("cd /spider/local_data; wget -qN
> http://www.country-files.com/cty/cty.dat")
>
> 0 2 * * * spawn("cd /spider/local_data; wget -qN
> http://www.country-files.com/cty/wpxloc.raw")
>
> 2 2 * * * spawn("/spider/perl/create_prefix.pl")
>
> 3 2 * * * run_cmd("load/prefix")
>
>
>
> # TOR & Others
>
> 10 * * * * spawn('cd /spider/local_data; wget -qN
> http://www.dxspider.net/download/badip.torexit')
>
> 10 * * * * spawn('cd /spider/local_data; wget -qN
> http://www.dxspider.net/download/badip.torrelay')
>
> 10 * * * * spawn('cd /spider/local_data; wget -qN
> http://www.dxspider.net/download/badip.global')
>
> 12 * * * * run_cmd('load/badip')
>
>
>
>
>
> **** scripts/startup*
>
>
>
> set/var $Spot::maxspots = 100
>
> set/var $DXCommandmode::maxbadcount = 3
>
>
>
> set/var $main::reqreg = 1
>
> set/var $main::passwdreq = 0
>
>
>
> # Slot 1 min
>
> set/var $Spot::timegranularity = 60
>
> # Slot 1 kHz
>
> set/var $Spot::qrggranularity = 1
>
> # Max dupepage 5 min
>
> set/var $Spot::dupage = 300
>
> # Autospot
>
> set/var $Spot::minselfspotqrg = 0
>
>
>
> #set/var $DXProt::senderverify = 2
>
>
>
> #set/var $DXProt::pc92c_ipaddr_enable 1
>
> set/var $DXProt::pc92_ad_enabled 1
>
>
>
> set/var $main::localhost_alias_ipv4 = '<public_ip>'
>
> set/var @main::localhost_names ('127.0.0.1', '::1', '<local_ip>')
>
>
>
> set/spider <partner_1>
>
> set/spider <partner_2>
>
> set/arc    <partner_3>
>
> set/spider <partner_4>
>
>
>
> set/pinginterval 0 <partner_3> # ARCluster
>
>
>
> set/rbn    SK0MMR
>
> set/rbn    SK1MMR
>
>
>
> conn <partner_1>
>
> conn <partner_2>
>
> conn <partner_3>
>
> conn <partner_4>
>
> conn SK0MMR
>
> conn SK1MMR
>
>
>
>
>
> **** Example of a connection file:*
>
>
>
> connect/<partner_1>
>
>
>
> timeout 15
>
> connect telnet <name_ip_partner_1> <port_partner_1>
>
> 'login:' '<your_callsign_node>'
>
> 'assword:' '<password>'
>
>
>
> **** From console spider (partner type spider):*
>
>
>
> set/spider <partner_1>
>
> set/register <partner_1>
>
> set/password <partner_1> <password>
>
>
>
> Note: I recommend the same password on both nodes of the pair.
>
>
>
> The rest I leave to the imagination of each one 😉
>
>
>
>
>
> Kin EA3CV
>
>
>
>
>
> https://clustermap.cronux.net/map.html
>
> https://github.com/EA3CV/dxspider_info
>
> https://github.com/EA3CV/dxspider_update
>
> DXSpider Channel: t.me/dxspider
>
> https://www.dxcluster.info/telnet/index.php
>
>
>
>
>
> _______________________________________________
> Dxspider-support mailing list
> Dxspider-support at tobit.co.uk
> https://mailman.tobit.co.uk/mailman/listinfo/dxspider-support
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://mailman.tobit.co.uk/pipermail/dxspider-support/attachments/20250227/b077ddb0/attachment-0001.htm>