[Dxspider-support] Downloads

[Dirk Koopman]

I should add: the 'download' is non-blocking. As you can see in the 
example below they run in parallel:

11Mar2023 at 20:24:00 (cron) cron: UTC 24 20 11 3 6 -> doing 
'run_cmd('download http://www.dxspider.net/download/badip.torexit')'
11Mar2023 at 20:24:00 (cron) DXCron::run_cmd: download 
http://www.dxspider.net/download/badip.torexit
11Mar2023 at 20:24:00 (*) download: url 
http://www.dxspider.net/download/badip.torexit
11Mar2023 at 20:24:00 (progress) CMD: 'download 
http://www.dxspider.net/download/badip.torexit' by GB7TLH ip: 127.0.0.1 2mS
11Mar2023 at 20:24:00 (cron) cron: UTC 24 20 11 3 6 -> doing 
'run_cmd('download http://www.dxspider.net/download/badip.torrelay')'
11Mar2023 at 20:24:00 (cron) DXCron::run_cmd: download 
http://www.dxspider.net/download/badip.torrelay
11Mar2023 at 20:24:00 (*) download: url 
http://www.dxspider.net/download/badip.torrelay
11Mar2023 at 20:24:00 (progress) CMD: 'download 
http://www.dxspider.net/download/badip.torrelay' by GB7TLH ip: 127.0.0.1 1mS
11Mar2023 at 20:24:00 (cron) cron: UTC 24 20 11 3 6 -> doing 
'run_cmd('download http://www.dxspider.net/download/badip.global')'
11Mar2023 at 20:24:00 (cron) DXCron::run_cmd: download 
http://www.dxspider.net/download/badip.global
11Mar2023 at 20:24:00 (*) download: url 
http://www.dxspider.net/download/badip.global
11Mar2023 at 20:24:00 (progress) CMD: 'download 
http://www.dxspider.net/download/badip.global' by GB7TLH ip: 127.0.0.1 1mS
11Mar2023 at 20:24:00 (progress) download: /spider/local_data/badip.global 
successfully downloaded
11Mar2023 at 20:24:00 (progress) download: /spider/local_data/badip.torexit 
successfully downloaded
11Mar2023 at 20:24:00 (progress) download: 
/spider/local_data/badip.torrelay successfully downloaded

Given that sysops are successfully running the mojo branch on Windows 
(apart from spawning commands), I believe this will work identically 
there as well.

On 11/03/2023 22:54, Dirk Koopman via Dxspider-support wrote:
> I have just pushed new DXSpider command 'download', it is a bit 
> experimental, but I have been using it successfully in a few places. 
> There may be additional facilities added to it based on demand. Here 
> is what the Changes file says (can't be bothered to type it all out 
> again):
>
> 1. I am aware that there are windows nodes out there on mojo (brave, 
> impetuous
>    that you are) and wget is not an easy option to download badip 
> files. So,
>    through the power of mojo I give you the new 'download' command. As it
>    stands at the moment, it will download a file from a webserver and 
> place
>    it in /spider/local_data. If it downloads successfully, it will 
> overwrite
>    any file with that name in /spider/local_data. Needless to say this 
> is a
>    sysop only command.
>
> 24 * * * * run_cmd('download 
> http://www.dxspider.net/download/badip.torexit')
> 24 * * * * run_cmd('download 
> http://www.dxspider.net/download/badip.torrelay')
> 24 * * * * run_cmd('download 
> http://www.dxspider.net/download/badip.global')
> 25 * * * * run_cmd('load/badip')
>
>    would be an obvious use. But it can also be used to download spot, 
> USDB
>    and other data as well. If you do use it then you will still need to
>    do a spawn_cmd in crontab for the conversion programs, but that too is
>    going to change.
>
> You don't need to restart, everything it does is in the command.
>
> Enjoy
>
> Dirk G1TLH
>
> _______________________________________________
> Dxspider-support mailing list
> Dxspider-support at tobit.co.uk
> https://mailman.tobit.co.uk/mailman/listinfo/dxspider-support
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://mailman.tobit.co.uk/pipermail/dxspider-support/attachments/20230311/4d02368f/attachment.htm>