[Dxspider-support] Latest source of utter frustration

Dirk Koopman djk at tobit.co.uk
Tue Apr 14 20:45:23 CEST 2020


Not /user/default/dxspider - but - /etc/default/dxspider   (sigh....)

On 14/04/2020 19:43, Dirk Koopman via Dxspider-support wrote:
> Here is a case for using the mojo branch. AFAIK there is no programmed 
> in 1024 file limit and it won't use normal select (unless you forget 
> to install EV) so FD_SIZE isn't relevant. You might well still have to 
> increase the maximum number of files available to a process. On my 
> syslem ' ulimit -n 2048' works. But it depends on the hard limits set 
> by the operating system. In Mike's case I think the hard limit is 
> 4096. You'll need to modify the start up for cluster.pl to do the 
> ulimit -n. A standard place is in /user/default/dxspider, or you could 
> start the node with 'ulimit -n 2048; /spider/perl/cluster.pl > 
> /dev/null >2&1'. YMMV.
>
> Mike is the *only* person I know that seems to be able to run a real 
> 300+ user node on the "standard" master branch. Everybody else 
> approaching that (that I know about) is on the mojo branch. If one is 
> serious about running "super nodes" then the mojo branch is the way to 
> go because it uses the Mojolicious framewark + EV + epoll(2) under the 
> hood.
>
> Dirk G1TLH




More information about the Dxspider-support mailing list