[Dxspider-support] Latest source of utter frustration
Dirk Koopman
djk at tobit.co.uk
Tue Apr 14 20:45:23 CEST 2020
Not /user/default/dxspider - but - /etc/default/dxspider (sigh....)
On 14/04/2020 19:43, Dirk Koopman via Dxspider-support wrote:
> Here is a case for using the mojo branch. AFAIK there is no programmed
> in 1024 file limit and it won't use normal select (unless you forget
> to install EV) so FD_SIZE isn't relevant. You might well still have to
> increase the maximum number of files available to a process. On my
> syslem ' ulimit -n 2048' works. But it depends on the hard limits set
> by the operating system. In Mike's case I think the hard limit is
> 4096. You'll need to modify the start up for cluster.pl to do the
> ulimit -n. A standard place is in /user/default/dxspider, or you could
> start the node with 'ulimit -n 2048; /spider/perl/cluster.pl >
> /dev/null >2&1'. YMMV.
>
> Mike is the *only* person I know that seems to be able to run a real
> 300+ user node on the "standard" master branch. Everybody else
> approaching that (that I know about) is on the mojo branch. If one is
> serious about running "super nodes" then the mojo branch is the way to
> go because it uses the Mojolicious framewark + EV + epoll(2) under the
> hood.
>
> Dirk G1TLH
More information about the Dxspider-support
mailing list