[Dxspider-support] spider generating dupes

[Dirk Koopman]

On Sat, 2001-11-24 at 19:33, Filip Jonckers wrote:
> 
> 
> > 
> > any idea why? This isn't something that happens very often. 
> > Do you have
> > ax25?
> 
> yes - that's the only difference besides the Linux version and memory
> size...
> 
> > 
> > > I had to stop the cluster and remove the /spider/data/dupefile
> > > to solve the problem
> > > dupefile was 258048 bytes
> > 
> > The standard solution.
> 
> would it be a good idea to automaitcally remove the dupefile when spider
> starts ?

No, because the whole point is that is persistant. However, there is an
argument there for me to work out why I get no errors when I add stuff,
because I am usre that they are there if I look hard enough.
 
> 
> 
> > It is aledged that later versions of Berkeley don't have 
> > these problems
> > and since most RPM based things now have DB 3.xx available I 
> > may go onto
> > that.
> 
> do you mean that the table get's to big too handle correctly ?
> can you give some more details ? what version should be better ?
> I could upgrade to see if it helps...
> 

Upgrading is no good. The interfaces are different and anyway, nearly
all the '1.85' BDBs out there are actually 2.xx BDB in 'compatibility'
mode. You can't fiddle with them because otherwise everything breaks
(including RPM).

Dirk