[Dxspider-support] The RBN interface is here...

[Lee Sawkins]

The server software used by the RBN was written by me.  I believe they have 3 servers running it for CW/RTTY spots using a Round-Robin DNS.  There should not be a capacity problem.  I do not know if FT4/8 spots are using Round-Robin DNS, but they could if needed.  

I have also written software to compress the data from these servers.  I should ask the RBN if they want to use it.  It uses delimited fields with blank entries for repeating info between spots.  The time, date. mode, spotter calls and much of the comments are repeated over and over.  It compresses spots to about 25% of original size, plus it is much easier to parse.

Dirk was correct.  The DX spots are are 75 bytes long plus the TCP/IP overhead.  My node accepted 3 million valid CW spots and 1 million valid FT8 spots during the contest.  My cluster sent 150 million spots to my users during the contest.  About 15 GB of cluster data out to users.  I think I calculated it right this time.

Lee VE7CC

----- Original Message -----
From: Rene Olsen via Dxspider-support <dxspider-support at tobit.co.uk>
To: dxspider-support at tobit.co.uk, Dirk Koopman <djk at tobit.co.uk>
Cc: Rene Olsen <rene.chr.olsen at gmail.com>
Sent: Tue, 14 Jul 2020 13:31:35 -0600 (MDT)
Subject: Re: [Dxspider-support] The RBN interface is here...

Hi Dirk.

Thanks for the info.

I also looked at the calculations you did about the bw useage of the RBN feed itself. If there 
is a lot of spider clusters connecting, they will have to deliver a lot of data.

If 200+ spider nodes connects to the raw RBN feeds, maybe they will have to do some 
filtering themselves, or simply limit the number of users on there.

Is there any reason why every single spider node should receive the raw RBN data?

Would it maybe be possible to create some main "hubs", that will act as RBN feed to other 
nodes? Maybe its a stupid idea, but for me who isn't able to handle the raw RBN feed, it 
might be a good option to still deliver good RBN spots to my users.

Those "hubs" should receive the raw RBN feeds, and then do the filtering and pass the 
filtered data on to X number of rbn enabled spider nodes.

Just a thought.

As you say yourself, 96% of the raw data is "useless", but of course needed to pick out the 
good spots.

Vy 73 de René / OZ1LQH


On 13 Jul 2020 at 0:13, Dirk Koopman wrote:

> René
> 
> Don't forget that it isn't compulsory to connect to the RBN. There are 
> lot's of other improvements under the hood. And this is the 
> "development" branch where all the new things happen.
> 
> 73 Dirk G1TLH
> 
> On 12/07/2020 21:16, Rene Olsen wrote:
> > Hi Dirk.
> >
> > Yes, I think that I will upgrade to mojo branch no matter what.
> >
> > I am still having doubts about the RBN thing though. As I wrote earlier I am on a limited plan,
> > which means I pay a very low price per month. I am only allowed 1 TB of data a month.
> >
> > I was logged on the the RBN network port 7000, and it said that the average at that time was
> > 17000 spots an hour. And that is probably at the low end when contests are there. This is a
> > normal sunday evening without any contests (that I am aware of).
> >
> > 17000 spots an hour, I count a spot as 80 bytes, means that just with that I will be using
> > around 1 TB of data in 30 days. The next plan at my provider is a lot more money, so guess I
> > am bowing out on the RBN stuff. Unless my calculations are way off.
> >
> > I guess in busy contest weekends the number can increase to 50000 spots an hour or more.
> >
> > Vy 73 de René / OZ1LQH
> >
> >
> 




_______________________________________________
Dxspider-support mailing list
Dxspider-support at tobit.co.uk
https://mailman.tobit.co.uk/mailman/listinfo/dxspider-support