<!DOCTYPE html>
<html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=UTF-8">
</head>
<body>
<div class="moz-cite-prefix">A slightly edited version done on a
decent screen and not a mobile phone with auto correct...<br>
<br>
Edits underlined<br>
<br>
On 01/02/2025 18:15, Dirk Koopman via Dxspider-support wrote:<br>
</div>
<blockquote type="cite"
cite="mid:6DD5941F-941A-49F1-A016-7A61A9DCF808@tobit.co.uk">
<div dir="ltr">The problem I have is that I <u>cannot</u> see
what you are seeing. And further more, <u> if you are getting
all these dupes you would be seeing multiple spots on your
console</u>. </div>
<div dir="ltr"><br>
</div>
<div dir="ltr">What I suggest you do is to stop your node, delete
your /spider/local_cmd/dupefile then restart your node.</div>
<div dir="ltr"><br>
</div>
<div dir="ltr">Startup a console and type set/debug <u>dxdupe</u>.
In another shell window type ‘watchdbg dxdupe’.</div>
<div dir="ltr"><br>
</div>
<div dir="ltr">Then wait. In amongst all the dupe add lines, once
a minute you will see a line with the count of dupe records
there are. If you have $<a class="moz-txt-link-freetext" href="Spot::dupe">Spot::dupe</a> age set to 10 minutes, after
that time has passed deletions should start to occur and the
count will settle down to a slowly rising count (caused by 3
hours of announces) and then will stabilise to a number which
will be in the lowish hundreds (as it’s a contest weekend). On
normal days I see something between 120 - 160 ish.</div>
</blockquote>
<br>
<br>
You will see something like this (one minute's worth):<br>
<br>
<font face="monospace">19:26:38 (dxdupe) <a class="moz-txt-link-freetext" href="DXDupe::add">DXDupe::add</a> key:
XZ32TO|IK4ZIF|7182|1738438200||EUDXC time: 1936Z<br>
19:26:45 (dxdupe) <a class="moz-txt-link-freetext" href="DXDupe::add">DXDupe::add</a> key:
XEA4DEI|KB8OTK|24917|1738438200|| time: 1936Z<br>
19:26:50 (dxdupe) <a class="moz-txt-link-freetext" href="DXDupe::add">DXDupe::add</a> key:
XK1LZ|TF1A|14200|1738438200||59INICELANDCQCO time: 1936Z<br>
19:26:50 (dxdupe) <a class="moz-txt-link-freetext" href="DXDupe::add">DXDupe::add</a> key: XK1LZ|TF1A|14200|1738438200|5/9
IN ICELAND time: 1936Z<br>
19:27:05 (dxdupe) <a class="moz-txt-link-freetext" href="DXDupe::add">DXDupe::add</a> key: XPA4O|RX7T|7015|1738438200||
time: 1937Z<br>
19:27:06 (dxdupe) <a class="moz-txt-link-freetext" href="DXDupe::add">DXDupe::add</a> key:
XWA0MN|N0UR|28044|1738438200||MNQPSTE time: 1937Z<br>
19:27:06 (dxdupe) <a class="moz-txt-link-freetext" href="DXDupe::add">DXDupe::add</a> key:
XWA0MN|N0UR|28044|1738438200|MNQP STE time: 1937Z<br>
19:27:16 (dxdupe) <a class="moz-txt-link-freetext" href="DXDupe::add">DXDupe::add</a> key:
XPE9GHZ/B|PA2DOL|5760815|1738438200||JO21GXTRJO11WM4 time: 1937Z<br>
19:27:16 (dxdupe) <a class="moz-txt-link-freetext" href="DXDupe::add">DXDupe::add</a> key:
XPE9GHZ/B|PA2DOL|5760815|1738438200|JO21GX(TR)JO11W time: 1937Z<br>
19:27:22 (dxdupe) <a class="moz-txt-link-freetext" href="DXDupe::add">DXDupe::add</a> key:
XAI0M|W2VTV|28420|1738438200||MNOLMSTED time: 1937Z<br>
19:27:22 (dxdupe) <a class="moz-txt-link-freetext" href="DXDupe::add">DXDupe::add</a> key: XAI0M|W2VTV|28420|1738438200|MN
OLMSTED time: 1937Z<br>
19:27:29 (dxdupe) <a class="moz-txt-link-freetext" href="DXDupe::add">DXDupe::add</a> key: XF5IN|RX7T|7016|1738438200||
time: 1937Z<br>
19:27:34 (dxdupe) <a class="moz-txt-link-freetext" href="DXDupe::add">DXDupe::add</a> key:
XWA0JGT|AE9LL|14245|1738438200|| time: 1937Z<br>
19:27:35 (dxdupe) <a class="moz-txt-link-freetext" href="DXDupe::add">DXDupe::add</a> key:
XYQ5A|UB3LBU|3573|1738438200||THEYEAROFHOMAGE time: 1937Z<br>
19:27:35 (dxdupe) <a class="moz-txt-link-freetext" href="DXDupe::add">DXDupe::add</a> key:
XYQ5A|UB3LBU|3573|1738438200|THE YEAR OF HOM time: 1937Z<br>
19:27:36 (dxdupe) <a class="moz-txt-link-freetext" href="DXDupe::del">DXDupe::del</a> key:
XDK2NI|UA3BL|3740|1738437600||CONTEST time: 1926Z<br>
19:27:36 (dxdupe) <a class="moz-txt-link-freetext" href="DXDupe::del">DXDupe::del</a> key:
XHA6QU|HA5KFU|1837|1738437600|EU TEST HA6QU H time: 1926Z<br>
19:27:36 (dxdupe) <a class="moz-txt-link-freetext" href="DXDupe::del">DXDupe::del</a> key:
XK3MTO|K5YDD|18128|1738437600||POTA time: 1927Z<br>
19:27:36 (dxdupe) <a class="moz-txt-link-freetext" href="DXDupe::del">DXDupe::del</a> key: XOM6TX|SP5BK|3731|1738437600||
time: 1927Z<br>
19:27:36 (dxdupe) <a class="moz-txt-link-freetext" href="DXDupe::del">DXDupe::del</a> key:
XTG9AHM|AD4YQ|24985|1738437600|| time: 1927Z<br>
19:27:36 (dxdupe) <a class="moz-txt-link-freetext" href="DXDupe::del">DXDupe::del</a> key:
XHA6QU|HA5KFU|1837|1738437600||EUTESTHA6QUHU04 time: 1926Z<br>
19:27:36 (dxdupe) <a class="moz-txt-link-freetext" href="DXDupe::del">DXDupe::del</a> key: XNQ1B|N3KN|21049|1738437600||CW
time: 1926Z<br>
19:27:36 (dxdupe) <a class="moz-txt-link-freetext" href="DXDupe::del">DXDupe::del</a> key: XPV2K|PY2OF|14248|1738437600|CQ
TEST time: 1926Z<br>
19:27:36 (dxdupe) <a class="moz-txt-link-freetext" href="DXDupe::del">DXDupe::del</a> key:
XPV2K|PY2OF|14248|1738437600||CQTEST time: 1926Z<br>
19:27:36 (dxdupe) <a class="moz-txt-link-freetext" href="DXDupe::del">DXDupe::del</a> key:
XVE3GJP|N5MEF|14250|1738437600|| time: 1927Z<br>
19:27:36 (dxdupe) <a class="moz-txt-link-freetext" href="DXDupe::del">DXDupe::del</a> key:
XSQ6PLE|DK1HJG|3586|1738437600||RTTY time: 1926Z<br>
19:27:36 (dxdupe) <a class="moz-txt-link-freetext" href="DXDupe::del">DXDupe::del</a> key:
XEC1A|KC2GOW|21092|1738437600||RTTY time: 1927Z<br>
19:27:36 (dxdupe) <a class="moz-txt-link-freetext" href="DXDupe::del">DXDupe::del</a> key:
XPA3DUU|LZ2HA|7058|1738437600||RTTY time: 1926Z<br>
19:27:36 (dxdupe) <a class="moz-txt-link-freetext" href="DXDupe::per_minute">DXDupe::per_minute</a> number of records 258<br>
</font><br>
It is normal to see two entries where there is a comment on the spot
and the "compressed and normalised" version is different from the
raw comment. "Normalised" means: capitalise all letters and remove
everything that is not a letter or a digit.<br>
<br>
The "number of records" is the current number of records in left in
dupefile + the number of records it has just deleted. Just me being
lazy, I'll change it to be the correct number at the time of
printing. This instance has been running here since about 21h00 last
night so should be representative of this level of activity. <br>
<br>
A swift "grepdbg dxdupe per minute", just now, yields:<br>
<br>
<font face="monospace">01Feb2025@19:26:36 (dxdupe)
<a class="moz-txt-link-freetext" href="DXDupe::per_minute">DXDupe::per_minute</a> number of records 256<br>
01Feb2025@19:27:36 (dxdupe) <a class="moz-txt-link-freetext" href="DXDupe::per_minute">DXDupe::per_minute</a> number of records
258<br>
01Feb2025@19:28:36 (dxdupe) <a class="moz-txt-link-freetext" href="DXDupe::per_minute">DXDupe::per_minute</a> number of records
263<br>
01Feb2025@19:29:36 (dxdupe) <a class="moz-txt-link-freetext" href="DXDupe::per_minute">DXDupe::per_minute</a> number of records
271<br>
01Feb2025@19:30:36 (dxdupe) <a class="moz-txt-link-freetext" href="DXDupe::per_minute">DXDupe::per_minute</a> number of records
262<br>
01Feb2025@19:31:36 (dxdupe) <a class="moz-txt-link-freetext" href="DXDupe::per_minute">DXDupe::per_minute</a> number of records
251<br>
01Feb2025@19:32:36 (dxdupe) <a class="moz-txt-link-freetext" href="DXDupe::per_minute">DXDupe::per_minute</a> number of records
246<br>
01Feb2025@19:33:36 (dxdupe) <a class="moz-txt-link-freetext" href="DXDupe::per_minute">DXDupe::per_minute</a> number of records
244<br>
01Feb2025@19:34:36 (dxdupe) <a class="moz-txt-link-freetext" href="DXDupe::per_minute">DXDupe::per_minute</a> number of records
247<br>
01Feb2025@19:35:36 (dxdupe) <a class="moz-txt-link-freetext" href="DXDupe::per_minute">DXDupe::per_minute</a> number of records
239<br>
01Feb2025@19:36:36 (dxdupe) <a class="moz-txt-link-freetext" href="DXDupe::per_minute">DXDupe::per_minute</a> number of records
234<br>
01Feb2025@19:37:36 (dxdupe) <a class="moz-txt-link-freetext" href="DXDupe::per_minute">DXDupe::per_minute</a> number of records
249<br>
01Feb2025@19:38:36 (dxdupe) <a class="moz-txt-link-freetext" href="DXDupe::per_minute">DXDupe::per_minute</a> number of records
256<br>
01Feb2025@19:39:36 (dxdupe) <a class="moz-txt-link-freetext" href="DXDupe::per_minute">DXDupe::per_minute</a> number of records
248<br>
01Feb2025@19:40:36 (dxdupe) <a class="moz-txt-link-freetext" href="DXDupe::per_minute">DXDupe::per_minute</a> number of records
260<br>
01Feb2025@19:41:36 (dxdupe) <a class="moz-txt-link-freetext" href="DXDupe::per_minute">DXDupe::per_minute</a> number of records
259<br>
01Feb2025@19:42:36 (dxdupe) <a class="moz-txt-link-freetext" href="DXDupe::per_minute">DXDupe::per_minute</a> number of records
264</font><br>
<br>
This is a more "normal" level:<br>
<br>
<font face="monospace">30Jan2025@11:40:12 (dxdupe)
<a class="moz-txt-link-freetext" href="DXDupe::per_minute">DXDupe::per_minute</a> number of records 92<br>
30Jan2025@11:41:12 (dxdupe) <a class="moz-txt-link-freetext" href="DXDupe::per_minute">DXDupe::per_minute</a> number of records
100<br>
30Jan2025@11:42:26 (dxdupe) <a class="moz-txt-link-freetext" href="DXDupe::per_minute">DXDupe::per_minute</a> number of records
110<br>
30Jan2025@11:44:05 (dxdupe) <a class="moz-txt-link-freetext" href="DXDupe::per_minute">DXDupe::per_minute</a> number of records
100<br>
30Jan2025@11:44:45 (dxdupe) <a class="moz-txt-link-freetext" href="DXDupe::per_minute">DXDupe::per_minute</a> number of records
109<br>
30Jan2025@11:45:15 (dxdupe) <a class="moz-txt-link-freetext" href="DXDupe::per_minute">DXDupe::per_minute</a> number of records
112<br>
30Jan2025@11:46:12 (dxdupe) <a class="moz-txt-link-freetext" href="DXDupe::per_minute">DXDupe::per_minute</a> number of records
119<br>
30Jan2025@11:47:12 (dxdupe) <a class="moz-txt-link-freetext" href="DXDupe::per_minute">DXDupe::per_minute</a> number of records
123<br>
30Jan2025@11:48:12 (dxdupe) <a class="moz-txt-link-freetext" href="DXDupe::per_minute">DXDupe::per_minute</a> number of records
123<br>
30Jan2025@11:49:12 (dxdupe) <a class="moz-txt-link-freetext" href="DXDupe::per_minute">DXDupe::per_minute</a> number of records
124<br>
30Jan2025@11:50:12 (dxdupe) <a class="moz-txt-link-freetext" href="DXDupe::per_minute">DXDupe::per_minute</a> number of records
125<br>
30Jan2025@11:51:12 (dxdupe) <a class="moz-txt-link-freetext" href="DXDupe::per_minute">DXDupe::per_minute</a> number of records
125<br>
30Jan2025@11:52:12 (dxdupe) <a class="moz-txt-link-freetext" href="DXDupe::per_minute">DXDupe::per_minute</a> number of records
113<br>
30Jan2025@11:53:12 (dxdupe) <a class="moz-txt-link-freetext" href="DXDupe::per_minute">DXDupe::per_minute</a> number of records
119<br>
30Jan2025@11:54:12 (dxdupe) <a class="moz-txt-link-freetext" href="DXDupe::per_minute">DXDupe::per_minute</a> number of records
115<br>
30Jan2025@11:55:12 (dxdupe) <a class="moz-txt-link-freetext" href="DXDupe::per_minute">DXDupe::per_minute</a> number of records
115<br>
30Jan2025@11:56:12 (dxdupe) <a class="moz-txt-link-freetext" href="DXDupe::per_minute">DXDupe::per_minute</a> number of records
115<br>
30Jan2025@11:57:12 (dxdupe) <a class="moz-txt-link-freetext" href="DXDupe::per_minute">DXDupe::per_minute</a> number of records
111<br>
30Jan2025@11:58:12 (dxdupe) <a class="moz-txt-link-freetext" href="DXDupe::per_minute">DXDupe::per_minute</a> number of records
108<br>
30Jan2025@11:59:12 (dxdupe) <a class="moz-txt-link-freetext" href="DXDupe::per_minute">DXDupe::per_minute</a> number of records
105<br>
30Jan2025@12:00:12 (dxdupe) <a class="moz-txt-link-freetext" href="DXDupe::per_minute">DXDupe::per_minute</a> number of records
99<br>
30Jan2025@12:01:12 (dxdupe) <a class="moz-txt-link-freetext" href="DXDupe::per_minute">DXDupe::per_minute</a> number of records
99<br>
30Jan2025@12:02:12 (dxdupe) <a class="moz-txt-link-freetext" href="DXDupe::per_minute">DXDupe::per_minute</a> number of records
109<br>
...</font><br>
<br>
Further, just now on my test machine, I have done the same as you:<br>
<br>
<font face="monospace">dx IZ2ABC 7090 test 2<br>
DX de G7BRN: 7090.0 IZ2ABC test 2 15 1946Z
14<br>
G7BRN de GB7TLH 1-Feb-2025 1946Z dxspider ><br>
dx IZ2ABC 7090 test 2<br>
Sorry, this is a duplicate<br>
G7BRN de GB7TLH 1-Feb-2025 1946Z dxspider ><br>
dx IZ2ABC 7090 test 2<br>
Sorry, this is a duplicate<br>
G7BRN de GB7TLH 1-Feb-2025 1946Z dxspider ><br>
</font><br>
So, as far as I am concerned - just now at least - I believe
deduping for spots is working.<br>
<br>
73 Dirk G1TLH<br>
<br>
<br>
</body>
</html>