[Dxspider-support] Help please! user_json is 13Gb!

[Dirk Koopman]

Did you upgrade from an 1.55 (master branch) installation?

On 07/12/2022 11:35, Keith Maton via Dxspider-support wrote:
> Arse, too late :-(
>
> Sorry.
>
> Is this part of the important magic that happens in the early hours of 
> Wednesday mornings?
>
>
>
>> On 7 Dec 2022, at 11:32, Dirk Koopman via Dxspider-support 
>> <dxspider-support at tobit.co.uk> wrote:
>>
>> keep the .keep file, it's there for a reason.
>>
>>
>> On 07/12/2022 11:30, Keith Maton via Dxspider-support wrote:
>>> Ahh, our emails crossed.
>>>
>>> Here’s my .v3j file.  I’ll blitz all the user_json files now.
>>>
>>> -rwxrwxr-x 1 sysop spider 8.0M Dec  7 11:28 *users.v3j*
>>> *
>>> *
>>>
>>> *
>>> *
>>>
>>>> On 7 Dec 2022, at 11:25, Dirk Koopman via Dxspider-support 
>>>> <dxspider-support at tobit.co.uk> wrote:
>>>>
>>>> I'm struggling to understand why your user_json files (any of them) 
>>>> are more than a few tens of MB. My reference site GB7DJK looks like 
>>>> this:
>>>>
>>>> -rw-rw-r--  1 sysop spider  50M Dec  7 02:30 user_json
>>>> -rw-rw-r--  1 sysop spider  48M Dec  7 02:30 user_json.backstop
>>>> -rw-rw-r--  1 sysop spider  29M Jan 24 2022 user_json.keep
>>>> -rw-rw-r--  1 sysop spider  50M Nov 30 02:30 user_json.o
>>>> -rw-rw-r--  1 sysop spider  49M Nov 23 02:30 user_json.oo
>>>> -rw-rw-r--  1 sysop spider  49M Nov 16 02:30 user_json.ooo
>>>> -rw-rw-r--  1 sysop spider  49M Nov  9 02:30 user_json.oooo
>>>> -rw-rw-r--  1 sysop spider  48M Nov  2 02:30 user_json.ooooo
>>>>
>>>> -rw-rw-r--  1 sysop spider  81M Dec  7 11:17 users.v3j
>>>>
>>>> And remember, this site has been on 24hrs / day since about 1998.
>>>>
>>>> WA9PIE-2's data is a bit bigger as he has more users and more 
>>>> connections:
>>>>
>>>> -rw-rw-r-- 1 sysop sysop  64M Dec  7 02:30 user_json
>>>> -rw-rw-r-- 1 sysop sysop  62M Dec  7 02:30 user_json.backstop
>>>> -rw-rw-r-- 1 sysop sysop  49M Jan 12 2022 user_json.keep
>>>> -rw-rw-r-- 1 sysop sysop  64M Nov 30 02:30 user_json.o
>>>> -rw-rw-r-- 1 sysop sysop  63M Nov 23 02:30 user_json.oo
>>>> -rw-rw-r-- 1 sysop sysop  63M Nov 16 02:30 user_json.ooo
>>>> -rw-rw-r-- 1 sysop sysop  62M Nov  9 02:30 user_json.oooo
>>>> -rw-rw-r-- 1 sysop sysop  62M Nov  2 02:30 user_json.ooooo
>>>>
>>>> -rw-rw-r-- 1 sysop sysop 114M Dec  7 11:19 users.v3j
>>>>
>>>> You can remove any user_json file and you don't need to restart. 
>>>> They are just backups of users.v3j. The user_json files are there 
>>>> to allow you to restore the users.v3j file.
>>>>
>>>> So how big is your users.v3j file?
>>>>
>>>> Dirk G1TLH
>>>>
>>>>
>>>> On 07/12/2022 10:08, Keith Maton via Dxspider-support wrote:
>>>>> Right, I stand corrected.  It’s the user_json.o file that’s 13Gb.
>>>>>
>>>>> -rw-rw-r-- 1 sysop spider   121704448 Dec  7 10:01 user_json
>>>>> -rw-rw-r-- 1 sysop spider     2838642 Dec  7 02:30 user_json.keep
>>>>> -rw-rw-r-- 1 sysop spider 13067960320 Dec  7 08:29 user_json.o
>>>>> -rwxrwxr-x 1 sysop spider     2838642 Dec  4 09:48 *user_json.oo*
>>>>>
>>>>>> On 7 Dec 2022, at 09:32, Joaquin via Dxspider-support 
>>>>>> <dxspider-support at tobit.co.uk> wrote:
>>>>>>
>>>>>> Sorry, I don't know why I didn't read about the user_json file.
>>>>>> Do an export_user, remove the 13GB one, and reboot.
>>>>>>
>>>>>> Kin
>>>>>>
>>>>>> El 07/12/2022 a las 10:29, Joaquin via Dxspider-support escribió:
>>>>>>>
>>>>>>> Keith,
>>>>>>>
>>>>>>> Look to see what you have defined in debug: *sh/debug*, you also 
>>>>>>> have many traces and you can reduce them with *unset/debug*.
>>>>>>> Or you can limit the number of log files if your FS is small.
>>>>>>>
>>>>>>> Kin
>>>>>>>
>>>>>>>
>>>>>>> El 07/12/2022 a las 10:23, Keith Maton via Dxspider-support 
>>>>>>> escribió:
>>>>>>>> I spoke too soon.
>>>>>>>>
>>>>>>>> Woke up this morning to a crashed node, the Pi was still running but when I tried to connect externally to the node, I had no response, when I logged on and issued a /spider/perl/console.pl command, I just had a grey screen.  I’ve checked the debug log and it fell over at 02:29:47 this morning.  The last entry in the debug log is just a normal spot.
>>>>>>>>
>>>>>>>> I successfully rebooted and it’s all running but I have PRTG monitoring and I just got pinged for low disk space.
>>>>>>>>
>>>>>>>> When I check, my /local_data/user_json file has grown to 13Gb.
>>>>>>>>
>>>>>>>> Any idea what’s caused this?  Can I just stop the node, delete the file and restart?  I suspect with less than 50Mb disk space, it’s going to crash soon anyway.
>>>>>>>
>>>>>>> _______________________________________________
>>>>>>> Dxspider-support mailing list
>>>>>>> Dxspider-support at tobit.co.uk
>>>>>>> https://mailman.tobit.co.uk/mailman/listinfo/dxspider-support
>>>>>> _______________________________________________
>>>>>> Dxspider-support mailing list
>>>>>> Dxspider-support at tobit.co.uk
>>>>>> https://mailman.tobit.co.uk/mailman/listinfo/dxspider-support
>>>>>
>>>>>
>>>>> _______________________________________________
>>>>> Dxspider-support mailing list
>>>>> Dxspider-support at tobit.co.uk
>>>>> https://mailman.tobit.co.uk/mailman/listinfo/dxspider-support
>>>>
>>>> _______________________________________________
>>>> Dxspider-support mailing list
>>>> Dxspider-support at tobit.co.uk
>>>> https://mailman.tobit.co.uk/mailman/listinfo/dxspider-support
>>>
>>>
>>> _______________________________________________
>>> Dxspider-support mailing list
>>> Dxspider-support at tobit.co.uk
>>> https://mailman.tobit.co.uk/mailman/listinfo/dxspider-support
>>
>> _______________________________________________
>> Dxspider-support mailing list
>> Dxspider-support at tobit.co.uk
>> https://mailman.tobit.co.uk/mailman/listinfo/dxspider-support
>
>
> _______________________________________________
> Dxspider-support mailing list
> Dxspider-support at tobit.co.uk
> https://mailman.tobit.co.uk/mailman/listinfo/dxspider-support
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://mailman.tobit.co.uk/pipermail/dxspider-support/attachments/20221207/79e1d1e9/attachment.htm>