[Dxspider-support] Help please! user_json is 13Gb!

[Dirk Koopman]

keep the .keep file, it's there for a reason.


On 07/12/2022 11:30, Keith Maton via Dxspider-support wrote:
> Ahh, our emails crossed.
>
> Here’s my .v3j file.  I’ll blitz all the user_json files now.
>
> -rwxrwxr-x 1 sysop spider 8.0M Dec  7 11:28 *users.v3j*
>
> *
> *
>
> *
> *
>
>> On 7 Dec 2022, at 11:25, Dirk Koopman via Dxspider-support 
>> <dxspider-support at tobit.co.uk> wrote:
>>
>> I'm struggling to understand why your user_json files (any of them) 
>> are more than a few tens of MB. My reference site GB7DJK looks like this:
>>
>> -rw-rw-r--  1 sysop spider  50M Dec  7 02:30 user_json
>> -rw-rw-r--  1 sysop spider  48M Dec  7 02:30 user_json.backstop
>> -rw-rw-r--  1 sysop spider  29M Jan 24  2022 user_json.keep
>> -rw-rw-r--  1 sysop spider  50M Nov 30 02:30 user_json.o
>> -rw-rw-r--  1 sysop spider  49M Nov 23 02:30 user_json.oo
>> -rw-rw-r--  1 sysop spider  49M Nov 16 02:30 user_json.ooo
>> -rw-rw-r--  1 sysop spider  49M Nov  9 02:30 user_json.oooo
>> -rw-rw-r--  1 sysop spider  48M Nov  2 02:30 user_json.ooooo
>>
>> -rw-rw-r--  1 sysop spider  81M Dec  7 11:17 users.v3j
>>
>> And remember, this site has been on 24hrs / day since about 1998.
>>
>> WA9PIE-2's data is a bit bigger as he has more users and more 
>> connections:
>>
>> -rw-rw-r-- 1 sysop sysop  64M Dec  7 02:30 user_json
>> -rw-rw-r-- 1 sysop sysop  62M Dec  7 02:30 user_json.backstop
>> -rw-rw-r-- 1 sysop sysop  49M Jan 12  2022 user_json.keep
>> -rw-rw-r-- 1 sysop sysop  64M Nov 30 02:30 user_json.o
>> -rw-rw-r-- 1 sysop sysop  63M Nov 23 02:30 user_json.oo
>> -rw-rw-r-- 1 sysop sysop  63M Nov 16 02:30 user_json.ooo
>> -rw-rw-r-- 1 sysop sysop  62M Nov  9 02:30 user_json.oooo
>> -rw-rw-r-- 1 sysop sysop  62M Nov  2 02:30 user_json.ooooo
>>
>> -rw-rw-r-- 1 sysop sysop 114M Dec  7 11:19 users.v3j
>>
>> You can remove any user_json file and you don't need to restart. They 
>> are just backups of users.v3j. The user_json files are there to allow 
>> you to restore the users.v3j file.
>>
>> So how big is your users.v3j file?
>>
>> Dirk G1TLH
>>
>>
>> On 07/12/2022 10:08, Keith Maton via Dxspider-support wrote:
>>> Right, I stand corrected.  It’s the user_json.o file that’s 13Gb.
>>>
>>> -rw-rw-r-- 1 sysop spider 121704448 Dec  7 10:01 user_json
>>> -rw-rw-r-- 1 sysop spider   2838642 Dec  7 02:30 user_json.keep
>>> -rw-rw-r-- 1 sysop spider 13067960320 Dec  7 08:29 user_json.o
>>> -rwxrwxr-x 1 sysop spider   2838642 Dec  4 09:48 *user_json.oo*
>>>
>>>> On 7 Dec 2022, at 09:32, Joaquin via Dxspider-support 
>>>> <dxspider-support at tobit.co.uk> wrote:
>>>>
>>>> Sorry, I don't know why I didn't read about the user_json file.
>>>> Do an export_user, remove the 13GB one, and reboot.
>>>>
>>>> Kin
>>>>
>>>> El 07/12/2022 a las 10:29, Joaquin via Dxspider-support escribió:
>>>>>
>>>>> Keith,
>>>>>
>>>>> Look to see what you have defined in debug: *sh/debug*, you also 
>>>>> have many traces and you can reduce them with *unset/debug*.
>>>>> Or you can limit the number of log files if your FS is small.
>>>>>
>>>>> Kin
>>>>>
>>>>>
>>>>> El 07/12/2022 a las 10:23, Keith Maton via Dxspider-support escribió:
>>>>>> I spoke too soon.
>>>>>>
>>>>>> Woke up this morning to a crashed node, the Pi was still running but when I tried to connect externally to the node, I had no response, when I logged on and issued a /spider/perl/console.pl command, I just had a grey screen.  I’ve checked the debug log and it fell over at 02:29:47 this morning.  The last entry in the debug log is just a normal spot.
>>>>>>
>>>>>> I successfully rebooted and it’s all running but I have PRTG monitoring and I just got pinged for low disk space.
>>>>>>
>>>>>> When I check, my /local_data/user_json file has grown to 13Gb.
>>>>>>
>>>>>> Any idea what’s caused this?  Can I just stop the node, delete the file and restart?  I suspect with less than 50Mb disk space, it’s going to crash soon anyway.
>>>>>
>>>>> _______________________________________________
>>>>> Dxspider-support mailing list
>>>>> Dxspider-support at tobit.co.uk
>>>>> https://mailman.tobit.co.uk/mailman/listinfo/dxspider-support
>>>> _______________________________________________
>>>> Dxspider-support mailing list
>>>> Dxspider-support at tobit.co.uk
>>>> https://mailman.tobit.co.uk/mailman/listinfo/dxspider-support
>>>
>>>
>>> _______________________________________________
>>> Dxspider-support mailing list
>>> Dxspider-support at tobit.co.uk
>>> https://mailman.tobit.co.uk/mailman/listinfo/dxspider-support
>>
>> _______________________________________________
>> Dxspider-support mailing list
>> Dxspider-support at tobit.co.uk
>> https://mailman.tobit.co.uk/mailman/listinfo/dxspider-support
>
>
> _______________________________________________
> Dxspider-support mailing list
> Dxspider-support at tobit.co.uk
> https://mailman.tobit.co.uk/mailman/listinfo/dxspider-support
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://mailman.tobit.co.uk/pipermail/dxspider-support/attachments/20221207/bbea7ff2/attachment.htm>