[Dxspider-support] Mojo Conversion, root of my troubles..

Mon Dec 6 21:04:45 GMT 2021

    Hello Dirk,

  I will send you a private email in a couple minutes, that will contain 
the info you requested.   Apparmor, that is what I was trying to think 
of as selinux kept cropping up in my mind.    I disabled it, and even 
removed the apparmor package, it's no longer showing in dmesg, but same 
error.  Not sure how I made this more complex than others, I just 
created a current Ubuntu VM and let it roll.

Should be no VM/disk limiting, and the storage is an attached SAS array 
and should be quite quick, or seems to be.

---
Howard Leadmon - WB3FFV
PBW Communications, LLC
http://www.pbwcomm.com

On 12/6/2021 3:30 PM, Dirk Koopman via Dxspider-support wrote:
> Can you give me ssh access to a sudo account? You can whatsapp/signal 
> me on +44 7973 333306 or on faceache messenger.
>
> But first do: sudo dmesg
>
> and check for sillynesses.
>
> You *should* have the old users.v3 file left in place, as well as (a) 
> user_asc. You can replace it with any users.v3, if it gone or is 
> corrupted. Just run update_sysop.pl on it before you start again. I 
> can supply you with one.
>
> But I now strongly believe that there is auth/apparmor issue (or dare 
> I say this some kind of VM disk I/O rate limiting) happening here.
>
> These errors are completely new to me. They are not anything to do 
> with the software which does nothing "clever" - or least - not in my 
> stuff. None of these errors happen on machines I have control over. I 
> was going to say that no-one has reported weird problems like this - 
> except one: WA9PIE-2. He was running on Google VMs and there was all 
> sorts of file corruptions going on - and yet, as a far as his users 
> went - it was still working well enough for them to (largely) not 
> notice. It turned out that the particular VDisk choices he had made 
> was producing more IO than the $30/month VM could handle.
>
> I put it DO's smallest droplet and it has been running (with up to 
> 1200 user) with no problems for over 2 years now.
>
> Dirk
>
> On 06/12/2021 19:37, Howard Leadmon via Dxspider-support wrote:
>>  Not sure if the way I did this is causing me grief or what, but this 
>> is not being painless by any means.
>>
>>  Instead of converting my node (WB3FFV-2) to Mojo, I backed it up and 
>> setup a new site and called it WB3FFV-3.  I just restored all the 
>> files to the new server, and let it start and run it's conversion.   
>>   What I missed, is the user file conversion is failing, and the site 
>> is starting up like it's a brand new node. New install is alive and 
>> going, but no users at all on the sucker, no wonder all the 
>> registered users are gone.
>>
>>  So I went back and ran the conversion again paying close attention, 
>> and sure enough, it fails the conversion.
>>
>>
>> Here is an attempted start without the new versions of the user files:
>>
>> (*) Perl path: 
>> .:/spider/local:/spider/perl:/spider/perl5lib:/spider/perl5lib/lib/perl5/5.30.0/x86_64-linux-gnu-thread-multi:/spider/perl5lib/lie
>> (*) DXSpider V1.57, build 364 (git: mojo/cafedfc0[r]) started
>> (*) Copyright (c) 1998-2021 Dirk Koopman G1TLH
>> (*) loading prefixes ...
>> (*) US Database loaded
>> (*) loading band data ...
>> (*) loading user file system ...
>> (*) New User File version /spider/local_data/users.v3j does not 
>> exist, running conversion from users.v3 or v2, please wait
>> using /spider/local_data/users.v3j for output
>> Converting the User from V3 format to users.v3j
>> This will take a while, maybe as much as 30 secs on very slow disks 
>> and/or machines
>> can't open user file: users.v3 (Inappropriate ioctl for device) 
>> [rebuild it from user_asc?] at 
>> /spider/perl/convert-users-v3-to-v3j.pl line 84.
>> (*) Exported users to /spider/local_data/user_json - 0 Users 0 
>> Deleted 0 Errors in 1 mS ('sh/log Export' for details)
>> (*) WB3FFV-2 missing, run the create_sysop.pl script and please RTFM 
>> at perl/cluster.pl line 584.
>> (*)  at perl/cluster.pl line 584.
>> (*)     main::setup_start() called at perl/cluster.pl line 829
>> WB3FFV-2 missing, run the create_sysop.pl script and please RTFM at 
>> perl/cluster.pl line 584
>>
>>
>>  Needless to say, the WB3FFV-2 missing, is because there are 0 users, 
>> the file did not convert in.   What I am not able to nail down is the 
>> error of "Inappropriate ioctl for device".  I have checked 
>> permissions, the files are r/w for the sysop user, I even created 
>> test files to be sure.
>>
>> I thought OK, let's run the user_asc file, but it fails saying it 
>> wants me to rebuild from user_json, which of course works but has 0 
>> users, hence back to square one.
>>
>> $ perl data/user_asc
>> (trace) can't open user file: users (Permission denied) [rebuild it 
>> from user_json?]
>> (trace) Stack (2): DXDebug::confess in /spider/perl/DXUser.pm line: 154
>> (trace) Stack (3): DXUser::init in data/user_asc line: 45
>>
>>
>>  So at the moment, the code is there and will run, but with 
>> everything lost.   Trying to sort out how to get all my users back 
>> into the new node so it can replace the old one eventually.   Also 
>> would changing the name on the new node to WB3FFV-3 cause any of 
>> this, doesn't seem like it should..
>>
>> Any help most appreciated, as I am scratching my head currently..
>>
>>
>> 73's...
>>
>>
>> ---
>> Howard Leadmon - WB3FFV
>> PBW Communications, LLC
>> http://www.pbwcomm.com
>>
>>
>> _______________________________________________
>> Dxspider-support mailing list
>> Dxspider-support at tobit.co.uk
>> https://mailman.tobit.co.uk/mailman/listinfo/dxspider-support
>
>
> _______________________________________________
> Dxspider-support mailing list
> Dxspider-support at tobit.co.uk
> https://mailman.tobit.co.uk/mailman/listinfo/dxspider-support