All errors (PLEASE OPEN NEW THREADS)

Questions and Answers : Bugs : All errors (PLEASE OPEN NEW THREADS)
Message board moderation

To post messages, you must log in.

Previous · 1 . . . 3 · 4 · 5 · 6 · 7 · Next

AuthorMessage
Gunnar Hjern

Send message
Joined: 26 May 22
Posts: 5
Credit: 1,625,961
RAC: 37
Message 497 - Posted: 13 Jul 2022, 12:13:53 UTC - in response to Message 496.  

Yes, this has happened to me too, with nearly 60 validate errors the last 24 hours.
I've PM:ed Christian about it so I know the admins are looking over it right now.
I've paused crunching for the moment but maybe I'll be back when it is all sorted out.
//Gunnar
ID: 497 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Christian Krause
Project administrator

Send message
Joined: 9 May 22
Posts: 199
Credit: 194,242
RAC: 1,826
Message 498 - Posted: 13 Jul 2022, 14:17:17 UTC - in response to Message 497.  

Yes, there is a problem. I’m currently traveling and can’t fix it now. Therefore, I stopped creation of new tasks and canceled existing ones that are not in progress yet.

I’ll publish a new app version with the fixes in 1-2 weeks.
ID: 498 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Christian Krause
Project administrator

Send message
Joined: 9 May 22
Posts: 199
Credit: 194,242
RAC: 1,826
Message 501 - Posted: 22 Jul 2022, 19:09:29 UTC - in response to Message 498.  

App version 220722 is available which includes a fix for the hanging tasks. New workunits are avaiable!
ID: 501 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Conan

Send message
Joined: 13 May 22
Posts: 19
Credit: 411,045
RAC: 5,427
Message 503 - Posted: 23 Jul 2022, 1:33:38 UTC - in response to Message 501.  
Last modified: 23 Jul 2022, 2:19:22 UTC

App version 220722 is available which includes a fix for the hanging tasks. New work units are available!


Sorry Christian but your new application has not helped me.

Just reported 18 work units most run for 2 hours and then get Computation Errors on all work units with "195 Exit Child Failed"

Some only run for a few minutes to 1/2 hour then same failure code.

Conan

OK now up to 26 returned and 100% have failed with 195 Exit Child Failed
I will abort the rest.
Sorry but they only part work and wont complete successfully.
ID: 503 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
shift

Send message
Joined: 14 May 22
Posts: 1
Credit: 78,882
RAC: 306
Message 504 - Posted: 23 Jul 2022, 6:09:18 UTC - in response to Message 501.  

I'm getting the same as Conan

Outcome Computation error
Client state Compute error
Exit status 195 (0x000000C3) EXIT_CHILD_FAILED
ID: 504 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
GolfSierra

Send message
Joined: 24 May 22
Posts: 13
Credit: 2,582,143
RAC: 9,370
Message 505 - Posted: 23 Jul 2022, 10:37:32 UTC - in response to Message 504.  
Last modified: 23 Jul 2022, 10:42:50 UTC

Some WUs failed here, too, but not all of them.

Example:
Name wu_1658516451_742_0
Arbeitspaket 456571
Erstellt 22 Jul 2022, 19:06:05 UTC
Gesendet 22 Jul 2022, 19:15:32 UTC
Ablaufdatum 29 Jul 2022, 19:15:32 UTC
Empfangen 23 Jul 2022, 10:34:48 UTC
Serverstatus Abgeschlossen
Resultat Berechnungsfehler
Clientstatus Berechnungsfehler
Endstatus 195 (0x000000C3) EXIT_CHILD_FAILED
Computer ID 542
Laufzeit 31 min. 33 sek.
CPU Zeit 31 min. 30 sek.
Prüfungsstatus Ungültig
Punkte 0.00
max. FLOPS des Gerätes 5.60 GFLOPS
Anwendungsversion LODA v2207.22
windows_x86_64
Peak working set size 980.47 MB
Peak swap size 1,000.26 MB
Peak disk usage 0.01 MB
ID: 505 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Conan

Send message
Joined: 13 May 22
Posts: 19
Credit: 411,045
RAC: 5,427
Message 506 - Posted: 23 Jul 2022, 11:27:00 UTC
Last modified: 23 Jul 2022, 11:27:42 UTC

Both shift and myself are running Linux and all work units fail.
I checked another persons Windows computer and now GolfSierra has confirmed that a number fail on Windows but most seem to work.

So is there a Linux programming issue that kills all work units?

Conan
ID: 506 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
GolfSierra

Send message
Joined: 24 May 22
Posts: 13
Credit: 2,582,143
RAC: 9,370
Message 507 - Posted: 23 Jul 2022, 12:52:30 UTC - in response to Message 506.  

As of now (23 July 14:50 local time),14 out of 241 WUs of the new version failed. There seems to be no pattern, it just happened to some of the WUs.
ID: 507 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Christian Krause
Project administrator

Send message
Joined: 9 May 22
Posts: 199
Credit: 194,242
RAC: 1,826
Message 508 - Posted: 23 Jul 2022, 14:14:21 UTC - in response to Message 507.  

Can you please check if you find anything unusual in your logs?
https://boinc.loda-lang.org/loda/logs.php
ID: 508 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Conan

Send message
Joined: 13 May 22
Posts: 19
Credit: 411,045
RAC: 5,427
Message 509 - Posted: 23 Jul 2022, 14:51:10 UTC - in response to Message 508.  

Can you please check if you find anything unusual in your logs?
https://boinc.loda-lang.org/loda/logs.php


I can only see a few warnings about getting close to maximum memory use. And the ones that ran to 120 minutes did so without any errors that I can see.

I am sorry but I can't see much that is useful in fault finding in the logs.

I have allowed work fetch again on that computer and might catch something useful but I can't monitor for a while as it is nearly 1 in the morning and I need to go to bed.

thanks
Conan
ID: 509 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Christian Krause
Project administrator

Send message
Joined: 9 May 22
Posts: 199
Credit: 194,242
RAC: 1,826
Message 510 - Posted: 23 Jul 2022, 15:19:39 UTC - in response to Message 509.  

Thanks. I also checked the logs of linux tasks failing after 2h. The logs look ok (include a "Finished mining" message). I'm debugging it now.
ID: 510 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
GolfSierra

Send message
Joined: 24 May 22
Posts: 13
Credit: 2,582,143
RAC: 9,370
Message 511 - Posted: 23 Jul 2022, 16:19:15 UTC - in response to Message 508.  
Last modified: 23 Jul 2022, 16:33:04 UTC

This one is an older one.
The latest WUs that failed looked normal from the data in the log file.
wu_1653998999_63948_0_r722827113_0

2022-06-09 03:59:22|INFO |Starting LODA v22.6.6. See https://loda-lang.org/
2022-06-09 03:59:22|INFO |Platform: windows, user name: GolfSierra
2022-06-09 03:59:22|INFO |Using LODA home directory "C:\ProgramData\BOINC/projects/boinc.loda-lang.org_loda\"
2022-06-09 03:59:22|INFO |Checking environment
2022-06-09 03:59:22|WARN |Setting environment variable: COMSPEC=C:\WINDOWS\system32\cmd.exe
2022-06-09 03:59:22|WARN |Setting environment variable: SYSTEMROOT=C:\WINDOWS
2022-06-09 03:59:22|WARN |Setting environment variable: PATH=C:\WINDOWS\system32;C:\Program Files\Git\cmd;C:\Program Files\Git\usr\bin
2022-06-09 03:59:22|WARN |Setting environment variable: TMP=C:\ProgramData\BOINC/projects/boinc.loda-lang.org_loda\
2022-06-09 03:59:22|WARN |Setting environment variable: TEMP=C:\ProgramData\BOINC/projects/boinc.loda-lang.org_loda\
2022-06-09 03:59:22|INFO |Loading sequences from the OEIS index
2022-06-09 03:59:27|INFO |Loaded 333358/354372 sequences in 4.83s
2022-06-09 03:59:29|WARN |Recursion detected in stats for C:\ProgramData\BOINC/projects/boinc.loda-lang.org_loda\programs\oeis\000\A000143.asm
2022-06-09 03:59:30|WARN |Recursion detected in stats for C:\ProgramData\BOINC/projects/boinc.loda-lang.org_loda\programs\oeis\018\A018836.asm
2022-06-09 03:59:30|WARN |Recursion detected in stats for C:\ProgramData\BOINC/projects/boinc.loda-lang.org_loda\programs\oeis\018\A018842.asm
2022-06-09 03:59:30|WARN |Recursion detected in stats for C:\ProgramData\BOINC/projects/boinc.loda-lang.org_loda\programs\oeis\025\A025861.asm
2022-06-09 03:59:30|WARN |Recursion detected in stats for C:\ProgramData\BOINC/projects/boinc.loda-lang.org_loda\programs\oeis\025\A025863.asm
2022-06-09 03:59:30|WARN |Recursion detected in stats for C:\ProgramData\BOINC/projects/boinc.loda-lang.org_loda\programs\oeis\025\A025910.asm
2022-06-09 03:59:30|WARN |Recursion detected in stats for C:\ProgramData\BOINC/projects/boinc.loda-lang.org_loda\programs\oeis\025\A025897.asm
2022-06-09 03:59:30|WARN |Recursion detected in stats for C:\ProgramData\BOINC/projects/boinc.loda-lang.org_loda\programs\oeis\025\A025922.asm
2022-06-09 03:59:30|WARN |Recursion detected in stats for C:\ProgramData\BOINC/projects/boinc.loda-lang.org_loda\programs\oeis\029\A029066.asm
2022-06-09 03:59:30|WARN |Recursion detected in stats for C:\ProgramData\BOINC/projects/boinc.loda-lang.org_loda\programs\oeis\029\A029068.asm
2022-06-09 03:59:30|WARN |Recursion detected in stats for C:\ProgramData\BOINC/projects/boinc.loda-lang.org_loda\programs\oeis\029\A029106.asm
2022-06-09 03:59:30|WARN |Recursion detected in stats for C:\ProgramData\BOINC/projects/boinc.loda-lang.org_loda\programs\oeis\029\A029119.asm
2022-06-09 03:59:30|WARN |Recursion detected in stats for C:\ProgramData\BOINC/projects/boinc.loda-lang.org_loda\programs\oeis\045\A045145.asm
2022-06-09 03:59:31|WARN |Recursion detected in stats for C:\ProgramData\BOINC/projects/boinc.loda-lang.org_loda\programs\oeis\098\A098389.asm
2022-06-09 03:59:35|WARN |Recursion detected in stats for C:\ProgramData\BOINC/projects/boinc.loda-lang.org_loda\programs\oeis\247\A247287.asm
2022-06-09 03:59:35|WARN |Recursion detected in stats for C:\ProgramData\BOINC/projects/boinc.loda-lang.org_loda\programs\oeis\280\A280258.asm
2022-06-09 03:59:35|WARN |Recursion detected in stats for C:\ProgramData\BOINC/projects/boinc.loda-lang.org_loda\programs\oeis\280\A280259.asm
2022-06-09 03:59:35|WARN |Recursion detected in stats for C:\ProgramData\BOINC/projects/boinc.loda-lang.org_loda\programs\oeis\285\A285811.asm
2022-06-09 03:59:37|WARN |Recursion detected in stats for C:\ProgramData\BOINC/projects/boinc.loda-lang.org_loda\programs\oeis\341\A341397.asm
2022-06-09 03:59:37|INFO |Initialized 5 matchers (ignoring 67936 sequences)
2022-06-09 03:59:37|INFO |Initialized 4 generators (profile: update, overwrite: auto)
2022-06-09 03:59:37|INFO |Mining programs in client mode (extended validation mode)
2022-06-09 03:59:50|INFO |Fetched http://api.loda-lang.org/miner/v1/oeis/b018003.txt.gz
ID: 511 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Christian Krause
Project administrator

Send message
Joined: 9 May 22
Posts: 199
Credit: 194,242
RAC: 1,826
Message 512 - Posted: 23 Jul 2022, 19:00:51 UTC - in response to Message 511.  

I found two bugs:
1) An arithmetic exception that can happen sporadically on all platforms. This is fixed now and tested.
2) A crash on some Linux platforms that happens after the mining finished already successfully. I have fixed it but we don't have a confirmation yet that it works on all Linux versions.

The new app version 220723 with the bug fixes is available now. We'll monitor new tasks to make sure it's ok now.
ID: 512 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Conan

Send message
Joined: 13 May 22
Posts: 19
Credit: 411,045
RAC: 5,427
Message 514 - Posted: 23 Jul 2022, 23:46:15 UTC

Thanks Christian, I now have successful tasks running and finishing on my computers now.

Much appreciated for your quick response to this issue.

Conan
ID: 514 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Gunnar Hjern

Send message
Joined: 26 May 22
Posts: 5
Credit: 1,625,961
RAC: 37
Message 518 - Posted: 25 Jul 2022, 23:00:39 UTC - in response to Message 512.  

Hi Christian!
I've completed 291 tasks with the new app version so far and not a single error or invalid yet!
Very well done!!!
My machines all run Ubuntu Linux 18.04 or 20.04 - see below.
Kindest regards,
Gunnar

I use two kinds of OS / libc on the machines I have running now:
Ubuntu 18.04.2 LTS [5.4.0-80-generic|libc 2.27 (Ubuntu GLIBC 2.27-3ubuntu1.2)] , and
Ubuntu 20.04.4 LTS [5.4.0-109-generic|libc 2.31 (Ubuntu GLIBC 2.31-0ubuntu9.7)]
ID: 518 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Gunnar Hjern

Send message
Joined: 26 May 22
Posts: 5
Credit: 1,625,961
RAC: 37
Message 526 - Posted: 28 Jul 2022, 20:57:22 UTC - in response to Message 518.  

Hi!
I'm now well over 1000 tasks with the new app and only encountered two errors and one invalid so far! :-)
(The invalid one is definitely due to one of my computers crashing from lack of memory, and I suspect that the two errors also could be due to computer malfunction.)
I have seen that some tasks (less than 1%) takes unusually long time to process. It seems that they reach the time limit of 10 hours. They are however not reported as errors or invalids, but instead accepted and credited according to the time they took.
Links to the invalid, the two errors and to five of the long tasks are attached below.
Have a nice week and weekend!!!
//Gunnar


invalid (computer crash):
https://boinc.loda-lang.org/loda/result.php?resultid=782455

errors:
https://boinc.loda-lang.org/loda/result.php?resultid=783022
https://boinc.loda-lang.org/loda/result.php?resultid=783062

long tasks:
https://boinc.loda-lang.org/loda/result.php?resultid=793483
https://boinc.loda-lang.org/loda/result.php?resultid=786385
https://boinc.loda-lang.org/loda/result.php?resultid=783528
https://boinc.loda-lang.org/loda/result.php?resultid=781510
https://boinc.loda-lang.org/loda/result.php?resultid=776992
ID: 526 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Dr Who Fan
Avatar

Send message
Joined: 13 May 22
Posts: 30
Credit: 102,311
RAC: 658
Message 527 - Posted: 16 Aug 2022, 3:17:20 UTC

ONE PC has had 4 tasks fail in a row. All have short run times
In the server error log they all have the SAME error message at end: fatal: your current branch appears to be broken
wu_1660327386_14035_0_r321630_0 / Task 943775
wu_1660327386_19849_0_r544343583_0 / Task 951047
wu_1660327386_19530_1_r1268663908_0 / Task 951254
wu_1660327386_20349_0_r573406346_0 / Task 951593

and one one more task that error-ed out with a low run time which I can't find a corresponding error log on the server:
Task 950468 / Name wu_1660327386_19361_0

ID: 527 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Dr Who Fan
Avatar

Send message
Joined: 13 May 22
Posts: 30
Credit: 102,311
RAC: 658
Message 528 - Posted: 16 Aug 2022, 13:21:47 UTC - in response to Message 527.  

Now have several more error-ed task on that pc but DIFFERENT MESSAGES in the server logs:
|ERROR|Error parsing C:\BOINCData/projects/boinc.loda-lang.org_loda\programs\oeis\211\A211640.asm: invalid identifier

fatal: your current branch appears to be broken

|ERROR|Error executing command (exit code 128): git -C "C:\BOINCData/projects/boinc.loda-lang.org_loda\programs" log --oneline --format="%H" -n 100 > "C:\BOINCData\projects\boinc.loda-lang.org_loda\loda_git_tmp.txt"

I have stopped running the project on that pc until I get some anwsers what is wrong and how to maybe fix it.

ID: 528 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Christian Krause
Project administrator

Send message
Joined: 9 May 22
Posts: 199
Credit: 194,242
RAC: 1,826
Message 529 - Posted: 16 Aug 2022, 19:05:20 UTC - in response to Message 528.  

Hi Dr Who Fan,
the error is on host 289. Can you please stop all tasks on that host and delete the programs folder by running these commands?
cd C:\BOINCData/projects/boinc.loda-lang.org_loda
rmdir /s programs

After that, you can restart the tasks and should recreate the folder.
ID: 529 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Dr Who Fan
Avatar

Send message
Joined: 13 May 22
Posts: 30
Credit: 102,311
RAC: 658
Message 530 - Posted: 17 Aug 2022, 5:53:11 UTC - in response to Message 529.  

Christian, Thank You. That seems to have done the trick, have task running right now.

ID: 530 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Previous · 1 . . . 3 · 4 · 5 · 6 · 7 · Next

Questions and Answers : Bugs : All errors (PLEASE OPEN NEW THREADS)

©2022 LODA Language