Yes, this has happened to me too, with nearly 60 validate errors the last 24 hours.
I've PM:ed Christian about it so I know the admins are looking over it right now.
I've paused crunching for the moment but maybe I'll be back when it is all sorted out.
//Gunnar

Yes, there is a problem. I’m currently traveling and can’t fix it now. Therefore, I stopped creation of new tasks and canceled existing ones that are not in progress yet.

I’ll publish a new app version with the fixes in 1-2 weeks.

App version 220722 is available which includes a fix for the hanging tasks. New workunits are avaiable!

App version 220722 is available which includes a fix for the hanging tasks. New work units are available!

Sorry Christian but your new application has not helped me.

Just reported 18 work units most run for 2 hours and then get Computation Errors on all work units with "195 Exit Child Failed"

Some only run for a few minutes to 1/2 hour then same failure code.

Conan

OK now up to 26 returned and 100% have failed with 195 Exit Child Failed
I will abort the rest.
Sorry but they only part work and wont complete successfully.

I'm getting the same as Conan

Outcome Computation error
Client state Compute error
Exit status 195 (0x000000C3) EXIT_CHILD_FAILED

---

Some WUs failed here, too, but not all of them.

Example:
Name wu_1658516451_742_0
Arbeitspaket 456571
Erstellt 22 Jul 2022, 19:06:05 UTC
Gesendet 22 Jul 2022, 19:15:32 UTC
Ablaufdatum 29 Jul 2022, 19:15:32 UTC
Empfangen 23 Jul 2022, 10:34:48 UTC
Serverstatus Abgeschlossen
Resultat Berechnungsfehler
Clientstatus Berechnungsfehler
Endstatus 195 (0x000000C3) EXIT_CHILD_FAILED
Computer ID 542
Laufzeit 31 min. 33 sek.
CPU Zeit 31 min. 30 sek.
Prüfungsstatus Ungültig
Punkte 0.00
max. FLOPS des Gerätes 5.60 GFLOPS
Anwendungsversion LODA v2207.22
windows_x86_64
Peak working set size 980.47 MB
Peak swap size 1,000.26 MB
Peak disk usage 0.01 MB

Both shift and myself are running Linux and all work units fail.
I checked another persons Windows computer and now GolfSierra has confirmed that a number fail on Windows but most seem to work.

So is there a Linux programming issue that kills all work units?

Conan

As of now (23 July 14:50 local time),14 out of 241 WUs of the new version failed. There seems to be no pattern, it just happened to some of the WUs.

Can you please check if you find anything unusual in your logs?
https://boinc.loda-lang.org/loda/logs.php

Can you please check if you find anything unusual in your logs?
https://boinc.loda-lang.org/loda/logs.php

I can only see a few warnings about getting close to maximum memory use. And the ones that ran to 120 minutes did so without any errors that I can see.

I am sorry but I can't see much that is useful in fault finding in the logs.

I have allowed work fetch again on that computer and might catch something useful but I can't monitor for a while as it is nearly 1 in the morning and I need to go to bed.

thanks
Conan

Thanks. I also checked the logs of linux tasks failing after 2h. The logs look ok (include a "Finished mining" message). I'm debugging it now.

This one is an older one.
The latest WUs that failed looked normal from the data in the log file.
wu_1653998999_63948_0_r722827113_0

2022-06-09 03:59:22|INFO |Starting LODA v22.6.6. See https://loda-lang.org/
2022-06-09 03:59:22|INFO |Platform: windows, user name: GolfSierra
2022-06-09 03:59:22|INFO |Using LODA home directory "C:\ProgramData\BOINC/projects/boinc.loda-lang.org_loda\"
2022-06-09 03:59:22|INFO |Checking environment
2022-06-09 03:59:22|WARN |Setting environment variable: COMSPEC=C:\WINDOWS\system32\cmd.exe
2022-06-09 03:59:22|WARN |Setting environment variable: SYSTEMROOT=C:\WINDOWS
2022-06-09 03:59:22|WARN |Setting environment variable: PATH=C:\WINDOWS\system32;C:\Program Files\Git\cmd;C:\Program Files\Git\usr\bin
2022-06-09 03:59:22|WARN |Setting environment variable: TMP=C:\ProgramData\BOINC/projects/boinc.loda-lang.org_loda\
2022-06-09 03:59:22|WARN |Setting environment variable: TEMP=C:\ProgramData\BOINC/projects/boinc.loda-lang.org_loda\
2022-06-09 03:59:22|INFO |Loading sequences from the OEIS index
2022-06-09 03:59:27|INFO |Loaded 333358/354372 sequences in 4.83s
2022-06-09 03:59:29|WARN |Recursion detected in stats for C:\ProgramData\BOINC/projects/boinc.loda-lang.org_loda\programs\oeis\000\A000143.asm
2022-06-09 03:59:30|WARN |Recursion detected in stats for C:\ProgramData\BOINC/projects/boinc.loda-lang.org_loda\programs\oeis\018\A018836.asm
2022-06-09 03:59:30|WARN |Recursion detected in stats for C:\ProgramData\BOINC/projects/boinc.loda-lang.org_loda\programs\oeis\018\A018842.asm
2022-06-09 03:59:30|WARN |Recursion detected in stats for C:\ProgramData\BOINC/projects/boinc.loda-lang.org_loda\programs\oeis\025\A025861.asm
2022-06-09 03:59:30|WARN |Recursion detected in stats for C:\ProgramData\BOINC/projects/boinc.loda-lang.org_loda\programs\oeis\025\A025863.asm
2022-06-09 03:59:30|WARN |Recursion detected in stats for C:\ProgramData\BOINC/projects/boinc.loda-lang.org_loda\programs\oeis\025\A025910.asm
2022-06-09 03:59:30|WARN |Recursion detected in stats for C:\ProgramData\BOINC/projects/boinc.loda-lang.org_loda\programs\oeis\025\A025897.asm
2022-06-09 03:59:30|WARN |Recursion detected in stats for C:\ProgramData\BOINC/projects/boinc.loda-lang.org_loda\programs\oeis\025\A025922.asm
2022-06-09 03:59:30|WARN |Recursion detected in stats for C:\ProgramData\BOINC/projects/boinc.loda-lang.org_loda\programs\oeis\029\A029066.asm
2022-06-09 03:59:30|WARN |Recursion detected in stats for C:\ProgramData\BOINC/projects/boinc.loda-lang.org_loda\programs\oeis\029\A029068.asm
2022-06-09 03:59:30|WARN |Recursion detected in stats for C:\ProgramData\BOINC/projects/boinc.loda-lang.org_loda\programs\oeis\029\A029106.asm
2022-06-09 03:59:30|WARN |Recursion detected in stats for C:\ProgramData\BOINC/projects/boinc.loda-lang.org_loda\programs\oeis\029\A029119.asm
2022-06-09 03:59:30|WARN |Recursion detected in stats for C:\ProgramData\BOINC/projects/boinc.loda-lang.org_loda\programs\oeis\045\A045145.asm
2022-06-09 03:59:31|WARN |Recursion detected in stats for C:\ProgramData\BOINC/projects/boinc.loda-lang.org_loda\programs\oeis\098\A098389.asm
2022-06-09 03:59:35|WARN |Recursion detected in stats for C:\ProgramData\BOINC/projects/boinc.loda-lang.org_loda\programs\oeis\247\A247287.asm
2022-06-09 03:59:35|WARN |Recursion detected in stats for C:\ProgramData\BOINC/projects/boinc.loda-lang.org_loda\programs\oeis\280\A280258.asm
2022-06-09 03:59:35|WARN |Recursion detected in stats for C:\ProgramData\BOINC/projects/boinc.loda-lang.org_loda\programs\oeis\280\A280259.asm
2022-06-09 03:59:35|WARN |Recursion detected in stats for C:\ProgramData\BOINC/projects/boinc.loda-lang.org_loda\programs\oeis\285\A285811.asm
2022-06-09 03:59:37|WARN |Recursion detected in stats for C:\ProgramData\BOINC/projects/boinc.loda-lang.org_loda\programs\oeis\341\A341397.asm
2022-06-09 03:59:37|INFO |Initialized 5 matchers (ignoring 67936 sequences)
2022-06-09 03:59:37|INFO |Initialized 4 generators (profile: update, overwrite: auto)
2022-06-09 03:59:37|INFO |Mining programs in client mode (extended validation mode)
2022-06-09 03:59:50|INFO |Fetched http://api.loda-lang.org/miner/v1/oeis/b018003.txt.gz

I found two bugs:
1) An arithmetic exception that can happen sporadically on all platforms. This is fixed now and tested.
2) A crash on some Linux platforms that happens after the mining finished already successfully. I have fixed it but we don't have a confirmation yet that it works on all Linux versions.

The new app version 220723 with the bug fixes is available now. We'll monitor new tasks to make sure it's ok now.

Thanks Christian, I now have successful tasks running and finishing on my computers now.

Much appreciated for your quick response to this issue.

Conan

Hi Christian!
I've completed 291 tasks with the new app version so far and not a single error or invalid yet!
Very well done!!!
My machines all run Ubuntu Linux 18.04 or 20.04 - see below.
Kindest regards,
Gunnar

I use two kinds of OS / libc on the machines I have running now:
Ubuntu 18.04.2 LTS [5.4.0-80-generic|libc 2.27 (Ubuntu GLIBC 2.27-3ubuntu1.2)] , and
Ubuntu 20.04.4 LTS [5.4.0-109-generic|libc 2.31 (Ubuntu GLIBC 2.31-0ubuntu9.7)]

Hi!
I'm now well over 1000 tasks with the new app and only encountered two errors and one invalid so far! :-)
(The invalid one is definitely due to one of my computers crashing from lack of memory, and I suspect that the two errors also could be due to computer malfunction.)
I have seen that some tasks (less than 1%) takes unusually long time to process. It seems that they reach the time limit of 10 hours. They are however not reported as errors or invalids, but instead accepted and credited according to the time they took.
Links to the invalid, the two errors and to five of the long tasks are attached below.
Have a nice week and weekend!!!
//Gunnar


invalid (computer crash):
https://boinc.loda-lang.org/loda/result.php?resultid=782455

errors:
https://boinc.loda-lang.org/loda/result.php?resultid=783022
https://boinc.loda-lang.org/loda/result.php?resultid=783062

long tasks:
https://boinc.loda-lang.org/loda/result.php?resultid=793483
https://boinc.loda-lang.org/loda/result.php?resultid=786385
https://boinc.loda-lang.org/loda/result.php?resultid=783528
https://boinc.loda-lang.org/loda/result.php?resultid=781510
https://boinc.loda-lang.org/loda/result.php?resultid=776992

ONE PC has had 4 tasks fail in a row. All have short run times
In the server error log they all have the SAME error message at end: fatal: your current branch appears to be broken
wu_1660327386_14035_0_r321630_0 / Task 943775
wu_1660327386_19849_0_r544343583_0 / Task 951047
wu_1660327386_19530_1_r1268663908_0 / Task 951254
wu_1660327386_20349_0_r573406346_0 / Task 951593

and one one more task that error-ed out with a low run time which I can't find a corresponding error log on the server:
Task 950468 / Name wu_1660327386_19361_0

---

Now have several more error-ed task on that pc but DIFFERENT MESSAGES in the server logs:
|ERROR|Error parsing C:\BOINCData/projects/boinc.loda-lang.org_loda\programs\oeis\211\A211640.asm: invalid identifier

fatal: your current branch appears to be broken

|ERROR|Error executing command (exit code 128): git -C "C:\BOINCData/projects/boinc.loda-lang.org_loda\programs" log --oneline --format="%H" -n 100 > "C:\BOINCData\projects\boinc.loda-lang.org_loda\loda_git_tmp.txt"

I have stopped running the project on that pc until I get some anwsers what is wrong and how to maybe fix it.

---

Hi Dr Who Fan,
the error is on host 289. Can you please stop all tasks on that host and delete the programs folder by running these commands?

cd C:\BOINCData/projects/boinc.loda-lang.org_loda
rmdir /s programs

After that, you can restart the tasks and should recreate the folder.

Christian, Thank You. That seems to have done the trick, have task running right now.

---