Posts by Michael Goetz

1) Message boards : News : Database Crash and Recovery (Message 3970)
Posted 31 Jan 2020 by Profile Michael Goetz
Post:
Dear Bok. I do not think I need the xml files. Most of the credit has been granted for recovered work. And the rest would be just too much hassle to import.


This is the result of the crash...for some devastating


Thanks for that information fro Free-DC!

That's only a fraction of the problem, however.

In addition to the loss shown on Free-DC, there's also the tasks processed while the website was down, plus all tasks returned after the last stats dump but before the website died.

All told, there's three time frames for lost tasks:

1) Returned after T.Brada's last database backup and before the last stats dump. This is the number shown on on the Free-DC website. In my case, this is 3139 credits.
2) Returned after the last stats dump, but before the T.Brada website went down. There's no easy way to determine what was lost here, although an examination of some of the logs on in the BOINC client could let you tell approximately how many tasks were returned from that host computer during this time frame.
3) Returned (or, more accurately, attempted to be returned) after the T.Brada website came back up. This is relatively easy to determine from the main client BOINC log as it tries to return the tasks, as in my earlier post. That was about 5100 credits in my case.

So the missing credits for me are:
1) 3139
2) unknown
3) ~5100

In my case, I happen to know they were all SPT tasks, but it would be much more complicated had I been running a mix of tasks.

Multiply this by the number of active users on the system.
2) Message boards : News : Database Crash and Recovery (Message 3966)
Posted 30 Jan 2020 by Profile Michael Goetz
Post:
I just lost 75 SPT completed and uploaded tasks:

17822	T.Brada Experiment Grid	1/30/2020 6:03:50 PM	Result spt_58_597201352000000000_0 is no longer usable	
17823	T.Brada Experiment Grid	1/30/2020 6:03:50 PM	Result spt_58_597187597000000000_0 is no longer usable	
17824	T.Brada Experiment Grid	1/30/2020 6:03:50 PM	Result spt_58_597197422000000000_0 is no longer usable	
17825	T.Brada Experiment Grid	1/30/2020 6:03:50 PM	Result spt_58_597195457000000000_0 is no longer usable	
17826	T.Brada Experiment Grid	1/30/2020 6:03:50 PM	Result spt_58_597321217000000000_0 is no longer usable	
17827	T.Brada Experiment Grid	1/30/2020 6:03:50 PM	Result spt_58_597164017000000000_0 is no longer usable	
17828	T.Brada Experiment Grid	1/30/2020 6:03:50 PM	Result spt_58_597209212000000000_0 is no longer usable	
17829	T.Brada Experiment Grid	1/30/2020 6:03:50 PM	Result spt_58_597205282000000000_0 is no longer usable	
17830	T.Brada Experiment Grid	1/30/2020 6:03:50 PM	Result spt_58_597203317000000000_0 is no longer usable	
17831	T.Brada Experiment Grid	1/30/2020 6:03:50 PM	Result spt_58_597189562000000000_0 is no longer usable	
17832	T.Brada Experiment Grid	1/30/2020 6:03:50 PM	Result spt_58_597191527000000000_0 is no longer usable	
17833	T.Brada Experiment Grid	1/30/2020 6:03:50 PM	Result spt_58_597207247000000000_0 is no longer usable	
17834	T.Brada Experiment Grid	1/30/2020 6:03:50 PM	Result spt_58_597199387000000000_0 is no longer usable	
17835	T.Brada Experiment Grid	1/30/2020 6:03:50 PM	Result spt_58_597193492000000000_0 is no longer usable	
17836	T.Brada Experiment Grid	1/30/2020 6:03:50 PM	Result spt_58_597317287000000000_0 is no longer usable	
17837	T.Brada Experiment Grid	1/30/2020 6:03:50 PM	Result spt_58_597319252000000000_0 is no longer usable	
17838	T.Brada Experiment Grid	1/30/2020 6:03:50 PM	Result spt_58_596592202000000000_0 is no longer usable	
17839	T.Brada Experiment Grid	1/30/2020 6:03:50 PM	Result spt_58_588235057000000000_0 is no longer usable	
17840	T.Brada Experiment Grid	1/30/2020 6:03:50 PM	Result spt_58_583566217000000000_0 is no longer usable	
17841	T.Brada Experiment Grid	1/30/2020 6:03:50 PM	Result spt_58_584246107000000000_1 is no longer usable	
17842	T.Brada Experiment Grid	1/30/2020 6:03:50 PM	Result spt_58_579760012000000000_0 is no longer usable	
17843	T.Brada Experiment Grid	1/30/2020 6:03:50 PM	Result spt_58_580868272000000000_0 is no longer usable	


and

23716	T.Brada Experiment Grid	1/30/2020 6:05:31 PM	Result spt_58_582624982000000000_0 is no longer usable	
23717	T.Brada Experiment Grid	1/30/2020 6:05:31 PM	Result spt_58_583927777000000000_0 is no longer usable	
23718	T.Brada Experiment Grid	1/30/2020 6:05:31 PM	Result spt_58_583923847000000000_0 is no longer usable	
23719	T.Brada Experiment Grid	1/30/2020 6:05:31 PM	Result spt_58_587034442000000000_0 is no longer usable	
23720	T.Brada Experiment Grid	1/30/2020 6:05:31 PM	Result spt_58_583855072000000000_0 is no longer usable	
23721	T.Brada Experiment Grid	1/30/2020 6:05:31 PM	Result spt_58_583721452000000000_0 is no longer usable	
23722	T.Brada Experiment Grid	1/30/2020 6:05:31 PM	Result spt_58_583849177000000000_0 is no longer usable	
23723	T.Brada Experiment Grid	1/30/2020 6:05:31 PM	Result spt_58_583915987000000000_0 is no longer usable	
23724	T.Brada Experiment Grid	1/30/2020 6:05:31 PM	Result spt_58_583969042000000000_0 is no longer usable	
23725	T.Brada Experiment Grid	1/30/2020 6:05:31 PM	Result spt_58_583355962000000000_0 is no longer usable	
23726	T.Brada Experiment Grid	1/30/2020 6:05:31 PM	Result spt_58_583147672000000000_0 is no longer usable	
23727	T.Brada Experiment Grid	1/30/2020 6:05:31 PM	Result spt_58_583359892000000000_0 is no longer usable	
23728	T.Brada Experiment Grid	1/30/2020 6:05:31 PM	Result spt_58_582695722000000000_0 is no longer usable	
23729	T.Brada Experiment Grid	1/30/2020 6:05:31 PM	Result spt_58_583725382000000000_0 is no longer usable	
23730	T.Brada Experiment Grid	1/30/2020 6:05:31 PM	Result spt_58_582630877000000000_0 is no longer usable	
23731	T.Brada Experiment Grid	1/30/2020 6:05:31 PM	Result spt_58_583418842000000000_0 is no longer usable	
23732	T.Brada Experiment Grid	1/30/2020 6:05:31 PM	Result spt_58_583717522000000000_0 is no longer usable	
23733	T.Brada Experiment Grid	1/30/2020 6:05:31 PM	Result spt_58_583957252000000000_0 is no longer usable	
23734	T.Brada Experiment Grid	1/30/2020 6:05:31 PM	Result spt_58_582626947000000000_0 is no longer usable	
23735	T.Brada Experiment Grid	1/30/2020 6:05:31 PM	Result spt_58_583947427000000000_0 is no longer usable	
23736	T.Brada Experiment Grid	1/30/2020 6:05:31 PM	Result spt_58_582931522000000000_0 is no longer usable	
23737	T.Brada Experiment Grid	1/30/2020 6:05:31 PM	Result spt_58_583381507000000000_0 is no longer usable	
23738	T.Brada Experiment Grid	1/30/2020 6:05:31 PM	Result spt_58_582650527000000000_0 is no longer usable	
23739	T.Brada Experiment Grid	1/30/2020 6:05:31 PM	Result spt_58_583931707000000000_0 is no longer usable	
23740	T.Brada Experiment Grid	1/30/2020 6:05:31 PM	Result spt_58_582933487000000000_0 is no longer usable	
23741	T.Brada Experiment Grid	1/30/2020 6:05:31 PM	Result spt_58_583921882000000000_0 is no longer usable	
23742	T.Brada Experiment Grid	1/30/2020 6:05:31 PM	Result spt_58_582634807000000000_0 is no longer usable	
23743	T.Brada Experiment Grid	1/30/2020 6:05:31 PM	Result spt_58_583385437000000000_0 is no longer usable	
23744	T.Brada Experiment Grid	1/30/2020 6:05:31 PM	Result spt_58_583794157000000000_0 is no longer usable	
23745	T.Brada Experiment Grid	1/30/2020 6:05:31 PM	Result spt_58_583383472000000000_0 is no longer usable	
23746	T.Brada Experiment Grid	1/30/2020 6:05:31 PM	Result spt_58_583929742000000000_0 is no longer usable	
23747	T.Brada Experiment Grid	1/30/2020 6:05:31 PM	Result spt_58_584024062000000000_0 is no longer usable	
23748	T.Brada Experiment Grid	1/30/2020 6:05:31 PM	Result spt_58_583917952000000000_0 is no longer usable	
23749	T.Brada Experiment Grid	1/30/2020 6:05:31 PM	Result spt_58_583959217000000000_0 is no longer usable	
23750	T.Brada Experiment Grid	1/30/2020 6:05:31 PM	Result spt_58_583723417000000000_0 is no longer usable	
23751	T.Brada Experiment Grid	1/30/2020 6:05:31 PM	Result spt_58_583949392000000000_0 is no longer usable	
23752	T.Brada Experiment Grid	1/30/2020 6:05:31 PM	Result spt_58_583851142000000000_0 is no longer usable	
23753	T.Brada Experiment Grid	1/30/2020 6:05:31 PM	Result spt_58_582628912000000000_0 is no longer usable	
23754	T.Brada Experiment Grid	1/30/2020 6:05:31 PM	Result spt_58_587680927000000000_0 is no longer usable	
23755	T.Brada Experiment Grid	1/30/2020 6:05:31 PM	Result spt_58_583845247000000000_0 is no longer usable	
23756	T.Brada Experiment Grid	1/30/2020 6:05:31 PM	Result spt_58_583976902000000000_0 is no longer usable	
23757	T.Brada Experiment Grid	1/30/2020 6:05:31 PM	Result spt_58_583971007000000000_0 is no longer usable	
23758	T.Brada Experiment Grid	1/30/2020 6:05:31 PM	Result spt_58_584016202000000000_0 is no longer usable	
23759	T.Brada Experiment Grid	1/30/2020 6:05:31 PM	Result spt_58_583963147000000000_0 is no longer usable	
23760	T.Brada Experiment Grid	1/30/2020 6:05:31 PM	Result spt_58_582699652000000000_0 is no longer usable	
23761	T.Brada Experiment Grid	1/30/2020 6:05:31 PM	Result spt_58_583847212000000000_0 is no longer usable	
23762	T.Brada Experiment Grid	1/30/2020 6:05:31 PM	Result spt_58_583974937000000000_0 is no longer usable	
23763	T.Brada Experiment Grid	1/30/2020 6:05:31 PM	Result spt_58_583719487000000000_0 is no longer usable	
23764	T.Brada Experiment Grid	1/30/2020 6:05:31 PM	Result spt_58_583972972000000000_0 is no longer usable	
23765	T.Brada Experiment Grid	1/30/2020 6:05:31 PM	Result spt_58_583019947000000000_0 is no longer usable	
23766	T.Brada Experiment Grid	1/30/2020 6:05:31 PM	Result spt_58_584018167000000000_0 is no longer usable	
23767	T.Brada Experiment Grid	1/30/2020 6:05:31 PM	Result spt_58_583155532000000000_0 is no longer usable	
23768	T.Brada Experiment Grid	1/30/2020 6:05:31 PM	Result spt_58_583357927000000000_0 is no longer usable	
23769	T.Brada Experiment Grid	1/30/2020 6:05:31 PM	Result spt_58_583919917000000000_0 is no longer usable	
23770	T.Brada Experiment Grid	1/30/2020 6:05:31 PM	Result spt_58_582632842000000000_0 is no longer usable	
23771	T.Brada Experiment Grid	1/30/2020 6:05:31 PM	Result spt_58_583955287000000000_0 is no longer usable	
23772	T.Brada Experiment Grid	1/30/2020 6:05:31 PM	Result spt_58_582927592000000000_0 is no longer usable	
23773	T.Brada Experiment Grid	1/30/2020 6:05:31 PM	Result spt_58_582579787000000000_0 is no longer usable	
23774	T.Brada Experiment Grid	1/30/2020 6:05:31 PM	Result spt_58_582308617000000000_0 is no longer usable	
23775	T.Brada Experiment Grid	1/30/2020 6:05:31 PM	Result spt_58_582161242000000000_0 is no longer usable	
23776	T.Brada Experiment Grid	1/30/2020 6:05:31 PM	Result spt_58_582878467000000000_0 is no longer usable	
23777	T.Brada Experiment Grid	1/30/2020 6:05:31 PM	Result spt_58_582666247000000000_0 is no longer usable	
23778	T.Brada Experiment Grid	1/30/2020 6:05:31 PM	Result spt_58_581638552000000000_0 is no longer usable	
23779	T.Brada Experiment Grid	1/30/2020 6:05:31 PM	Result spt_58_584483872000000000_1 is no longer usable	
23780	T.Brada Experiment Grid	1/30/2020 6:05:31 PM	Result spt_58_582169102000000000_0 is no longer usable	
23781	T.Brada Experiment Grid	1/30/2020 6:05:31 PM	Result spt_58_580508677000000000_0 is no longer usable	
23782	T.Brada Experiment Grid	1/30/2020 6:05:31 PM	Result spt_58_580913467000000000_0 is no longer usable	
23783	T.Brada Experiment Grid	1/30/2020 6:05:31 PM	Result spt_58_580361302000000000_0 is no longer usable	
23784	T.Brada Experiment Grid	1/30/2020 6:05:31 PM	Result spt_58_585309172000000000_1 is no longer usable	
23785	T.Brada Experiment Grid	1/30/2020 6:05:31 PM	Result spt_58_579329677000000000_0 is no longer usable	
23786	T.Brada Experiment Grid	1/30/2020 6:05:31 PM	Result spt_58_579514387000000000_0 is no longer usable	
23787	T.Brada Experiment Grid	1/30/2020 6:05:31 PM	Result spt_58_579671587000000000_0 is no longer usable	
23788	T.Brada Experiment Grid	1/30/2020 6:05:31 PM	Result spt_58_578170327000000000_0 is no longer usable	
23789	T.Brada Experiment Grid	1/30/2020 6:05:31 PM	Result spt_57_546500422000000000_1 is no longer usable	
23790	T.Brada Experiment Grid	1/30/2020 6:05:31 PM	Result spt_57_546339292000000000_1 is no longer usable	
23791	T.Brada Experiment Grid	1/30/2020 6:05:31 PM	Result spt_57_546486667000000000_1 is no longer usable	
23792	T.Brada Experiment Grid	1/30/2020 6:05:31 PM	Result spt_57_546319642000000000_1 is no longer usable	
23793	T.Brada Experiment Grid	1/30/2020 6:05:31 PM	Result spt_57_546488632000000000_1 is no longer usable	
23794	T.Brada Experiment Grid	1/30/2020 6:05:31 PM	Result spt_57_546490597000000000_1 is no longer usable	
23795	T.Brada Experiment Grid	1/30/2020 6:05:31 PM	Result spt_57_546333397000000000_1 is no longer usable	
23796	T.Brada Experiment Grid	1/30/2020 6:05:31 PM	Result spt_57_546294097000000000_1 is no longer usable	
23797	T.Brada Experiment Grid	1/30/2020 6:05:31 PM	Result spt_57_546311782000000000_1 is no longer usable	
23798	T.Brada Experiment Grid	1/30/2020 6:05:31 PM	Result spt_57_546321607000000000_1 is no longer usable	
23799	T.Brada Experiment Grid	1/30/2020 6:05:31 PM	Result spt_57_546337327000000000_1 is no longer usable	
23800	T.Brada Experiment Grid	1/30/2020 6:05:31 PM	Result spt_57_546323572000000000_1 is no longer usable	
23801	T.Brada Experiment Grid	1/30/2020 6:05:31 PM	Result spt_57_546459157000000000_1 is no longer usable	
23802	T.Brada Experiment Grid	1/30/2020 6:05:31 PM	Result spt_58_596234572000000000_2 is no longer usable	
23803	T.Brada Experiment Grid	1/30/2020 6:05:31 PM	Result spt_58_598985572000000000_2 is no longer usable	
23804	T.Brada Experiment Grid	1/30/2020 6:05:31 PM	Result spt_58_596289592000000000_2 is no longer usable	
23805	T.Brada Experiment Grid	1/30/2020 6:05:31 PM	Result spt_58_596232607000000000_2 is no longer usable	
23806	T.Brada Experiment Grid	1/30/2020 6:05:31 PM	Result spt_58_599003257000000000_2 is no longer usable	
23807	T.Brada Experiment Grid	1/30/2020 6:05:31 PM	Result spt_58_599015047000000000_2 is no longer usable	
23808	T.Brada Experiment Grid	1/30/2020 6:05:31 PM	Result spt_58_599011117000000000_2 is no longer usable	
23809	T.Brada Experiment Grid	1/30/2020 6:05:31 PM	Result spt_58_596291557000000000_2 is no longer usable	
23810	T.Brada Experiment Grid	1/30/2020 6:05:31 PM	Result spt_58_599013082000000000_2 is no longer usable	
23811	T.Brada Experiment Grid	1/30/2020 6:05:31 PM	Result spt_58_596269942000000000_2 is no longer usable	
23812	T.Brada Experiment Grid	1/30/2020 6:05:31 PM	Result spt_58_599044522000000000_2 is no longer usable	
23813	T.Brada Experiment Grid	1/30/2020 6:05:31 PM	Result spt_58_596230642000000000_2 is no longer usable	
23814	T.Brada Experiment Grid	1/30/2020 6:05:31 PM	Result spt_58_599052382000000000_2 is no longer usable	
23815	T.Brada Experiment Grid	1/30/2020 6:05:31 PM	Result spt_58_596236537000000000_2 is no longer usable	
23816	T.Brada Experiment Grid	1/30/2020 6:05:31 PM	Result spt_58_596267977000000000_2 is no longer usable	
23817	T.Brada Experiment Grid	1/30/2020 6:05:31 PM	Result spt_58_599048452000000000_2 is no longer usable	
23818	T.Brada Experiment Grid	1/30/2020 6:05:31 PM	Result spt_58_598983607000000000_2 is no longer usable	
23819	T.Brada Experiment Grid	1/30/2020 6:05:31 PM	Result spt_58_599046487000000000_2 is no longer usable	
23820	T.Brada Experiment Grid	1/30/2020 6:05:31 PM	Result spt_58_596266012000000000_2 is no longer usable	
23821	T.Brada Experiment Grid	1/30/2020 6:05:31 PM	Result spt_58_599050417000000000_2 is no longer usable	


I don't have the fastest computers, so that represents over a day's work wasted.

On top of those results that my computers were crunching while your website was unreachable, I have no idea how much, if any, credit I lost from tasks returned before the crash.

Dear Bok. I do not think I need the xml files. Most of the credit has been granted for recovered work. And the rest would be just too much hassle to import.


This user feels quite differently. I'm probably not alone.
3) Message boards : Open Issues : Sub-project Details on Account Page (Message 3954)
Posted 28 Jan 2020 by Profile Michael Goetz
Post:
Can't comment on what is being exported but it would be expected that if you added up the individual sub-projects totals it would match your total credit for the project on your account page. This is clearly not the case.


This is indeed still not the case.


He explained that he doesn’t have the data for the older apps, so it’s always going to be incomplete and not add up.

You know, like Florida elections.
4) Message boards : News : Badges (Message 3923)
Posted 18 Jan 2020 by Profile Michael Goetz
Post:
Dear Crunchers.
The SPT badge will be now automatically granted when user reaches 110'000 credits on Symmetric Prime Tuples or STPT applications.

There will be more levels of this badge, but I do not have them now. If someone want's to draw, here is the svg. Also, Inkscape filling sucks.


Is there ever work available for these projects?

I've had two computers trying to get these tasks for weeks. I have a backup project, so they're not trying to get tasks 24/7, but they have not pulled a single SPT or STPT task yet. Every time I look at the server status page there's no tasks there. All I ever see are the regular PADLS tasks.
5) Message boards : Closed Issues : Result table rows growing (Message 3755)
Posted 4 Nov 2019 by Profile Michael Goetz
Post:
There are 5'383'613 rows in "result" table according to dbinfo.php, which is about 5 times as much as I would expect. (Old/processed results are deleted by my program automatically.)
However simple count query over the table reports only 236'865 rows.
What is going on?


tl;dr: Believe what count(*) tells you rather than dbinfo.php.

ops/dbinfo.php uses the SHOW TABLE STATUS command rather than SELECT COUNT(*).

From the mysql documentation for SHOW TABLE STATUS:

Rows

The number of rows. Some storage engines, such as MyISAM, store the exact count. For other storage engines, such as InnoDB, this value is an approximation, and may vary from the actual value by as much as 40% to 50%. In such cases, use SELECT COUNT(*) to obtain an accurate count.

The Rows value is NULL for INFORMATION_SCHEMA tables.

For InnoDB tables, the row count is only a rough estimate used in SQL optimization. (This is also true if the InnoDB table is partitioned.)


I get some odd row counts on my system too, but not as bizarre as yours. I guess you're special! :)

I wouldn't worry about it.
6) Message boards : News : Badges (Message 3754)
Posted 4 Nov 2019 by Profile Michael Goetz
Post:
With the addition of new sub-projects, are you considering adding individual project badges rather than just total credit badges?

Yes I am. Actually I considered subproject badges since start of badges, but there is a minor technical difficulty that I do not track credit by subproject currently.
Right away I announce that there wont be subproject badge for the tot5 app. Because I do not want to and second I do not have the data to assign it by.
For Lua and Symmetric prime tuples, deletion of old results is disabled so I can extract the credit data late with a simple sql command.


Algebra is your friend! :)

If you decide that you do want to award a sub project badge for tot5, I suspect you may already have all the data you need to determine each user's tot5 credit.

You say you have the LUA and SPT credit, right? You also have total credit, right? tot5_credit = total_credit - LUA_credit - SPT_credit.
7) Message boards : Closed Issues : Validator not running (Message 3742)
Posted 2 Nov 2019 by Profile Michael Goetz
Post:
There’s currently 11943 workunits waiting for validation. Is this intentional?
8) Message boards : Code and Servers : Symmetric Prime Tuples development (Message 3707)
Posted 21 Oct 2019 by Profile Michael Goetz
Post:
Interestingly, the gap occurred in both cases at d = 10
84 - 74 = 10
36 - 26 = 10
A coincidence?

Not coincidence. Windows replaced value of 0A00 (hex, little-endian) with 0A0D 00 which is exactly 2573.


LOL. (This is a much easier to fix problem than it first appeared to be!)

Do you realize what happened?

0A is ASCII LF, and 0D is ASCII CR.

When the file was copied from linux to Windows (DOS), the copy program was probably in "text" mode rather than "binary" mode. So it converted the linux LF into a DOS CR-LF.

I suppose it could be something else, but it did in fact convert LF to CR-LF, so that's the most likely cause.
9) Message boards : News : Badges (Message 3690)
Posted 21 Oct 2019 by Profile Michael Goetz
Post:
With the addition of new sub-projects, are you considering adding individual project badges rather than just total credit badges?

Yes I am. Actually I considered subproject badges since start of badges, but there is a minor technical difficulty that I do not track credit by subproject currently.
Right away I announce that there wont be subproject badge for the tot5 app. Because I do not want to and second I do not have the data to assign it by.
For Lua and Symmetric prime tuples, deletion of old results is disabled so I can extract the credit data late with a simple sql command.


NFS@Home, Primegrid and yoyo@Home all track subproject stats. I think the code all got put into the more recent server code, but you may want to ask one of them how they do it.

PrimeGrid’s code for tracking sub-projects is all custom code. If I remember correctly from our most recent server upgrade, the BOINC database schema does not have any tables designed for tracking sub-project status.
10) Message boards : Closed Issues : Uploads and scheduler offline? (Message 3677)
Posted 18 Oct 2019 by Profile Michael Goetz
Post:
And... it's all fixed now. :)
11) Message boards : Closed Issues : Uploads and scheduler offline? (Message 3676)
Posted 18 Oct 2019 by Profile Michael Goetz
Post:
10/18/2019 5:36:53 PM | T.Brada Experiment Grid | Sending scheduler request: To fetch work.
10/18/2019 5:36:53 PM | T.Brada Experiment Grid | Requesting new tasks for CPU
10/18/2019 5:36:55 PM | T.Brada Experiment Grid | Scheduler request failed: HTTP bad gateway
10/18/2019 5:37:50 PM | T.Brada Experiment Grid | Started upload of tot5_51c_SudEH7TLDLTESDQms2dkqXfFY_0_r1010243935_0
10/18/2019 5:37:51 PM | T.Brada Experiment Grid | [error] Error reported by file upload server: File uploads are temporarily disabled.
10/18/2019 5:37:51 PM | T.Brada Experiment Grid | Temporarily failed upload of tot5_51c_SudEH7TLDLTESDQms2dkqXfFY_0_r1010243935_0: transient upload error
10/18/2019 5:37:51 PM | T.Brada Experiment Grid | Backing off 00:04:35 on upload of tot5_51c_SudEH7TLDLTESDQms2dkqXfFY_0_r1010243935_0


TZ is UTC+4, so that's 21:36 UTC.
12) Message boards : Code and Servers : Symmetric Prime Tuples development (Message 3657)
Posted 15 Oct 2019 by Profile Michael Goetz
Post:
<rsc_memory_bound>100000000.000000</rsc_memory_bound>


That's from one of these tasks. That's 100 MB. (I think)

Actual usage is 357.91 MB according to BOINCTasks. Maybe that's got something to do with it?
13) Message boards : Code and Servers : Symmetric Prime Tuples development (Message 3655)
Posted 15 Oct 2019 by Profile Michael Goetz
Post:
Batch 43 checking in range 500266350516360713..500286766859602800.
Double-checking results from Xaver.


I'm seeing some strange behavior with these tasks.

First thing is they have a short deadline -- about 25 minutes, and they're going to take about 4 or 5 hours to run.

Second problem is even though there's 4 cores on the computer, and 4 tasks were downloaded, only 1 task is running. I don't know why. There's enough memory to run more than one task, so that doesn't appear to be the problem. I'm not sure if this is a problem on your end or my end.

Between the two problems, you can expect lots of automatically aborted tasks because of this. As soon as the (short) deadline passes, BOINC will automatically abort the three unstarted tasks, and immediately download three more. When their deadline passes, they will be aborted and replaced with three more, and so on.
14) Message boards : News : Badges (Message 3617)
Posted 20 Sep 2019 by Profile Michael Goetz
Post:
This project has badges now!
They are based on total credit, but I did not want to be usual, so I choose thematic thresholds.
Lv. 8) Over 6204 credits.
Lv. 9)     37224
Lv.10)    197600
Lv.11)    785997
Lv.12)   2629687
Lv.13)   6873318
Lv.15)  16350666
Lv.17)  84584914

The "numbers" are number of SNDLS on the corresponding level of rule 51. The badges are assigned to Users and Teams alike and next level badge replaces the previous level.
Also the credit gain has been increased about 30% up.


Is the process that assigns badges running? I have 6328 total credit, which should be enough for the first badge according to what you wrote. It's been three days. I don't know how the official BOINC system works since mine predates it by many years. Are badges assigned less frequently than that?
15) Message boards : Code and Servers : Lua Interpreter (Message 3612)
Posted 18 Sep 2019 by Profile Michael Goetz
Post:
I would be curious to know how many of your _t3 test results found a compiler installed vs. not installed. Please share your results!

I was not smart about the output and did not make the result of compiler detection easily parse-able out of the stderr. I can try my luck at regex or submit new batch.


No need to run new tasks. The information is sitting there in your database.

SELECT 
  COUNT(*) "Total Tasks", 
  SUM(stderr_out LIKE '%gcc: not found%") "No gcc",
  SUM(stderr_out LIKE '%g++: not found%") "No g++"
  SUM(stderr_out LIKE '%gcc: not found%" AND stderr_out LIKE '%g++: not found%") "Neither",
FROM 
  result
WHERE
  server_state=5 
  AND outcome=1
  AND stderr_out LIKE "%lua8_t3.lua%
  AND appid=2 ;


Change appid to whatever is used for your lua app.

It's easier to detect the error message from the compiler being missing than it is to detect all possible valid responses from multiple compiler versions, but that's possible if you really want to do it. For example, you can parse the output to determine which compiler version is present.
16) Message boards : Open Issues : Not getting email notifications in subscribed forum topics (Message 3609)
Posted 18 Sep 2019 by Profile Michael Goetz
Post:
Please consider this a low priority bug report.

I believe the outgoing email from the server is not working. I'm not receiving emails about posts in subscribed forum threads, and not receiving email for incoming private messages. My email address is correct, and the community preferences are set to "immediate". The messages aren't in my spam filter.

From experience, I know it's difficult getting this to work correctly, and this isn't very important, so nobody should complain if it's not fixed soon (or ever). I just want to make sure you're aware of it.
17) Message boards : Code and Servers : Lua Interpreter (Message 3608)
Posted 18 Sep 2019 by Profile Michael Goetz
Post:
A lot of the people I know who run BOINC for fun -- but treat it as a serious hobby -- besides doing the traditional "run BOINC in your spare computer cycles" thing, actively buy, build, and or rent computers just for running BOINC projects.

Many times Linux machines are set up just for running BOINC. This includes VMs running on Windows machines as well as cloud servers from AWS, or less expensive options like Digital Ocean. In most cases, these are minimal Linux installations, sometimes with a boinc-client package installed and nothing else.

Of the three linux VMs running in my house, only one has compiler tools. The one that ran your Lua tasks does not. And, of course, every cloud server I've spun up for running BOINC did not.

I would be curious to know how many of your _t3 test results found a compiler installed vs. not installed. Please share your results!
18) Message boards : Closed Issues : Validator broken or slow? (Message 3593)
Posted 14 Sep 2019 by Profile Michael Goetz
Post:
It seems that no tasks have been validated for almost a day. My most recent validated task was received at the server at 13 Sep 2019, 15:51:43 UTC, and 8 tasks since then are pending validation. The server status page shows 2781 tasks waiting for validation.
19) Message boards : Number crunching : variation in credit allocation (Message 3588)
Posted 9 Sep 2019 by Profile Michael Goetz
Post:
As a follow up, I thought I'd post the following.

I didn't set the original credit at PrimeGrid, but Jim and I have been running PrimeGrid for about 7 years now and we've tried to keep the credit internally consistent. When AVX CPUs first came out, I realized the BOINC credit system couldn't be used at PrimeGrid anymore. Using the stock credit system, people buying new CPUs with AVX would get half the credit that people with older CPUs receive. That would attract people with slow computers to PrimeGrid and drive away people with the fastest computers, which is exactly the opposite of what we wanted! So we built a better system, where we could model the expected computation time of every task, and assign credit based on that model. It's not perfect, but it's pretty good -- and it's good enough to keep the users from complaining about it. It wasn't easy to do, and it's only feasible if your tasks are predictable. Not every project can do credit that way.

But I never compared the credit we give out to the "reference standard Cobblestone", like I did just now for your tasks. I thought that might be an interesting exercise. I have 9 computers running our new PPS-DIV application. I picked a representative task for each computer, and compared the actual credit (generated by our modeling system) against the the theoretical credit based on the Cobblestone formula. This is what I got for the actual vs. theoretical credit, based on the run times for the task and the characteristics (GHz and CPU family) for the 9 computers:

Anything above 100% means I got more credit than the Cobblestone formula suggests, under 100% means I got less than the formula predicts.

132%
116%
137% -- this is the computer I'm using here
125%
92%
106%
87%
102%
80%

Even at PrimeGrid, with a credit system as highly tuned to our actual applications as I know how to make it, the credit is still varying between 80% and 137% of the theoretical correct amount. It varies according to which computer is running the tasks. Even the last 5 computers on that list, which are all identical Xeon(R) Gold 6140 CPUs, vary from 80% to 106%.

It's unrealistic to expect any project to do better than that.

If all the tasks I ran here had received 79-ish credits, it would have come out to very close to the ideal 100%. At that credit rate, I think you're as close to perfect as you can get.

Yes, it will be less credit than at PrimeGrid, but that's because our apps can make use of the SIMD instructions to do multiple computations in parallel. That produces more credit -- and also more heat, uses more electricity, and requires better cooling solutions. For a "normal" app, I think at the higher credit rate you've got it set correctly. The results are always going to vary from computer to computer, so there's no "perfect" answer.
20) Message boards : News : Badges (Message 3586)
Posted 9 Sep 2019 by Profile Michael Goetz
Post:
The badge signature site https://signature.statseb.fr has also picked up your badges! :)

Edit: As you can see in Steve Dodd's signature image three posts before this one.


Next 20

©2020 Tomáš Brada