SoFiA 100MB Progress Update

Message boards : News : SoFiA 100MB Progress Update

To post messages, you must log in.

AuthorMessage
Profile Sam
Volunteer moderator
Project administrator
Project developer
Project tester
Volunteer developer
Volunteer tester
Project scientist
Help desk expert

Send message
Joined: 9 Feb 17
Posts: 251
Credit: 7,636
RAC: 0
Message 1303 - Posted: 21 Mar 2018, 1:13:12 UTC

Hello Everyone,

Just a quick progress update on the processing of our 100MB cubelets.
So far we've successfully processed 5 / 16 cubelet sets, and we're processing about 1 set per week.
The results database is looking pretty good too. I'm not seeing too many validation errors (about one every 30 or so results), so that's certainly promising.

Just a note that you'll only receive 100MB cubelets if you opt in to receiving them via checking the "Run test applications?" checkbox on the Sourcefinder preferences page. This is because the 100MB cubelets are significantly more CPU, memory, and disk intensive than the previous cubelets.

Thanks,
Sam
ID: 1303 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Luigi R.

Send message
Joined: 21 Feb 17
Posts: 19
Credit: 140,850
RAC: 3,448
Message 1308 - Posted: 26 Mar 2018, 20:28:22 UTC - in response to Message 1303.  

I run Virtualbox 5.2.8 on Linux.

All Beta application for SoFiA. tasks for Luigi R.
State: All (502) · In progress (10) · Validation pending (70) · Validation inconclusive (29) · Valid (344) · Invalid (35) · Error (14)
Application: All (710) · Beta application for SoFiA. (502) · Duchamp Sourcefinder (160) · Sofia Sourcefinder (48)


At the moment my invalids rate is > 1/10.
ID: 1308 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
kashi

Send message
Joined: 3 Apr 17
Posts: 2
Credit: 477,887
RAC: 5,694
Message 1309 - Posted: 27 Mar 2018, 5:19:03 UTC
Last modified: 27 Mar 2018, 5:20:40 UTC

I'm currently about the same 10% Invalid rate on two Windows 8.1 computers.

Would have been higher Invalid rate if I didn't abort some resent tasks that were failing to validate repeatedly on many different hosts and then set No new tasks towards the end of the last batch when the majority of "non validating" tasks were being resent. Got caught out with oodles of invalids at the end of an earlier batch but am trying not do so again as currently don't have time to manually prune all the suspect tasks from my cache.

State: All (1610) · In progress (0) · Validation pending (78) · Validation inconclusive (28) · Valid (1310) · Invalid (141) · Error (53)
Application: All (4276) · Beta application for SoFiA. (1610) · Duchamp Sourcefinder (1806) · Sofia Sourcefinder (860)
ID: 1309 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Luigi R.

Send message
Joined: 21 Feb 17
Posts: 19
Credit: 140,850
RAC: 3,448
Message 1310 - Posted: 27 Mar 2018, 10:05:11 UTC - in response to Message 1309.  

Would have been higher Invalid rate if I didn't abort some resent tasks that were failing to validate repeatedly on many different hosts and then set No new tasks towards the end of the last batch when the majority of "non validating" tasks were being resent.

Probably you're right, but some get validated.

https://sourcefinder.theskynet.org/duchamp/workunit.php?wuid=304942
ID: 1310 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote

Message boards : News : SoFiA 100MB Progress Update


©2018 ICRAR