SoFiA Production Update 1

Message boards : News : SoFiA Production Update 1

To post messages, you must log in.

AuthorMessage
Profile Sam
Volunteer moderator
Project administrator
Project developer
Project tester
Volunteer developer
Volunteer tester
Project scientist
Help desk expert

Send message
Joined: 9 Feb 17
Posts: 216
Credit: 7,636
RAC: 0
Message 928 - Posted: 8 Nov 2017, 6:54:13 UTC

Added the ability to scale credit awarded to workunits by the validator. Currently credit scaling is at x1.5 to make up for the validation errors we've been having.

Currently processing a new batch of work units, which should be done within the next 12 or so hours.
ID: 928 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Yavanius
Volunteer moderator
Avatar

Send message
Joined: 12 Feb 17
Posts: 121
Credit: 163,211
RAC: 2,542
Message 939 - Posted: 8 Nov 2017, 23:41:40 UTC - in response to Message 928.  

Report Weird/Bad WUs here: https://sourcefinder.theskynet.org/duchamp/forum_thread.php?id=238#938
ID: 939 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
adrianxw

Send message
Joined: 4 May 17
Posts: 51
Credit: 45,194
RAC: 45
Message 945 - Posted: 9 Nov 2017, 17:11:45 UTC - in response to Message 928.  

Okay, allowed new tasks again.
ID: 945 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Yavanius
Volunteer moderator
Avatar

Send message
Joined: 12 Feb 17
Posts: 121
Credit: 163,211
RAC: 2,542
Message 949 - Posted: 10 Nov 2017, 2:04:32 UTC

Well, I'm seeing about 5% Validation Inconclusive. I haven't seen any Err out on me yet though and I haven't gone into those to see if they erred for anybody else. If this goes to 3rd wingmen that means about 500 WU will have to be resent (if it was 10k WU that were initially allotted.)

Does that look about the same rate for everybody else?

On a positive note, this 1.5 multiplier is kind of nice. :)

~Y
ID: 949 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
gomeyer

Send message
Joined: 29 Oct 17
Posts: 5
Credit: 27,898
RAC: 186
Message 950 - Posted: 10 Nov 2017, 11:45:03 UTC - in response to Message 949.  

Well, I'm seeing about 5% Validation Inconclusive. I haven't seen any Err out on me yet though and I haven't gone into those to see if they erred for anybody else. If this goes to 3rd wingmen that means about 500 WU will have to be resent (if it was 10k WU that were initially allotted.)

Does that look about the same rate for everybody else?

On a positive note, this 1.5 multiplier is kind of nice. :)

~Y

Not counting the previous batch of work, I have 25 new tasks pending, 10 inconclusive, and 7 valid. That does seem to be a lot of inconclusives for the total number.
ID: 950 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
adrianxw

Send message
Joined: 4 May 17
Posts: 51
Credit: 45,194
RAC: 45
Message 952 - Posted: 10 Nov 2017, 20:19:33 UTC
Last modified: 10 Nov 2017, 20:22:01 UTC

I've got 14 inconclusives from the new batch as well. It's not, err, looking good right now.
ID: 952 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Yavanius
Volunteer moderator
Avatar

Send message
Joined: 12 Feb 17
Posts: 121
Credit: 163,211
RAC: 2,542
Message 953 - Posted: 11 Nov 2017, 6:50:42 UTC

I just checked and I'm down to 1 inconclusive. It hasn't been sent out to a 3rd wingman yet on that one. So even though there's still 2k+ WUs left, it appears the system is sending out those inconclusives. That might be why we haven't exhausted the workload yet. We'll have to wait till Sam gets a chance to check in again to look into it.


On a different note, I'm curious to know what's the lowest spec system y'all have gotten to run SourceFinder? I'll start a thread in number crunching. :)

Yav
ID: 953 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Yavanius
Volunteer moderator
Avatar

Send message
Joined: 12 Feb 17
Posts: 121
Credit: 163,211
RAC: 2,542
Message 959 - Posted: 11 Nov 2017, 17:14:22 UTC - in response to Message 953.  

Well, it shot up like crazy overnight. I'm up to 49 but no Invalids or Errors though.

I was scrolling though and noticed there are still old tasks (up to3rd) in the system that haven't seen third wingmen yet. Maybe Sam can see how the system is prioritizing things?
ID: 959 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
adrianxw

Send message
Joined: 4 May 17
Posts: 51
Credit: 45,194
RAC: 45
Message 965 - Posted: 12 Nov 2017, 16:57:27 UTC

Inconclusives up to 19 now in this batch.
ID: 965 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
G_UK
Avatar

Send message
Joined: 7 May 17
Posts: 20
Credit: 70,696
RAC: 1,218
Message 966 - Posted: 12 Nov 2017, 23:42:59 UTC
Last modified: 12 Nov 2017, 23:55:38 UTC

I've had a few inconclusive but they do seem to be validating eventually, I've had very few end up as invalid so far:

From the 8th until now:
159 Total
3 In-Progress
84 Pending
22 Inconclusive

45 Valid

4 Invalid
1 Error

(If I've counted right)
Gridcoin: Rx5iQUC9fdZkYuxrjW6ySV6Jfttsw5Ub2L
Bitshares: g-uk https://wallet.bitshares.org/?r=g-uk
Ethereum: 0x734E41c433DE29383957A80dc57B8D025dd326b5
ID: 966 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Yavanius
Volunteer moderator
Avatar

Send message
Joined: 12 Feb 17
Posts: 121
Credit: 163,211
RAC: 2,542
Message 970 - Posted: 13 Nov 2017, 6:46:08 UTC

Now we just need to wait for Sam to check back in...


Doctor Sam, Doctor Sam,
Wake up now

Calling Doctor Sam
Doctor Sam, Doctor Sam,
Get up now
Wake up now...



^_^
ID: 970 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
G_UK
Avatar

Send message
Joined: 7 May 17
Posts: 20
Credit: 70,696
RAC: 1,218
Message 975 - Posted: 13 Nov 2017, 19:28:09 UTC

Latest Update:

54 Valid
78 Pending
16 Inconclusive
11 Invalid
1 Error

2 In-Progress
Gridcoin: Rx5iQUC9fdZkYuxrjW6ySV6Jfttsw5Ub2L
Bitshares: g-uk https://wallet.bitshares.org/?r=g-uk
Ethereum: 0x734E41c433DE29383957A80dc57B8D025dd326b5
ID: 975 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Yavanius
Volunteer moderator
Avatar

Send message
Joined: 12 Feb 17
Posts: 121
Credit: 163,211
RAC: 2,542
Message 976 - Posted: 13 Nov 2017, 21:47:28 UTC - in response to Message 975.  

Are your suspended tasks saved to memory? Just curious.
ID: 976 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
kashi

Send message
Joined: 3 Apr 17
Posts: 1
Credit: 220,012
RAC: 267
Message 977 - Posted: 14 Nov 2017, 2:02:29 UTC

306 Valid
296 Pending
112 Inconclusive
25 Invalid

Invalid rate slowly climbing, currently about 8%. Validation is slow, validator needs a kick.
ID: 977 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
G_UK
Avatar

Send message
Joined: 7 May 17
Posts: 20
Credit: 70,696
RAC: 1,218
Message 982 - Posted: 14 Nov 2017, 19:53:28 UTC - in response to Message 976.  
Last modified: 14 Nov 2017, 20:02:23 UTC

Are your suspended tasks saved to memory? Just curious.


Yes, I've got it set to keep them in memory.

Edit:
59 Valid
75 Pending
11 Inconclusive
15 Invalid
1 Error

Current Invalid Rate = 25%
Gridcoin: Rx5iQUC9fdZkYuxrjW6ySV6Jfttsw5Ub2L
Bitshares: g-uk https://wallet.bitshares.org/?r=g-uk
Ethereum: 0x734E41c433DE29383957A80dc57B8D025dd326b5
ID: 982 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Yavanius
Volunteer moderator
Avatar

Send message
Joined: 12 Feb 17
Posts: 121
Credit: 163,211
RAC: 2,542
Message 984 - Posted: 14 Nov 2017, 23:16:37 UTC - in response to Message 982.  

Okay. I was trying to unload some suspended tasks from memory and I think I crashed one of the WUs when I temporarily disabled suspend to memory and then try to start the WU again later...
ID: 984 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote

Message boards : News : SoFiA Production Update 1


©2017 ICRAR