SoFiA Production Update 4

Message boards : News : SoFiA Production Update 4

To post messages, you must log in.

AuthorMessage
Profile Sam
Volunteer moderator
Project administrator
Project developer
Project tester
Volunteer developer
Volunteer tester
Project scientist
Help desk expert

Send message
Joined: 9 Feb 17
Posts: 216
Credit: 7,636
RAC: 0
Message 1042 - Posted: 29 Nov 2017, 4:46:11 UTC

Updated the windows 32bit and 64bit virtualbox wrappers to version 26200.

Pushing out 4 sets of work units this time instead of 3 to try and keep work flowing nicely.

I'm still trying to investigate the potential cause of invalid workunits. I'm currently testing workunits on several different virtualbox versions in-case one version in particular is causing issues. I'm also going to test the VM with virtualbox 5.2, just to confirm it works properly. We're still waiting on 5.2 compatible wrappers from BOINC, though.
ID: 1042 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Yavanius
Volunteer moderator
Avatar

Send message
Joined: 12 Feb 17
Posts: 121
Credit: 163,211
RAC: 2,542
Message 1043 - Posted: 29 Nov 2017, 5:41:29 UTC - in response to Message 1042.  

FYI: VB 5.8.22 is recently released.

I did a quick test earlier today with it and Sourcefinder still doesn't work with this new series. The WUs haven't populated the server yet so I won't be able to test with the new wrappers tonight as I'm heading off to bed.

Although I don't think this project needs it, the corresponding extension pack gave me an error installing.
ID: 1043 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
LumenDan

Send message
Joined: 9 Feb 17
Posts: 88
Credit: 164,599
RAC: 610
Message 1045 - Posted: 29 Nov 2017, 9:33:58 UTC - in response to Message 1043.  

Although I don't think this project needs it, the corresponding extension pack gave me an error installing.

I'm almost certain that the Source Finder virtual machines don't use any of the extension pack features.
While testing VB 5.2.x with Source Finder I have been declining the updated extensions so that i can roll back to 5.1.30 without having to roll back the extensions as well. When we have a successful migration to VB 5.2.x I will update the extensions to suit.
ID: 1045 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Yavanius
Volunteer moderator
Avatar

Send message
Joined: 12 Feb 17
Posts: 121
Credit: 163,211
RAC: 2,542
Message 1047 - Posted: 29 Nov 2017, 21:14:47 UTC - in response to Message 1042.  

Updated the windows 32bit and 64bit virtualbox wrappers to version 26200.


It appears to be running with VirtualBox 5.2.2. Finished without issue.

However, I was looking at the terminal window and noticed the following error msg;

Info:root:Running SoFia output file place in the wrong directory. Moving it...


It does this for each supercube_run...

I also saw one instance of this -
 Info:root:An application error occurred; code 1
ID: 1047 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Profile Sam
Volunteer moderator
Project administrator
Project developer
Project tester
Volunteer developer
Volunteer tester
Project scientist
Help desk expert

Send message
Joined: 9 Feb 17
Posts: 216
Credit: 7,636
RAC: 0
Message 1048 - Posted: 30 Nov 2017, 0:02:35 UTC - in response to Message 1047.  

Yeah, for some reason SoFiA doesn't always place its output files in the directory I tell it to (I have no idea why), so I have to move them. Don't worry about that error.
Also, the application error will occur in some cases when SoFiA can't find any sources in the input file. I don't know why they've designed it to return error codes if no sources are found, but I've had to work around it none the less.
ID: 1048 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
[AF>Le_Pommier] Jerome_C2005

Send message
Joined: 12 Feb 17
Posts: 4
Credit: 13,617
RAC: 38
Message 1052 - Posted: 1 Dec 2017, 9:49:27 UTC
Last modified: 1 Dec 2017, 9:50:28 UTC

Hi

it was impossible for me to download any new UT this morning, I suppose with latest version of app, it would download several files OK each time but then always fail on "SofiaVM_1.3.vdi" :

Stderr output
<core_client_version>7.8.4</core_client_version>
<![CDATA[
<message>
app_version download error: couldn't get input files:
<file_xfer_error>
<file_name>SofiaVM_1.3.vdi</file_name>
<error_code>-224 (permanent HTTP error)</error_code>
<error_message>permanent HTTP error</error_message>
</file_xfer_error>
</message>
]]>

Strangely it seems that after that it could actully download 8 of these, and then again it failed (but I'm not in front of the computer so I can't confirm now).

Thanks.
ID: 1052 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Yavanius
Volunteer moderator
Avatar

Send message
Joined: 12 Feb 17
Posts: 121
Credit: 163,211
RAC: 2,542
Message 1055 - Posted: 3 Dec 2017, 4:23:45 UTC - in response to Message 1052.  

The server (or quite possibly AWS) recently had a fit that lasted a few hours. Don't know if it's related.

You can try resetting the project if it's still giving you issues.
ID: 1055 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
[AF>Le_Pommier] Jerome_C2005

Send message
Joined: 12 Feb 17
Posts: 4
Credit: 13,617
RAC: 38
Message 1056 - Posted: 3 Dec 2017, 11:58:30 UTC

Dim 3 déc 12:54:05 2017 | duchamp | Resent lost task sofia_17_askap_cube_10_20_28_1
Dim 3 déc 12:54:08 2017 | duchamp | Started download of SofiaVM_1.3.vdi
Dim 3 déc 12:54:08 2017 | duchamp | Started download of sofia_17_askap_cube_10_20_28.tar.gz
Dim 3 déc 12:54:09 2017 | duchamp | Giving up on download of SofiaVM_1.3.vdi: permanent HTTP error
Dim 3 déc 12:54:17 2017 | duchamp | Finished download of sofia_17_askap_cube_10_20_28.tar.gz
Dim 3 déc 12:55:27 2017 | duchamp | Resetting project
Dim 3 déc 12:55:28 2017 | duchamp | Master file download succeeded

Dim 3 déc 12:55:36 2017 | duchamp | Sending scheduler request: To fetch work.
Dim 3 déc 12:55:36 2017 | duchamp | Requesting new tasks for CPU
Dim 3 déc 12:55:37 2017 | duchamp | Scheduler request completed: got 1 new tasks
Dim 3 déc 12:55:37 2017 | duchamp | This project is using an old URL. When convenient, remove the project, then add https://sourcefinder.theskynet.org/duchamp/
Dim 3 déc 12:55:37 2017 | duchamp | Resent lost task sofia_17_askap_cube_10_20_28_1
Dim 3 déc 12:55:40 2017 | duchamp | Started download of vboxwrapper_26199_x86_64-apple-darwin
Dim 3 déc 12:55:40 2017 | duchamp | Started download of SofiaVM_1.3.vdi
Dim 3 déc 12:55:41 2017 | duchamp | Giving up on download of SofiaVM_1.3.vdi: permanent HTTP error
Dim 3 déc 12:55:41 2017 | duchamp | Started download of vbox_job_sofia_1.2.xml
Dim 3 déc 12:55:42 2017 | duchamp | Finished download of vboxwrapper_26199_x86_64-apple-darwin
Dim 3 déc 12:55:42 2017 | duchamp | Finished download of vbox_job_sofia_1.2.xml
Dim 3 déc 12:55:42 2017 | duchamp | Started download of sofia_17_askap_cube_10_20_28.tar.gz
Dim 3 déc 12:55:42 2017 | duchamp | Started download of parameters_sofia_17.tar.gz
Dim 3 déc 12:55:43 2017 | duchamp | Finished download of parameters_sofia_17.tar.gz
Dim 3 déc 12:55:46 2017 | duchamp | Finished download of sofia_17_askap_cube_10_20_28.tar.gz

And then I have the task in the boincmanager list in error status (download failure)
ID: 1056 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote
Profile Sam
Volunteer moderator
Project administrator
Project developer
Project tester
Volunteer developer
Volunteer tester
Project scientist
Help desk expert

Send message
Joined: 9 Feb 17
Posts: 216
Credit: 7,636
RAC: 0
Message 1057 - Posted: 4 Dec 2017, 0:22:06 UTC - in response to Message 1056.  

This is an issue on the server, most probably a file permissions error with the VM file.
I'll try and get it fixed as soon as possible, I've just been busy and haven't had a chance to log on to the server yet.
My apologies.
ID: 1057 · Rating: 0 · rate: Rate + / Rate - Report as offensive    Reply Quote

Message boards : News : SoFiA Production Update 4


©2017 ICRAR