Nekonomicon - Seti Enhanced

kshuff
From Jonas, PA USA
Who joined Jan. 8, 2005, 8:13 p.m.

Wrote the following at May 18, 2006, 3:51 p.m...

Although not IRIX related, I've come to the realization that Seti Enhanced sucks!!!

I have two windoze boxes crunching, a dual P3 1 GHz VW320 and a 2.8 GHz P4. The dual P3 was turning out a WU about every 10 to 12 hours per processor under normal seti, just checked since upgrading to enhanced and I see the current two WU's being run with CPU time elapsed 52 hours and time to completion 138 hours. The P4 was turning out a WU every 3 to 4 hours, that went to 12 to 16 hours. I've also noted lower granted credit for work done.

Anyone else seeing this?

-ks

See them all >here<

ulenz
From Hamburg, Germany
Who joined May 14, 2004, 11:09 a.m.

Wrote the following at May 18, 2006, 8:19 p.m...

This is okay. The new client is searching much more precisely and therefore needs more cpu-time. Running MacOSX or HP-UX, it's the same.

kshuff
From Jonas, PA USA
Who joined Jan. 8, 2005, 8:13 p.m.

Wrote the following at May 20, 2006, 7:02 p.m...

Ok, since their not sending out any regular work units anymore, and my SGI's are sitting idle again, anyone have an Enhanced client working??

-ks

See them all >here<

foetz
Moderator
Who joined April 14, 2003, 4:34 a.m.

Wrote the following at May 21, 2006, 2:43 p.m...

kshuff wrote: Ok, since their not sending out any regular work units anymore, and my SGI's are sitting idle again, anyone have an Enhanced client working??

i tried to compile it some time ago but the code really sucked

r-a-c.de

kshuff
From Jonas, PA USA
Who joined Jan. 8, 2005, 8:13 p.m.

Wrote the following at May 21, 2006, 5:43 p.m...

foetz wrote:

kshuff wrote: Ok, since their not sending out any regular work units anymore, and my SGI's are sitting idle again, anyone have an Enhanced client working??

i tried to compile it some time ago but the code really sucked

Yeah, I've read in another thread. Thought maybe someone had succeeded

-ks

See them all >here<

ulenz
From Hamburg, Germany
Who joined May 14, 2004, 11:09 a.m.

Wrote the following at May 25, 2006, 8:59 p.m...

Well, guys, let's face it: Irix is out of the game as far as distributed computing is concerned. Rest in peace ! :cry:

kshuff
From Jonas, PA USA
Who joined Jan. 8, 2005, 8:13 p.m.

Wrote the following at May 25, 2006, 9:37 p.m...

ulenz wrote: Well, guys, let's face it: Irix is out of the game as far as distributed computing is concerned. Rest in peace !

Maybe not, I posted to the message board and it was turned over to the IRIX porter. Now we play the waiting game...

-ks

See them all >here<

foetz
Moderator
Who joined April 14, 2003, 4:34 a.m.

Wrote the following at May 26, 2006, 10:25 a.m...

ulenz wrote: Well, guys, let's face it: Irix is out of the game as far as distributed computing is concerned. Rest in peace !

no reason for making crappy code anyway.

r-a-c.de

unixmuseum
From Los Angeles, CA
Who joined April 19, 2004, 4:25 p.m.

Wrote the following at May 26, 2006, 10:28 a.m...

ulenz wrote: Well, guys, let's face it: Irix is out of the game as far as distributed computing is concerned. Rest in peace !

Not in my office... Running a 4-way distributed NASTRAN job as we speak :-)

ulenz
From Hamburg, Germany
Who joined May 14, 2004, 11:09 a.m.

Wrote the following at June 4, 2006, 1:02 a.m...

What is NASTRAN ?

unixmuseum
From Los Angeles, CA
Who joined April 19, 2004, 4:25 p.m.

Wrote the following at June 4, 2006, 1:37 a.m...

ulenz wrote: What is NASTRAN ?

An engineering application that requires heavy number crunching...

nvukovlj
From London, UK
Who joined June 9, 2003, 8:27 a.m.

Wrote the following at June 5, 2006, 4:13 p.m...

Hi guys,

Well, I managed to compile the BOINC client (in the process adding the code to correctly identify the RAM, swap space, number of CPUs) and the SETI@home enhanced client.
I haven't had the time to package this properly and the binaries have some dependencies they shouldn't right now, but if you follow the instructions on my download page, they should work until I get around to creating a proper tardist.
Some info on the way the binaries were compiled:
1. BOINC client gcc/g++ 3.2 (the Nekoware gcc 3.4 lacks libstdc++ which is required). No real optimisation, but it isn't required for this binary.
2. SETI@home client - gcc/g++ 3.2 - Unfortunately, porting this to MipsPro (I have only 7.3.1.3) would be an exercise in frustration, however,I have tried to build it as optimised as possible (i.e. -O3 -mips4 -mabi=n32 -mfused-madd -fomit-frame-pointer -funroll-loops).
In adiition to this - the SETI@home binary is now linked (statically) against libfftw (3.1.1 or above) and it is within this library that a lot of the computation takes place.
Fortunately, this library was written in C and by people who had cross-platform portability in mind, so it compiles well using MipsPro. Incidentally, the seti porting guys have been playing with the lib more recently, and it is already showing signs of becoming less portable. I compiled the original. I doubt that any changes made would improve performance on MIPS chips, but I will test this eventually.
The library was compiled with:
-O3 -mips4 -IPA -TARG:madd=ON:platform=ip30 -OPT:Olimit=0, i.e. fairly aggressively.

Note: I didn't use -Ofast as I thought that it may have too much of an impact on floating point values.
The library was compiled in single precision mode - gives approximately 4% speed increase over standard (double precision) mode.
Hmm, I wonder whether performance would be better if calls to FFTW were replaced with the SCSL implementation. Unfortunately, I won't have the time to try this.

Anyway, the current archive is here:
http://nikv.pwp.blueyonder.co.uk/

The directory structure and the app_info.xml file are already set up for SETI@home enhanced. All you need to do (once you have installed the pre-reqs and the LD_LIBRARY_PATH has been set up) is to run 'boinc_client' giving the seti project url and your account key. Run boinc_client --help for instructions.
Boinc now includes 'boinc_cmd' binary which lets you check on the progress of the calculation. 'boinc_cmd --help' for more instructions.

Anyway, I am planning to package this up as a tardist in the next few weeks.
In the meantime, enjoy and let me know if it works for you.

Nik.

Frapazoid
From Poznan, Poland
Who joined May 23, 2006, 9:49 a.m.

Wrote the following at June 5, 2006, 5:02 p.m...

I have a much more serious and important question.

How come it says Team Picard but the topbanner on the site shows the retro Kirk Enterprise?

Maverick 3: Athlon X2 7750, 2gb, Windows Vista
Frank Dux: SGI Octane2 R12k 400mhz 1.5gb

"Chief, look! I learned to make fire! Who knows what we could do with this... We should learn to control it!"

"Ridiculous. How can you justify wasting time and effort on this so-called 'fire' when our children are freezing to death at night?"

kshuff
From Jonas, PA USA
Who joined Jan. 8, 2005, 8:13 p.m.

Wrote the following at June 5, 2006, 8:23 p.m...

nvukovlj wrote: Hi guys,

Well, I managed to compile the BOINC client (in the process adding the code to correctly identify the RAM, swap space, number of CPUs) and the SETI@home enhanced client.
I haven't had the time to package this properly and the binaries have some dependencies they shouldn't right now, but if you follow the instructions on my download page, they should work until I get around to creating a proper tardist.
Some info on the way the binaries were compiled:
1. BOINC client gcc/g++ 3.2 (the Nekoware gcc 3.4 lacks libstdc++ which is required). No real optimisation, but it isn't required for this binary.
2. SETI@home client - gcc/g++ 3.2 - Unfortunately, porting this to MipsPro (I have only 7.3.1.3) would be an exercise in frustration, however,I have tried to build it as optimised as possible (i.e. -O3 -mips4 -mabi=n32 -mfused-madd -fomit-frame-pointer -funroll-loops).
In adiition to this - the SETI@home binary is now linked (statically) against libfftw (3.1.1 or above) and it is within this library that a lot of the computation takes place.
Fortunately, this library was written in C and by people who had cross-platform portability in mind, so it compiles well using MipsPro. Incidentally, the seti porting guys have been playing with the lib more recently, and it is already showing signs of becoming less portable. I compiled the original. I doubt that any changes made would improve performance on MIPS chips, but I will test this eventually.
The library was compiled with:
-O3 -mips4 -IPA -TARG:madd=ON:platform=ip30 -OPT:Olimit=0, i.e. fairly aggressively.

Note: I didn't use -Ofast as I thought that it may have too much of an impact on floating point values.
The library was compiled in single precision mode - gives approximately 4% speed increase over standard (double precision) mode.
Hmm, I wonder whether performance would be better if calls to FFTW were replaced with the SCSL implementation. Unfortunately, I won't have the time to try this.

Anyway, the current archive is here:
http://nikv.pwp.blueyonder.co.uk/

The directory structure and the app_info.xml file are already set up for SETI@home enhanced. All you need to do (once you have installed the pre-reqs and the LD_LIBRARY_PATH has been set up) is to run 'boinc_client' giving the seti project url and your account key. Run boinc_client --help for instructions.
Boinc now includes 'boinc_cmd' binary which lets you check on the progress of the calculation. 'boinc_cmd --help' for more instructions.

Anyway, I am planning to package this up as a tardist in the next few weeks.
In the meantime, enjoy and let me know if it works for you.

Nik.

Way cool, thanks Nik. I'll download tomorrow and let you know how I make out

-ks

See them all >here<

nvukovlj
From London, UK
Who joined June 9, 2003, 8:27 a.m.

Wrote the following at June 6, 2006, 12:12 a.m...

One thing I forgot to mention - the gcc libraries (stdc++, gcc_lib) will currently have to go into /usr/local/lib. Sorry about that.
My plan is to compile gcc 3.4.6 and upload that to Nekoware and then compile these binaries using that version of gcc/g++ so that a proper pre-req. order can be created.

Nik.

kshuff
From Jonas, PA USA
Who joined Jan. 8, 2005, 8:13 p.m.

Wrote the following at June 22, 2006, 3:15 p.m...

nvukovlj wrote:

kshuff wrote:
Hey Nik, have you had a chance to package this into a tardist yet?

Hi,

I will try to do it this weekend. Didn't get the chance to do it in the past week.

Nik.

You have the same problem as me, too many projects, not enough time

-ks

See them all >here<

yetanother**ixuser
From Flynn's Arcade
Who joined May 21, 2004, 4:47 a.m.

Wrote the following at June 22, 2006, 3:15 p.m...

ulenz wrote: What is NASTRAN ?

Nasa Structural Analysis System, whatever that shit might do!?

Maybe something like finite element crap.

joerg
From In an origin rack - Germany
Who joined Jan. 8, 2004, 6:57 a.m.

Wrote the following at June 23, 2006, 3:39 a.m...

Yes the works.... but as previous boinc version it works like a blackhole. Dunno how seti work internaly. As reportet earlier the project have bandwidht problems and not enough WU for all clients.

Also a big problem is coming up after an outage. Must be the same like a Ddos attack :).

To avoid this the client sets a long timeout period befor start with reconecting. If you take a look into one of the XML file you can see a unixtimestamp value when the client connect next time to the network. I have to wait more than 24h :)

After this time my client starts download WUs. But running the client like in the pass doesnt work so good anymore.

Code: Select all


   nohup npri -w ./boinc_client >> boinc.log &

- A lot of seti tasks shown as sleeping status when using top, but 99% cpu
- Sometime there is no activity. If i restart boinc the seti starts resuming
- Sometime boinc went away

I have no clue about these warnings

Code: Select all


   2006-06-21 18:46:41 [---] Process 418475 not found
   

   

   2006-06-21 13:43:57 [---] Using earliest-deadline-first scheduling because computer is overcommitted.
   

   2006-06-21 13:43:57 [---] Suspending work fetch because computer is overcommitted.
   

   2006-06-22 21:12:46 [SETI@home] Resuming task 01ap99ab.20150.22944.390890.3.10_0 using setiathome_enhanced version 512
   

   2006-06-22 21:12:46 [SETI@home] Deferring task 01ap99ab.20150.22944.390890.3.13_1

I also attached the Einstein project to this boinc client. But it looks they have updated the client and older einstein versions didnt get any work and there is no source of the project.

Code: Select all


   [o2k]:/usr/people/beh/krc $ pstree -p 488824
   

   -+- 00001 root /etc/init
   

   \-+- 488709 root screen -R boinc
   

   \-+- 488723 beh /usr/nekoware/bin/bash
   

   \-+- 488824 beh ./boinc_client
   

   |--- 513375 beh setiathome-5.12.mips-sgi-irix
   

   |--- 514759 beh setiathome-5.12.mips-sgi-irix
   

   |--- 519186 beh setiathome-5.12.mips-sgi-irix
   

   |--- 502245 beh setiathome-5.12.mips-sgi-irix
   

   |--- 526817 beh setiathome-5.12.mips-sgi-irix
   

   |--- 509293 beh setiathome-5.12.mips-sgi-irix
   

   |--- 509758 beh setiathome-5.12.mips-sgi-irix
   

   |--- 533112 beh setiathome-5.12.mips-sgi-irix
   

   |--- 488815 beh setiathome-5.12.mips-sgi-irix
   

   |--- 488830 beh setiathome-5.12.mips-sgi-irix
   

   |--- 488834 beh setiathome-5.12.mips-sgi-irix
   

   |--- 488835 beh setiathome-5.12.mips-sgi-irix
   

   |--- 488837 beh setiathome-5.12.mips-sgi-irix
   

   |--- 488842 beh setiathome-5.12.mips-sgi-irix
   

   |--- 488845 beh setiathome-5.12.mips-sgi-irix
   

   |--- 488849 beh setiathome-5.12.mips-sgi-irix
   

   |--- 488851 beh setiathome-5.12.mips-sgi-irix
   

   |--- 488854 beh setiathome-5.12.mips-sgi-irix
   

   |--- 488861 beh setiathome-5.12.mips-sgi-irix
   

   \--- 488864 beh setiathome-5.12.mips-sgi-irix

As a notice. It looks like that it needs more time now to compute a WU.

In the seti Forum i have read something about a reference WU which can be used for benchmarking.

@nvukovlj
can you provide your patched how getting boinc/seti compiled? I would like to take a look of the use of non nekoware libs like zlib,libjpeg. If i can work it out i would like to create a neko_boinc package.

regards
Joerg

http://www.irixworld.net

AX
From Damascus, Oregon
Who joined April 27, 2005, 9:18 p.m.

Wrote the following at June 23, 2006, 6:03 a.m...

Tried a few of your suggestions.

I am assuming that you are using the app_info.xml I included in the archive.

Yes I am.

It is possible that the seti client can't start up. Have you tried starting the seti client from the same shell you have used to start the boinc client ?

Tried running Seti by itself and yes you are right it does not start like it should. I get this error even after verifying Neko openssl is loaded and adding a setenv library path variable to its location.

Code: Select all


   Octane 5% ./setiathome-5.12.mips-sgi-irix
   

   15143:./setiathome-5.12.mips-sgi-irix: rld: Warning: Version search suppressed in ./setiathome-5.12.mips-sgi-irix because version (sgi0.9.7) of object libssl.so in liblist is not an sgi interface version.
   

   15143:./setiathome-5.12.mips-sgi-irix: rld: Fatal Error: Cannot Successfully map soname 'libssl.so' under any of the filenames /usr/lib32/libssl.so:/usr/lib32/internal/libssl.so:/lib32/libssl.so:/opt/lib32/libssl.so:

Thanks for your help.

JR

ulenz
From Hamburg, Germany
Who joined May 14, 2004, 11:09 a.m.

Wrote the following at June 25, 2006, 12:22 p.m...

Well, I don't have any problems running einstein@home and setihome@enhanced on my PowerMac G5 and MacOSX.
Let's face it, guys:
The crunching power of older SGI-MIPS-cpus is poor in comparison with actual AMD-/Intel-cpus. Moreover, there are only a few machines available. Therefore it doesn't make much sense any longer to develop Irix-clients for distributed computing. Too much electricity consumption and too less crunching power.

IRIX and Software

Seti Enhanced - Page 1