SGI: hinv

Onyx2 Rack. 8xR12K+32xR10K. 7Gb. IR2 (upgrade)

Now when I succeeded with this, I decided to enter this under a topic of its own. The beginning of this story can be found at viewtopic.php?f=14&t=16725329
Today I hooked up the systems, my Onyx2 rack + Origin racks. I have gotten a bunch of directory ram from tesla, so everything was ready.
It is a mix of 8xR12000@300MHz and 32xR10000@250MHz and I used the Xpresslink cables to connect the two systems.

I organized all memory I had, equally over the nodeboards. This took more than one bank on each nodeboard, and I put a directory ram into the first slot.
Then this happened

Code: Select all

IP27 PROM SGI Version 6.156  built 11:27:56 AM Nov 18, 2003
*** Mixed standard and premium memory:
*** Treating all as standard.
Testing/Initializing memory ...............      DONE
Copying PROM code to memory ...............      DONE
Discovering local IO ......................
'Treating all as standard' :( . Unfortunatelly not totally unexpected, and it ended in

Code: Select all

*** This configuration requires all nodes to have premium DIMMS.
*** /hw/module/1/slot/n1 not premium
etc...
Going to die...
So after unscrewing 40 philips screws and 40 hex socket screws, organizing memory and screwing it back together, I had to do it all over again.
This time I only put memory in the first bank.
I really don't like those compression connectors, my fingers hurts from that small Allen key :?


The MMSC and the quite long list of cpus in the osview.


And of course the 'hinv'

Code: Select all

Processor 0: 300 MHZ IP27
CPU: MIPS R12000 Processor Chip Revision: 2.3
FPU: MIPS R12010 Floating Point Chip Revision: 2.3
Processor 1: 300 MHZ IP27
CPU: MIPS R12000 Processor Chip Revision: 2.3
FPU: MIPS R12010 Floating Point Chip Revision: 2.3
Processor 2: 300 MHZ IP27
CPU: MIPS R12000 Processor Chip Revision: 2.3
FPU: MIPS R12010 Floating Point Chip Revision: 2.3
Processor 3: 300 MHZ IP27
CPU: MIPS R12000 Processor Chip Revision: 2.3
FPU: MIPS R12010 Floating Point Chip Revision: 2.3
Processor 4: 300 MHZ IP27
CPU: MIPS R12000 Processor Chip Revision: 2.3
FPU: MIPS R12010 Floating Point Chip Revision: 2.3
Processor 5: 300 MHZ IP27
CPU: MIPS R12000 Processor Chip Revision: 2.3
FPU: MIPS R12010 Floating Point Chip Revision: 2.3
Processor 6: 300 MHZ IP27
CPU: MIPS R12000 Processor Chip Revision: 2.3
FPU: MIPS R12010 Floating Point Chip Revision: 2.3
Processor 7: 300 MHZ IP27
CPU: MIPS R12000 Processor Chip Revision: 2.3
FPU: MIPS R12010 Floating Point Chip Revision: 2.3
Processor 8: 250 MHZ IP27
CPU: MIPS R10000 Processor Chip Revision: 3.4
FPU: MIPS R10010 Floating Point Chip Revision: 3.4
Processor 9: 250 MHZ IP27
CPU: MIPS R10000 Processor Chip Revision: 3.4
FPU: MIPS R10010 Floating Point Chip Revision: 3.4
Processor 10: 250 MHZ IP27
CPU: MIPS R10000 Processor Chip Revision: 3.4
FPU: MIPS R10010 Floating Point Chip Revision: 3.4
Processor 11: 250 MHZ IP27
CPU: MIPS R10000 Processor Chip Revision: 3.4
FPU: MIPS R10010 Floating Point Chip Revision: 3.4
Processor 12: 250 MHZ IP27
CPU: MIPS R10000 Processor Chip Revision: 3.4
FPU: MIPS R10010 Floating Point Chip Revision: 3.4
Processor 13: 250 MHZ IP27
CPU: MIPS R10000 Processor Chip Revision: 3.4
FPU: MIPS R10010 Floating Point Chip Revision: 3.4
Processor 14: 250 MHZ IP27
CPU: MIPS R10000 Processor Chip Revision: 3.4
FPU: MIPS R10010 Floating Point Chip Revision: 3.4
Processor 15: 250 MHZ IP27
CPU: MIPS R10000 Processor Chip Revision: 3.4
FPU: MIPS R10010 Floating Point Chip Revision: 3.4
Processor 16: 250 MHZ IP27
CPU: MIPS R10000 Processor Chip Revision: 3.4
FPU: MIPS R10010 Floating Point Chip Revision: 3.4
Processor 17: 250 MHZ IP27
CPU: MIPS R10000 Processor Chip Revision: 3.4
FPU: MIPS R10010 Floating Point Chip Revision: 3.4
Processor 18: 250 MHZ IP27
CPU: MIPS R10000 Processor Chip Revision: 3.4
FPU: MIPS R10010 Floating Point Chip Revision: 3.4
Processor 19: 250 MHZ IP27
CPU: MIPS R10000 Processor Chip Revision: 3.4
FPU: MIPS R10010 Floating Point Chip Revision: 3.4
Processor 20: 250 MHZ IP27
CPU: MIPS R10000 Processor Chip Revision: 3.4
FPU: MIPS R10010 Floating Point Chip Revision: 3.4
Processor 21: 250 MHZ IP27
CPU: MIPS R10000 Processor Chip Revision: 3.4
FPU: MIPS R10010 Floating Point Chip Revision: 3.4
Processor 22: 250 MHZ IP27
CPU: MIPS R10000 Processor Chip Revision: 3.4
FPU: MIPS R10010 Floating Point Chip Revision: 3.4
Processor 23: 250 MHZ IP27
CPU: MIPS R10000 Processor Chip Revision: 3.4
FPU: MIPS R10010 Floating Point Chip Revision: 3.4
Processor 24: 250 MHZ IP27
CPU: MIPS R10000 Processor Chip Revision: 3.4
FPU: MIPS R10010 Floating Point Chip Revision: 3.4
Processor 25: 250 MHZ IP27
CPU: MIPS R10000 Processor Chip Revision: 3.4
FPU: MIPS R10010 Floating Point Chip Revision: 3.4
Processor 26: 250 MHZ IP27
CPU: MIPS R10000 Processor Chip Revision: 3.4
FPU: MIPS R10010 Floating Point Chip Revision: 3.4
Processor 27: 250 MHZ IP27
CPU: MIPS R10000 Processor Chip Revision: 3.4
FPU: MIPS R10010 Floating Point Chip Revision: 3.4
Processor 28: 250 MHZ IP27
CPU: MIPS R10000 Processor Chip Revision: 3.4
FPU: MIPS R10010 Floating Point Chip Revision: 3.4
Processor 29: 250 MHZ IP27
CPU: MIPS R10000 Processor Chip Revision: 3.4
FPU: MIPS R10010 Floating Point Chip Revision: 3.4
Processor 30: 250 MHZ IP27
CPU: MIPS R10000 Processor Chip Revision: 3.4
FPU: MIPS R10010 Floating Point Chip Revision: 3.4
Processor 31: 250 MHZ IP27
CPU: MIPS R10000 Processor Chip Revision: 3.4
FPU: MIPS R10010 Floating Point Chip Revision: 3.4
Processor 32: 250 MHZ IP27
CPU: MIPS R10000 Processor Chip Revision: 3.4
FPU: MIPS R10010 Floating Point Chip Revision: 3.4
Processor 33: 250 MHZ IP27
CPU: MIPS R10000 Processor Chip Revision: 3.4
FPU: MIPS R10010 Floating Point Chip Revision: 3.4
Processor 34: 250 MHZ IP27
CPU: MIPS R10000 Processor Chip Revision: 3.4
FPU: MIPS R10010 Floating Point Chip Revision: 3.4
Processor 35: 250 MHZ IP27
CPU: MIPS R10000 Processor Chip Revision: 3.4
FPU: MIPS R10010 Floating Point Chip Revision: 3.4
Processor 36: 250 MHZ IP27
CPU: MIPS R10000 Processor Chip Revision: 3.4
FPU: MIPS R10010 Floating Point Chip Revision: 3.4
Processor 37: 250 MHZ IP27
CPU: MIPS R10000 Processor Chip Revision: 3.4
FPU: MIPS R10010 Floating Point Chip Revision: 3.4
Processor 38: 250 MHZ IP27
CPU: MIPS R10000 Processor Chip Revision: 3.4
FPU: MIPS R10010 Floating Point Chip Revision: 3.4
Processor 39: 250 MHZ IP27
CPU: MIPS R10000 Processor Chip Revision: 3.4
FPU: MIPS R10010 Floating Point Chip Revision: 3.4
Main memory size: 7168 Mbytes
Instruction cache size: 32 Kbytes
Data cache size: 32 Kbytes
Secondary unified instruction/data cache size: 8 Mbytes
Secondary unified instruction/data cache size: 8 Mbytes
Secondary unified instruction/data cache size: 8 Mbytes
Secondary unified instruction/data cache size: 8 Mbytes
Secondary unified instruction/data cache size: 8 Mbytes
Secondary unified instruction/data cache size: 8 Mbytes
Secondary unified instruction/data cache size: 8 Mbytes
Secondary unified instruction/data cache size: 8 Mbytes
Secondary unified instruction/data cache size: 4 Mbytes
Secondary unified instruction/data cache size: 4 Mbytes
Secondary unified instruction/data cache size: 4 Mbytes
Secondary unified instruction/data cache size: 4 Mbytes
Secondary unified instruction/data cache size: 4 Mbytes
Secondary unified instruction/data cache size: 4 Mbytes
Secondary unified instruction/data cache size: 4 Mbytes
Secondary unified instruction/data cache size: 4 Mbytes
Secondary unified instruction/data cache size: 4 Mbytes
Secondary unified instruction/data cache size: 4 Mbytes
Secondary unified instruction/data cache size: 4 Mbytes
Secondary unified instruction/data cache size: 4 Mbytes
Secondary unified instruction/data cache size: 4 Mbytes
Secondary unified instruction/data cache size: 4 Mbytes
Secondary unified instruction/data cache size: 4 Mbytes
Secondary unified instruction/data cache size: 4 Mbytes
Secondary unified instruction/data cache size: 4 Mbytes
Secondary unified instruction/data cache size: 4 Mbytes
Secondary unified instruction/data cache size: 4 Mbytes
Secondary unified instruction/data cache size: 4 Mbytes
Secondary unified instruction/data cache size: 4 Mbytes
Secondary unified instruction/data cache size: 4 Mbytes
Secondary unified instruction/data cache size: 4 Mbytes
Secondary unified instruction/data cache size: 4 Mbytes
Secondary unified instruction/data cache size: 4 Mbytes
Secondary unified instruction/data cache size: 4 Mbytes
Secondary unified instruction/data cache size: 4 Mbytes
Secondary unified instruction/data cache size: 4 Mbytes
Secondary unified instruction/data cache size: 4 Mbytes
Secondary unified instruction/data cache size: 4 Mbytes
Secondary unified instruction/data cache size: 4 Mbytes
Secondary unified instruction/data cache size: 4 Mbytes
Integral SCSI controller 16: Version Fibre Channel AIC-1160, revision 2
Integral SCSI controller 18: Version QL1040B (rev. 2), single ended
Integral SCSI controller 24: Version QL1040B, single ended
Disk drive: unit 2 on SCSI controller 24
Disk drive: unit 4 on SCSI controller 24
CDROM: unit 6 on SCSI controller 24
Integral SCSI controller 12: Version QL1040B, single ended
CDROM: unit 6 on SCSI controller 12
Integral SCSI controller 10: Version QL1040B (rev. 2), single ended
CDROM: unit 6 on SCSI controller 10
Integral SCSI controller 0: Version QL1040B (rev. 2), single ended
Disk drive: unit 1 on SCSI controller 0
Disk drive: unit 2 on SCSI controller 0
Disk drive: unit 3 on SCSI controller 0
Disk drive: unit 4 on SCSI controller 0
CDROM: unit 6 on SCSI controller 0
Integral SCSI controller 14: Version QL1040B (rev. 2), single ended
CDROM: unit 6 on SCSI controller 14
Integral SCSI controller 1: Version QL1040B (rev. 2), single ended
Integral SCSI controller 25: Version QL1040B, single ended
Integral SCSI controller 13: Version QL1040B, single ended
Integral SCSI controller 11: Version QL1040B (rev. 2), single ended
Integral SCSI controller 15: Version QL1040B (rev. 2), single ended
Integral SCSI controller 19: Version QL1040B (rev. 2), differential
Integral SCSI controller 17: Version Fibre Channel AIC-1160, revision 2
Integral SCSI controller 22: Version Fibre Channel QL2200
Integral SCSI controller 20: Version QL1040B (rev. 2), differential
Integral SCSI controller 23: Version Fibre Channel QL2200A
Integral SCSI controller 21: Version QL1040B (rev. 2), differential
IOC3/IOC4 serial port: tty25
IOC3/IOC4 serial port: tty1
IOC3/IOC4 serial port: tty2
IOC3/IOC4 serial port: tty26
IOC3/IOC4 serial port: tty17
IOC3/IOC4 serial port: tty18
IOC3/IOC4 serial port: tty13
IOC3/IOC4 serial port: tty14
IOC3/IOC4 serial port: tty11
IOC3/IOC4 serial port: tty12
IOC3/IOC4 serial port: tty16
IOC3/IOC4 serial port: tty15
IOC3/IOC4 serial port: tty19
IOC3/IOC4 serial port: tty20
IOC3/IOC4 serial port: tty21
IOC3/IOC4 serial port: tty22
IOC3/IOC4 serial port: tty23
IOC3/IOC4 serial port: tty24
IOC3 parallel port: plp2
Graphics board: InfiniteReality2
Integral Fast Ethernet: ef0, version 1, module 7, slot io1, pci 2
Fast Ethernet: ef12, version 1, module 1, slot io1, pci 2
Fast Ethernet: ef6, version 1, module 3, slot io1, pci 2
Fast Ethernet: ef5, version 1, module 2, slot io1, pci 2
Fast Ethernet: ef7, version 1, module 4, slot io1, pci 2
Fast Ethernet: ef8, version 1, module 7, slot io3, pci 0
Fast Ethernet: ef9, version 1, module 7, slot io3, pci 1
Fast Ethernet: ef10, version 1, module 7, slot io3, pci 2
Fast Ethernet: ef11, version 1, module 7, slot io3, pci 3
Iris Audio Processor: version RAD revision 7.0, number 2
Origin FIBRE CHANNEL board, module 7 slot 4: Revision 4
Origin MSCSI board, module 7 slot 10: Revision 4
Origin BASEIO board, module 2 slot 1: Revision 4
Origin BASEIO board, module 7 slot 1: Revision 4
Origin BASEIO board, module 1 slot 1: Revision 3
Origin BASEIO board, module 3 slot 1: Revision 3
Origin BASEIO board, module 4 slot 1: Revision 3
Origin MENET board, module 7 slot 3: Revision 4
DIVO Video: controller 1 unit 0: Input, Output
IOC3/IOC4 external interrupts: 5
IOC3/IOC4 external interrupts: 1
IOC3/IOC4 external interrupts: 3
IOC3/IOC4 external interrupts: 2
IOC3/IOC4 external interrupts: 4

The interesting part of the 'hinv -v' . The memory that turns into 'premium' when you add directory ram.

Code: Select all

Memory at Module 1/Slot 1: 512 MB (enabled)
Bank 0 contains 512 MB (Premium) DIMMS (enabled)
Memory at Module 1/Slot 2: 256 MB (enabled)
Bank 0 contains 256 MB (Premium) DIMMS (enabled)
Memory at Module 1/Slot 3: 256 MB (enabled)
Bank 0 contains 256 MB (Premium) DIMMS (enabled)
Memory at Module 1/Slot 4: 256 MB (enabled)
Bank 0 contains 256 MB (Premium) DIMMS (enabled)
Memory at Module 2/Slot 1: 512 MB (enabled)
Bank 0 contains 512 MB (Premium) DIMMS (enabled)
Memory at Module 2/Slot 2: 256 MB (enabled)
Bank 0 contains 256 MB (Premium) DIMMS (enabled)
Memory at Module 2/Slot 3: 256 MB (enabled)
Bank 0 contains 256 MB (Premium) DIMMS (enabled)
Memory at Module 2/Slot 4: 256 MB (enabled)
Bank 0 contains 256 MB (Premium) DIMMS (enabled)
Memory at Module 3/Slot 1: 512 MB (enabled)
Bank 0 contains 512 MB (Premium) DIMMS (enabled)
Memory at Module 3/Slot 2: 256 MB (enabled)
Bank 0 contains 256 MB (Premium) DIMMS (enabled)
Memory at Module 3/Slot 3: 256 MB (enabled)
Bank 0 contains 256 MB (Premium) DIMMS (enabled)
Memory at Module 3/Slot 4: 256 MB (enabled)
Bank 0 contains 256 MB (Premium) DIMMS (enabled)
Memory at Module 4/Slot 1: 512 MB (enabled)
Bank 0 contains 512 MB (Premium) DIMMS (enabled)
Memory at Module 4/Slot 2: 256 MB (enabled)
Bank 0 contains 256 MB (Premium) DIMMS (enabled)
Memory at Module 4/Slot 3: 256 MB (enabled)
Bank 0 contains 256 MB (Premium) DIMMS (enabled)
Memory at Module 4/Slot 4: 256 MB (enabled)
Bank 0 contains 256 MB (Premium) DIMMS (enabled)
Memory at Module 7/Slot 1: 512 MB (enabled)
Bank 0 contains 512 MB (Premium) DIMMS (enabled)
Memory at Module 7/Slot 2: 512 MB (enabled)
Bank 0 contains 512 MB (Premium) DIMMS (enabled)
Memory at Module 7/Slot 3: 512 MB (enabled)
Bank 0 contains 512 MB (Premium) DIMMS (enabled)
Memory at Module 7/Slot 4: 512 MB (enabled)
Bank 0 contains 512 MB (Premium) DIMMS (enabled)
Theoretically I could get 10Gb with the number of directory rams I have, but I didn't want to mess around more than necessary with the memory.
I let the 128Mb sticks stay where they where.
If anyone is interested in the whole 'hinv -v' I can post it too. It is quite long.

Here is also the short version of 'gfxinfo'

Code: Select all

Graphics board 0 is "KONAL" graphics.
Managed (":0.0") 1600x1200
Display has 8 channels
4 GEs (of 4), occmask = 0x0f
4MB external BEF ram, 32bit path
4 RM7 boards (of 4) 1/1/1/1
Texture Memory: 64MB/64MB/64MB/64MB
Large pixel depth
32K cmap, 64K external gamma
(Could not contact X server; thus, no XSGIvc information available)

Now I need some demos to push its limits :) . Or I could connect 8x 21inch SGI monitors to it, if I have enough cables and some sturdy shelves.
I have two movie clips showing my power meter flashing as it measures the powerconsumption. I won't run it for longer periods of time ;)
That's the spirit!! Congratulations is in order now that you finally have it up and running.
If I can't fix it I can fix it so it can't be fixed.
:O2000: :O2000: +MXE/IO6G :Onyx: [RE2] :Fuel: :O200: :Octane: x3 :Octane2: :O2: x2 :1600SW: x3 :Indigo2IMP: x2 :Indigo2: x2 :Indigo: :Indy: x5 :320: x2, 2xSparcStation 20 and a horde of PC's
Oh man... I just adore your spirit. Wow.
:O3200: :Fuel: :Indy: :O3x02L:
A very monster!!! :shock:
bjornl wrote: The memory that turns into 'premium' when you add directory ram.

This thing interests me, the memory becomes a kind of premium if you add the direct ram? Otherwise, it is the standard?Why :?
I if I add the direct ram on the Onyx2 Deskside,I can make it premium, or no use since I have not the router from outside NUMAlink?
Another question if they are not too many, but a system that consumes so?
Thanks,
regards. :)
OMG, it is really a huuuuuuuuuuge system :O.
Image _ Betty Blue _
R12000A 400 Mhz ; 1 Gb RAM ; 72 Gb 15K HDD; IRIX 6.5.29
CrystalEyes; Dial Box; O2Cam "ZEYE"; external Toshiba SD-M1711 DVD-ROM; Octane speakers;
Lock bar; SGI microphone.
Mods: PSU Noctua fan; internal Toshiba SD-M1401 DVD-ROM; Adaptec AIC-7880P SCSI card.

_ REKIEM_I7 _
Seasonic X 1250W PSU / Intel I7 2600k 4 x 5,00 Ghz / 2 x Gainward 2Gb GTX 560Ti Phantom 2 / 32 Gb DDR3 / Intel x25-M 160 Gb SSD and 10 extra Tb
_ REKIEM_T5400 _
875W PSU / 2 x Intel Xeon Harpertown 4 x 3,33 Ghz / 1 x EVGA Geforce 4Gb GTX 980 Supercloked / 32 Gb DDR2 667 ECC / Samsung 840 Series Pro 128GB SSD and 3 extra Tb
_ Raspberry Pi _
:|
Holy crap... O.o Shiny....
MAYA, nut-
:Octane2: :Octane2: Octane 2 R14k 600 V12 4GB, Octane2 R14K 600 V10 1GB ,
:Onyx2: :Onyx2: Onyx2 IR3 4GB Quad R14K 500 DIVO, Onyx2 IR Quad R12K 400 2GB,
:Indigo2: SGI Indigo 2 R8K75 TEAL Extreme 256MB,
:Indigo2IMP: SGI Indigo 2 R10K 195 Solid Impact 256MB, MAX Impact Pending
,
Apple G5 Quad, NV Quadro 4500 + 7800GT, 12GB RAM
Sun Blade 1000 Dual 900 XVR 1000 4GB
Sun Blade 2000 Dual 1200 XVR 1200 8GB
Thank you. It is fun when its working.

I have a deskside, I'm going to try to fit in there. Just need another pair of long craylink cables.
I assume O200 craylinks are electrically compatible so I can use them for shorter distances.
Me needs larger garage ...

gambonyx wrote: This thing interests me, the memory becomes a kind of premium if you add the direct ram? Otherwise, it is the standard?Why :?
I if I add the direct ram on the Onyx2 Deskside,I can make it premium, or no use since I have not the router from outside NUMAlink?
Another question if they are not too many, but a system that consumes so?

If you read on the standard memory sticks, it says something about DIR memory. For example a double stacked 256MB stick says 16MB DIR,
a double stacked 64MB stick says 4MB DIR. I don't know if that mean how much DIR is required for each stick. Maybe there is a small amount
of DIR mem on all sticks, but insufficient for larger setup. There are only two kinds, as far as I know. 16MB and 64MB DIR memory sticks,
and for the 256MB sticks you need the 64MB DIR.
Also, in a Onyx2 deskside I don't think there is any use for it, becauses it cannot route to anything else. Maybe coolness factor in 'hinv' :-)
On the other hand, it is needed in a Origin2000 deskside if you have the correct routers to connect it to something bigger than 32 cpus.
bjornl wrote: If you read on the standard memory sticks, it says something about DIR memory. For example a double stacked 256MB stick says 16MB DIR,
a double stacked 64MB stick says 4MB DIR. I don't know if that mean how much DIR is required for each stick. Maybe there is a small amount
of DIR mem on all sticks, but insufficient for larger setup. There are only two kinds, as far as I know. 16MB and 64MB DIR memory sticks,
and for the 256MB sticks you need the 64MB DIR.
Also, in a Onyx2 deskside I don't think there is any use for it, becauses it cannot route to anything else. Maybe coolness factor in 'hinv'
On the other hand, it is needed in a Origin2000 deskside if you have the correct routers to connect it to something bigger than 32 cpus.

Thanks for explanation bjornl,And just so there 'written above the 16mb of the double RAM modules of 64mb, but however' I noticed a particular, I also took a form of O2 modules(is a single Dimm) 32mb and there 'written 16mb(O2 has no direct Ram).
It is perhaps significant that the side and two sides is being 16x2=32mb should be the explanation, 'cause those are the Onyx2 type double to 4 faces
and always cover 16mb (16x4 = 64mb).
To see the 256mb I have to remove a node, tomorrow I look and I say, I got on individual onyx2 DIMM 256MB, so if you and everything just like I think I should find written 128Mb. Tomorrow unmount and look. :)
But what consumes your monster in watts?