SGI: hinv

Origin 300, 8xR14k 600MHz, 8GB RAM - 2 Bricks, L2, Router

smj avatar
smj
Donor
From Berkeley, CA, USA, NA, Earth, Sol
Who joined Nov. 12, 2007, 7:54 p.m.
Wrote the following at Nov. 11, 2010, 3:23 a.m...
Edit: Updated 25 Mar 2012, added a picture

First posting is an up-to-date system configuration, see latest comments for what was changed etc.

Not much interesting to say about adding an L2...

Code: Select all

M2100887-001-L2>cfg
L2 10.10.10.107: - 001 (LOCAL)
L1 10.10.10.107:1:0      - 001r08
L1 10.10.10.107:2:0      - 001c02
L1 10.10.10.107:0:0      - 001c01
M2100887-001-L2>


But the PROM initialization changes a tiny bit with the addition of the NUMALink Router:

Code: Select all

M2100887-001-L2>* pwr up
M2100887-001-L2>^D
entering system console mode (001c01 CPU0), <CTRL_T> to escape to L2
Starting PROM Boot process
Starting PROM Boot process


IP35 PROM SGI Version 6.210  built 02:33:51 PM Aug 26, 2004


IP35 PROM SGI Version 6.210  built 02:33:51 PM Aug 26, 2004
Testing/Initializing memory ..........Testing/Initializing memory ............DONE
Copying PROM code to memory ...............             DONE
..Discovering local IO ......................           DONE
Discovering NUMAlink connectivity .........             DONE
Found 3 objects (2 hubs, 1 routers) in 106643 usec
Waiting for peers to complete discovery....             ....            DONE
Copying PROM code to memory ...............             DONE
Discovering local IO ......................             DONE
Discovering NUMAlink connectivity .........             DONE
Found 3 objects (2 hubs, 1 routers) in 22785 usec
Waiting for peers to complete discovery....             DONE
Global master is /hw/rack/001/bay/01
DONE
Global master is /hw/rack/001/bay/01
Intializing any CPUless nodes..............             DONE
Checking partitioning information .........             DONE
Checking partitioning information .........             DONE
Local slave entering slave loop
Local slave entering slave loop
Local slave entering slave loop
Local master entering slave loop
Loading BASEIO prom .......................             Local slave entering slave loop
Local slave entering slave loop
Local slave entering slave loop
DONE

BASEIO PROM Monitor SGI Version 6.210  built 02:30:38 PM Aug 26, 2004 (BE64)
8 CPUs on 2 nodes found.
Automatic update of PROM environment disabled
Installing PROM Device drivers ............
Base I/O Ethernet set to /dev/ethernet/ef0

Walking SCSI Adapter 0, (pci id 1)
1+ Device Vendor Product: IBM-SSG S53D073
2- 3- 4- 5- 6- 7- 8- 9- 10- 11- 12- 13- 14- 15- = 1 device(s)


Walking SCSI Adapter 1, (pci id 1)
1- 2- 3- 4- 5- 6- 7- 8- 9- 10- 11- 12- 13- 14- 15- = 0 device(s)

Initializing PROM Device drivers ..........             DONE
Checking hardware inventory ...............              DONE

**** System Configuration and Diagnostics Summary ****
CONFIG:
No. of NODEs enabled    = 2
No. of NODEs disabled   = 0
No. of CPUs enabled     = 8
No. of CPUs disabled    = 0
Mem enabled             = 8192 MB
Mem disabled            = 0 MB
No. of RTRs enabled     = 1
No. of RTRs disabled    = 0

DIAG RESULTS:
ALL DIAGS PASSED.
**** End System Configuration and Diagnostics Summary ****


System Maintenance Menu

1) Start System
2) Install System Software
3) Run Diagnostics
4) Recover System
5) Enter Command Monitor

Option? 5
Command Monitor.  Type "exit" to return to the menu.
>> hinv
System  SGI-IP35
8 600 MHz IP35 Processors
Main memory size: 8192 Mbytes
Integral Fast Ethernet
IOC3 serial port
USB (OHCI interface)
Integral Fast Ethernet
IOC3 serial port
USB (OHCI interface)
Integral SCSI controller 0: Version Qlogic 12160
Disk drive: unit 1 on SCSI Controller 0, (dksc(0,1,0))
Integral SCSI controller 1: Version Qlogic 12160
>>


Here's the IRIX-level hinv from a scratch install of 6.5.22:

Code: Select all

IRIS 12# hinv -vm
Location: /hw/module/001c01/node
IP45_4CPU Board: barcode MYS631     part 030-1797-001 rev -B
Location: /hw/module/001c01/Ibrick/xtalk/14
IO8 Board: barcode MMJ437     part 030-1673-003 rev -G
Location: /hw/module/001c01/Ibrick/xtalk/15
IO8 Board: barcode MMJ437     part 030-1673-003 rev -G
Location: /hw/module/001c02/node
IP45_4CPU Board: barcode MMH445     part 030-1797-001 rev -B
Location: /hw/module/001c02/Ibrick/xtalk/14
IO8 Board: barcode MJS307     part 030-1673-003 rev -F
Location: /hw/module/001c02/Ibrick/xtalk/15
IO8 Board: barcode MJS307     part 030-1673-003 rev -F
8 600 MHZ IP35 Processors
CPU: MIPS R14000 Processor Chip Revision: 2.4
FPU: MIPS R14010 Floating Point Chip Revision: 2.4
CPU 0 at Module 001c01/Slot 0/Slice A: 600 Mhz MIPS R14000 Processor Chip (enabled)
Processor revision: 2.4. Scache: Size 4 MB Speed 300 Mhz  Tap 0xa
CPU 1 at Module 001c01/Slot 0/Slice B: 600 Mhz MIPS R14000 Processor Chip (enabled)
Processor revision: 2.4. Scache: Size 4 MB Speed 300 Mhz  Tap 0xa
CPU 2 at Module 001c01/Slot 0/Slice C: 600 Mhz MIPS R14000 Processor Chip (enabled)
Processor revision: 2.4. Scache: Size 4 MB Speed 300 Mhz  Tap 0xa
CPU 3 at Module 001c01/Slot 0/Slice D: 600 Mhz MIPS R14000 Processor Chip (enabled)
Processor revision: 2.4. Scache: Size 4 MB Speed 300 Mhz  Tap 0xa
CPU 4 at Module 001c02/Slot 0/Slice A: 600 Mhz MIPS R14000 Processor Chip (enabled)
Processor revision: 2.4. Scache: Size 4 MB Speed 300 Mhz  Tap 0xa
CPU 5 at Module 001c02/Slot 0/Slice B: 600 Mhz MIPS R14000 Processor Chip (enabled)
Processor revision: 2.4. Scache: Size 4 MB Speed 300 Mhz  Tap 0xa
CPU 6 at Module 001c02/Slot 0/Slice C: 600 Mhz MIPS R14000 Processor Chip (enabled)
Processor revision: 2.4. Scache: Size 4 MB Speed 300 Mhz  Tap 0xa
CPU 7 at Module 001c02/Slot 0/Slice D: 600 Mhz MIPS R14000 Processor Chip (enabled)
Processor revision: 2.4. Scache: Size 4 MB Speed 300 Mhz  Tap 0xa
Main memory size: 8192 Mbytes
Instruction cache size: 32 Kbytes
Data cache size: 32 Kbytes
Secondary unified instruction/data cache size: 4 Mbytes
Memory at Module 001c01/Slot 0: 4096 MB (enabled)
Bank 0 contains 1024 MB (Premium) DIMMS (enabled)
Bank 1 contains 1024 MB (Premium) DIMMS (enabled)
Bank 2 contains 1024 MB (Premium) DIMMS (enabled)
Bank 3 contains 1024 MB (Premium) DIMMS (enabled)
Memory at Module 001c02/Slot 0: 4096 MB (enabled)
Bank 0 contains 1024 MB (Premium) DIMMS (enabled)
Bank 1 contains 1024 MB (Premium) DIMMS (enabled)
Bank 2 contains 1024 MB (Premium) DIMMS (enabled)
Bank 3 contains 1024 MB (Premium) DIMMS (enabled)
Integral SCSI controller 0: Version QL12160, low voltage differential
Disk drive: unit 1 on SCSI controller 0 (unit 1)
Integral SCSI controller 1: Version QL12160, low voltage differential
Integral SCSI controller 6: Version QL12160, low voltage differential
Integral SCSI controller 7: Version QL12160, low voltage differential
IOC3/IOC4 serial port: tty3
IOC3/IOC4 serial port: tty4
IOC3/IOC4 serial port: tty5
IOC3/IOC4 serial port: tty6
Integral Fast Ethernet: ef0, version 1, module 001c01, pci 4
Fast Ethernet: ef1, version 1, module 001c02, pci 4
PCI Adapter ID (vendor 4096, device 1600) pci slot 1
PCI Adapter ID (vendor 4096, device 1600) pci slot 1
PCI Adapter ID (vendor 4096, device 1600) pci slot 1
PCI Adapter ID (vendor 4096, device 1600) pci slot 1
PCI Adapter ID (vendor 4215, device 4630) pci slot 1
PCI Adapter ID (vendor 4265, device 3) pci slot 4
PCI Adapter ID (vendor 4545, device 22530) pci slot 5
PCI Adapter ID (vendor 4215, device 4630) pci slot 1
PCI Adapter ID (vendor 4265, device 3) pci slot 4
PCI Adapter ID (vendor 4545, device 22530) pci slot 5
IOC3/IOC4 external interrupts: 1
IOC3/IOC4 external interrupts: 2
HUB in Module 001c01/Slot 0: Revision 2 Speed 200.00 Mhz (enabled)
HUB in Module 001c02/Slot 0: Revision 2 Speed 200.00 Mhz (enabled)
IP35prom in Module 001c01/Slot n0: Revision 6.210
IP35prom in Module 001c02/Slot n0: Revision 6.210
USB controller: type OHCI
USB controller: type OHCI
IRIS 13#

Here's what the stack currently looks like (the L2 is out of sight, and the Xserve G5 is unrelated of course):
Then? :IRIS3130: ... Now? :O3x02L: :A3504L: - :A3502L: :1600SW: +MLA :Fuel: :Octane2: :Octane: :Indigo2IMP: :Indy: ... Other: DEC :BA213: :BA123: Sun , DG AViiON , NeXT :Cube:
smj avatar
smj
Donor
From Berkeley, CA, USA, NA, Earth, Sol
Who joined Nov. 12, 2007, 7:54 p.m.
Wrote the following at Nov. 11, 2010, 3:31 a.m...
[ This post now includes the original first and second posts in this thread, so that
[ the first post can be updated to reflect the current state of the system at any
[ given time.

Thu Nov 11, 2010 3:23 am

Making due with PROM hinv output for the time being... But since I NUMAlinked the two modules and brought them up to the PROM and in sync as a single system for the first time, I figured it was time to post a hinv.

RAM in all slots is 030-1060-004 1GB modules, and each machine came with an 030-2097-001 "4Gb dual link FibreChannel HBA" in the top PCI slot.

L1 Info

Code: Select all

001c01-L1>* serial all
001c01:

Data                            Location      Value
------------------------------  ------------  --------
Local System Serial Number      NVRAM         M2001730
Reference System Serial Number  Attached C    M2001730
Local Brick Serial Number       EEPROM        MYS631
Reference Brick Serial Number   NVRAM         MYS631


EEPROM      Product Name    Serial         Part Number           Rev  T/W
----------  --------------  -------------  --------------------  ---  ------
NODE        IP45_4CPU       MYS631         030_1797_001          B    00
IO8         IO8             MMJ437         030_1673_003          G    00

EEPROM     JEDEC-SPD Info           Part Number        Rev  Speed  SGI
---------- ------------------------ ------------------ ---- ------ --------
DIMM 0     CE000000000000000C07FD00 M3 46L2820ET3-CA0   3E   10.0  N/A
DIMM 2     CE000000000000000C96DD00 M3 46L2820ET3-CA0   3E   10.0  N/A
DIMM 1     7F7FFE0000000000120003A4 CM2201B             2     8.0  N/A
DIMM 3     7F7FFE000000000012000439 CM2201B             2     8.0  N/A

001c02:

Data                            Location      Value
------------------------------  ------------  --------
Local System Serial Number      NVRAM         M2001730
Reference System Serial Number  Attached C    M2001730
Local Brick Serial Number       EEPROM        MMH445
Reference Brick Serial Number   NVRAM         MMH445


EEPROM      Product Name    Serial         Part Number           Rev  T/W
----------  --------------  -------------  --------------------  ---  ------
NODE        IP45_4CPU       MMH445         030_1797_001          B    00
IO8         IO8             MJS307         030_1673_003          F    00

EEPROM     JEDEC-SPD Info           Part Number        Rev  Speed  SGI
---------- ------------------------ ------------------ ---- ------ --------
DIMM 0     7F7FFE000000000012002984 CM2201B1            2     8.0  N/A
DIMM 2     7F7FFE000000000012002B2C CM2201B1            2     8.0  N/A
DIMM 1     CE000000000000000C3BCD00 M3 46L2820ET3-CA0   3E   10.0  N/A
DIMM 3     CE000000000000000C30CD00 M3 46L2820ET3-CA0   3E   10.0  N/A

001c01-L1> * env
001c01:
Environmental monitoring is enabled and running.

Description    State       Warning Limits     Fault Limits       Current
-------------- ----------  -----------------  -----------------  -------
12 IO    Enabled  10%  10.80/ 13.20  20%   9.60/ 14.40   12.125
12 DIG    Enabled  10%  10.80/ 13.20  20%   9.60/ 14.40   12.125
5V    Enabled  10%   4.50/  5.50  20%   4.00/  6.00    4.966
3.3V    Enabled  10%   2.97/  3.63  20%   2.64/  3.96    3.337
5V AUX    Enabled  10%   4.50/  5.50  20%   4.00/  6.00    4.966
3.3V AUX    Enabled  10%   2.97/  3.63  20%   2.64/  3.96    3.406
2.5V    Enabled  10%   2.25/  2.75  20%   2.00/  3.00    2.483
VCPU    Enabled  10%   1.44/  1.76  20%   1.28/  1.92    1.579
1.5V    Enabled  10%   1.35/  1.65  20%   1.20/  1.80    1.480

Description     State       Warning RPM  Current RPM
--------------- ----------  -----------  -----------
FAN  0     LEFT    Enabled         2160         4066
FAN  1   CENTER    Enabled         2160         4115
FAN  2    RIGHT    Enabled         2160         4115
FAN  3       PS    Enabled         2160         3245
FAN  4      PS'    Enabled         2160         4383

Advisory   Critical   Fault      Current
Description       State       Temp       Temp       Temp       Temp
----------------- ----------  ---------  ---------  ---------  ---------
0 NODE 0            Enabled   40C/104F   46C/114F   49C/120F   24C/ 75F
1 NODE 1            Enabled   40C/104F   46C/114F   49C/120F   23C/ 73F

001c02:
Environmental monitoring is enabled and running.

Description    State       Warning Limits     Fault Limits       Current
-------------- ----------  -----------------  -----------------  -------
12 IO    Enabled  10%  10.80/ 13.20  20%   9.60/ 14.40   12.063
12 DIG    Enabled  10%  10.80/ 13.20  20%   9.60/ 14.40   12.063
5V    Enabled  10%   4.50/  5.50  20%   4.00/  6.00    4.992
3.3V    Enabled  10%   2.97/  3.63  20%   2.64/  3.96    3.337
5V AUX    Enabled  10%   4.50/  5.50  20%   4.00/  6.00    4.940
3.3V AUX    Enabled  10%   2.97/  3.63  20%   2.64/  3.96    3.388
2.5V    Enabled  10%   2.25/  2.75  20%   2.00/  3.00    2.483
VCPU    Enabled  10%   1.44/  1.76  20%   1.28/  1.92    1.579
1.5V    Enabled  10%   1.35/  1.65  20%   1.20/  1.80    1.480

Description     State       Warning RPM  Current RPM
--------------- ----------  -----------  -----------
FAN  0     LEFT      [color=#FF0000]Fault[/color]         2160            [color=#FF0000]0[/color]
FAN  1   CENTER    Enabled         2160         4115
FAN  2    RIGHT    Enabled         2160         4218
FAN  3       PS    Enabled         2160         3214
FAN  4      PS'    Enabled         2160         4383

Advisory   Critical   Fault      Current
Description       State       Temp       Temp       Temp       Temp
----------------- ----------  ---------  ---------  ---------  ---------
0 NODE 0            Enabled   40C/104F   46C/114F   49C/120F   27C/ 80F
1 NODE 1            Enabled   40C/104F   46C/114F   49C/120F   24C/ 75F

001c01-L1>

001c01-L1>  ver
L1 1.48.1 (Image B), Built 01/22/2007 11:34:20  [Fuel/PE/O300 1MB image]
001c01-L1>
001c01-L1> flash status
Flash image B currently booted

Image      Status                Revision       Built
-----   -----------------       ----------      -----
A     valid                   1.46.2          10/12/2006 12:20:03
B     default                 1.48.1          01/22/2007 11:34:20

001c01-L1>


PROM Info

Code: Select all


>> modnum
001c01 001c02
>> version
BASEIO PROM Monitor SGI Version 6.210  built 02:30:38 PM Aug 26, 2004 (BE64)
>>
>> hinv -v
IP35 Node Board, Module 001c01
ASIC BEDROCK Rev 2, 200MHz, (nasid 0)
Processor A: 600 MHz R14000 Rev 2.4
Secondary Cahce 4MB 300MHz Tap 0xa , (cpu 0)
R14010FPC Rev 2.4
Processor B: 600 MHz R14000 Rev 2.4
Secondary Cahce 4MB 300MHz Tap 0xa , (cpu 1)
R14010FPC Rev 2.4
Processor C: 600 MHz R14000 Rev 2.4
Secondary Cahce 4MB 300MHz Tap 0xa , (cpu 2)
R14010FPC Rev 2.4
Processor D: 600 MHz R14000 Rev 2.4
Secondary Cahce 4MB 300MHz Tap 0xa , (cpu 3)
R14010FPC Rev 2.4
Memory on board, 4096 MBytes (Standard)
Bank 0, 1024 MBytes (Premium)  <-- (Software Bank 0)
Bank 1, 1024 MBytes (Premium)
Bank 2, 1024 MBytes (Premium)
Bank 3, 1024 MBytes (Premium)
IP35 Node Board, Module 001c02
ASIC BEDROCK Rev 2, 200MHz, (nasid 0)
Processor C: 600 MHz R14000 Rev 2.4
Secondary Cahce 4MB 300MHz Tap 0xa , (cpu 6)
R14010FPC Rev 2.4
Processor D: 600 MHz R14000 Rev 2.4
Secondary Cahce 4MB 300MHz Tap 0xa , (cpu 7)
R14010FPC Rev 2.4
Processor A: 600 MHz R14000 Rev 2.4
Secondary Cahce 4MB 300MHz Tap 0xa , (cpu 4)
R14010FPC Rev 2.4
Processor B: 600 MHz R14000 Rev 2.4
Secondary Cahce 4MB 300MHz Tap 0xa , (cpu 5)
R14010FPC Rev 2.4
Memory on board, 4096 MBytes (Standard)
Bank 0, 1024 MBytes (Premium)  <-- (Software Bank 0)
Bank 1, 1024 MBytes (Premium)
Bank 2, 1024 MBytes (Premium)
Bank 3, 1024 MBytes (Premium)
IBRICK Bridge, Module 001c01
ASIC BRIDGE Rev 2, (widget 14)
adapter ID (Vendor 1000 Device 640 class c subclass c)
(pci id 1 function 0)
adapter ID (Vendor 1000 Device 640 class c subclass c)
(pci id 1 function 1)
IBRICK Bridge, Module 001c01
ASIC BRIDGE Rev 2, (widget 15)
adapter PCI (SCSI interface) Rev 6
(pci id 1)
peripheral DISK, BUS 0, ID 1, SEAGATE ST373405LC
peripheral DISK, BUS 0, ID 2, SGI ST373405LC
adapter IOC3 Rev 1
(pci id 4)
controller multi function SuperIO
controller Ethernet Rev 1
adapter USB (OHCI interface)
(pci id 5)
IBRICK Bridge, Module 001c02
ASIC BRIDGE Rev 2, (widget 14)
adapter ID (Vendor 1000 Device 640 class c subclass c)
(pci id 1 function 0)
adapter ID (Vendor 1000 Device 640 class c subclass c)
(pci id 1 function 1)
IBRICK Bridge, Module 001c02
ASIC BRIDGE Rev 2, (widget 15)
adapter PCI (SCSI interface) Rev 6
(pci id 1)
adapter IOC3 Rev 1
(pci id 4)
controller multi function SuperIO
controller Ethernet Rev 1
adapter USB (OHCI interface)
(pci id 5)
ASIC XBOW Rev 2, on CBrick, Module 001c01
ASIC XBOW Rev 2, on CBrick, Module 001c02
>>


Edit : Consolidating first two posts here
Then? :IRIS3130: ... Now? :O3x02L: :A3504L: - :A3502L: :1600SW: +MLA :Fuel: :Octane2: :Octane: :Indigo2IMP: :Indy: ... Other: DEC :BA213: :BA123: Sun , DG AViiON , NeXT :Cube:
smj avatar
smj
Donor
From Berkeley, CA, USA, NA, Earth, Sol
Who joined Nov. 12, 2007, 7:54 p.m.
Wrote the following at Nov. 11, 2010, 9:59 a.m...
eMGee wrote: Very nice system! Those FC cards, if you don't intend to use them, they have a considerable market value (particularly of this type).
Thanks - I have an insatiable need for freshly rendered mirror spheres and teapots hovering above checkerboards, and this will really help feed the beast... :lol:

And special thanks re: the FC cards. One thing that really stands out on nekochan is that people are very helpful in identifying items like that where the poster may not have a clue. Makes for a great community, and I hope I can give a little back along the way.
Then? :IRIS3130: ... Now? :O3x02L: :A3504L: - :A3502L: :1600SW: +MLA :Fuel: :Octane2: :Octane: :Indigo2IMP: :Indy: ... Other: DEC :BA213: :BA123: Sun , DG AViiON , NeXT :Cube:
bigD avatar
bigD
From Philadelphia
Who joined June 17, 2008, 8:38 p.m.
Wrote the following at Nov. 11, 2010, 10:55 a.m...
Nice machine! I've been meaning to pick up another 300 and enjoy 8 processor goodness myself. Mmmmmmm!
:Onyx2: :Indigo2: :O3x0:
smj avatar
smj
Donor
From Berkeley, CA, USA, NA, Earth, Sol
Who joined Nov. 12, 2007, 7:54 p.m.
Wrote the following at March 22, 2012, 4:36 p.m...
Finally hooked up the L2 and NUMALink Router I bought a while back with the two Origin 300 bricks. Cabled everything up, powered up the L2, then each O300 brick...

Interesting to see that each brick seems to have it's serial number cleared whenever the L2 first detects it. I knew the L2 would push/enforce it's serial number, but interesting to see it in action. After I checked the serial number at the start of this, I plugged in the power for the NUMALink Router.

Code: Select all

M2100887-001-L2>* serial
L2 system serial number: M2100887.
M2100887-001-L2>hub.c: USB new device connect on bus1/1, assigned device number 3
hub.c: USB hub found
hub.c: 7 ports detected
hub.c: USB new device connect on bus1/1/1, assigned device number 4
Manufacturer: Silicon Graphics, Inc.
Product: SN1 L1 System Controller
SerialNumber: 00000000
sgil1.c: SGI L1 connected, minor: 64 device: 1.4
INFO: opened USB device at b1;p1/1;d4 (/dev/sgil1_0)
M2100887-001-L2>env
001r08:
Environmental monitoring is enabled and running.

Description    State       Warning Limits     Fault Limits       Current
-------------- ----------  -----------------  -----------------  -------
12V bias   Wait Pwr  10%  10.80/ 13.20  20%   9.60/ 14.40    0.00
2.5V   Wait Pwr  10%   2.25/  2.75  20%   2.00/  3.00    0.10
3.3V aux   Wait Pwr  10%   2.97/  3.63  20%   2.64/  3.96    3.29
5V aux   Wait Pwr  10%   4.50/  5.50  20%   4.00/  6.00    5.12

Description    State       Warning RPM  Current RPM
-------------- ----------  -----------  -----------
FAN 0     LEFT   Wait Pwr         2160            0
FAN 1    RIGHT   Wait Pwr         2160            0

Advisory   Critical   Fault      Current
Description       State       Temp       Temp       Temp       Temp
----------------- ----------  ---------  ---------  ---------  ---------
0 POWER            Wait Pwr   30C/ 86F   40C/104F   50C/122F   11C/ 51F

M2100887-001-L2>
M2100887-001-L2>001r08 pwr up
M2100887-001-L2>
M2100887-001-L2>* env
001r08:
Environmental monitoring is enabled and running.

Description    State       Warning Limits     Fault Limits       Current
-------------- ----------  -----------------  -----------------  -------
12V bias    Enabled  10%  10.80/ 13.20  20%   9.60/ 14.40   11.88
2.5V    Enabled  10%   2.25/  2.75  20%   2.00/  3.00    2.51
3.3V aux    Enabled  10%   2.97/  3.63  20%   2.64/  3.96    3.29
5V aux    Enabled  10%   4.50/  5.50  20%   4.00/  6.00    5.10

Description    State       Warning RPM  Current RPM
-------------- ----------  -----------  -----------
FAN 0     LEFT    Enabled         2160         5720
FAN 1    RIGHT    Enabled         2160         5625

Advisory   Critical   Fault      Current
Description       State       Temp       Temp       Temp       Temp
----------------- ----------  ---------  ---------  ---------  ---------
0 POWER             Enabled   30C/ 86F   40C/104F   50C/122F   12C/ 53F

M2100887-001-L2> 001r08 l1
001r08-L1>
001r08-L1>serial
BSN: NDW543    SSN: M2100887    Time: 03/22/2012 12:08:25 PST
001r08-L1>version
L1 1.28.3 (Image B), Built 03/20/2004 00:00:51    [Base 1MB image]
001r08-L1>
001r08-L1>let the carnage begin
001r08-L1>serial
BSN: NDW543    SSN: M2100887    Time: 03/22/2012 12:09:01 PST   Security: OFF
001r08-L1>
001r08-L1>reboot_l1usb.c: USB disconnect on device 4
sgil1.c: SGI L1 disconnected, minor: 64 device: 1.4
hub.c: USB new device connect on bus1/1/1, assigned device number 5
Manufacturer: Silicon Graphics, Inc.
Product: SN1 L1 System Controller
SerialNumber: 00000000
sgil1.c: SGI L1 connected, minor: 65 device: 1.5
INFO: closed connection to 001r08
INFO: opened USB device at b1;p1/1;d5 (/dev/sgil1_1)

ERROR: no response from 001r08

001r08-L1>
001r08-L1>link v
port '1' appears okay (1)
port '2' appears okay (1)
port '3' appears okay (0)        // Have two O300 bricks on
port '4' appears okay (0)        // ports 3 & 4, not plugged in
port '5' appears okay (1)
port '6' appears okay (1)
port '7' appears okay (1)
port '8' appears okay (1)
001r08-L1>
001r08-L1>rtr
3400 Series: router type is ordinary
001r08-L1>
// Hmm, "3400" - maybe this didn't come from a Prism...?
001r08-L1>log
11/09/05 11:44:02 power down (COMMAND)
11/09/05 11:44:46 power up hold (COMMAND)
11/09/05 11:44:57 reset (COMMAND)
11/23/05 11:32:05 power down (COMMAND)
11/23/05 11:53:41 power down (COMMAND)
11/28/05 09:15:35 L1 booting 1.28.3
11/28/05 09:15:37 USB0: waiting on open
11/28/05 09:16:24 USB0: opened
11/28/05 09:16:24 USB0: registered for events
11/28/05 09:16:46 power up hold (COMMAND)
11/28/05 09:16:57 reset (COMMAND)
12/19/05 08:37:11 power down (COMMAND)
12/19/05 08:37:37 USB-R: USB:bus was reset
12/19/05 08:37:37 UNREG: 30004c80 0 7
12/19/05 08:37:37 USB0: unregistered
01/03/06 12:04:05 L1 booting 1.28.3
01/03/06 12:04:07 USB0: waiting on open
01/03/06 12:04:53 USB0: opened
01/03/06 12:04:53 USB0: registered for events
01/03/06 12:05:10 power up hold (COMMAND)
01/03/06 12:05:21 reset (COMMAND)
01/14/06 02:44:20 48V power fail warning
01/14/06 02:44:20 VRM not OK: type 2.5V, number 1
01/14/06 11:37:43 L1 booting 1.28.3
01/14/06 11:37:45 USB0: waiting on open
01/14/06 11:38:31 USB0: opened
01/14/06 11:38:31 USB0: registered for events
01/14/06 11:38:45 USB-R: USB:connection lost
01/14/06 11:38:45 UNREG: 30004c80 0 7
01/14/06 11:38:45 USB0: unregistered
01/14/06 11:38:46 USB0-R: IRouter:read failed - read error
01/14/06 11:38:46 USB0: waiting on open
01/14/06 11:39:31 USB0: opened
01/14/06 11:39:31 USB0: registered for events
01/15/06 10:36:09 power down (COMMAND)
01/15/06 10:36:14 power up hold (COMMAND)
01/15/06 10:36:26 reset (COMMAND)
04/27/06 12:03:19 power down (COMMAND)
06/21/06 10:39:37 L1 booting 1.28.3
06/21/06 10:39:39 USB0: waiting on open
12/16/06 17:39:10 L1 booting 1.28.3
12/16/06 17:39:12 USB0: waiting on open                // Date was current when I powered it up, so it's been sitting...
03/22/12 12:06:31 L1 booting 1.28.3
03/22/12 12:11:02 L1 booting 1.28.3
03/22/12 12:11:04 USB0: waiting on open
03/22/12 12:11:04 USB0: opened
03/22/12 12:11:04 USB0: registered for events
001r08-L1>
001r08-L1>port
Port Name Stat Remote Pwr Local Pwr  Link LED SW LED
--------- ---- ---------- ---------- -------- --------
1 0x02       none       okay      off      off
2 0x02       none       okay      off      off
3 0x00       none       none      off      off
4 0x00       none       none      off      off
5 0x02       none       okay      off      off
6 0x02       none       okay      off      off
7 0x02       none       okay      off      off
8 0x02       none       okay      off      off
001r08-L1>
001r08-L1>^T
escaping to L2 system controller, <CTRL_T> to send escape to L1
M2100887-001-L2>l2
L2 command processor engaged, <CTRL-D> for console mode.
M2100887-001-L2>

Okay, let's plug in the first O300 brick. Note that this first brick temporarily shows as 001?01 while being initialized by the L2 controller.

Code: Select all

M2100887-001-L2>hub.c: USB new device connect on bus1/1/4, assigned device number 6
usb.c: USB device not accepting new address=6 (error=-110)
hub.c: USB new device connect on bus1/1/4, assigned device number 7
usb.c: USB device not accepting new address=7 (error=-110)
hub.c: USB new device connect on bus1/1/4, assigned device number 8
Manufacturer: Silicon Graphics, Inc.
Product: SN1 L1 System Controller
SerialNumber: 00000000
sgil1.c: SGI L1 connected, minor: 64 device: 1.8
INFO: opened USB device at b1;p1/4;d8 (/dev/sgil1_0)
001?01 INFO: System serial number reassigned (8000) to M2100887 from attached L2.

M2100887-001-L2>
M2100887-001-L2>cfg
L2 10.10.10.107: - 001 (LOCAL)
L1 10.10.10.107:1:0      - 001r08
L1 10.10.10.107:0:0      - 001c01
M2100887-001-L2>
M2100887-001-L2>001c01 l1
entering L1 mode 001c01, <CTRL-T> to escape to L2

001c01-L1>serial
BSN: MYS631    SSN: M2100887    Time: 03/22/2012 15:24:55 EST
001c01-L1>
001c01-L1>^T
escaping to L2 system controller, <CTRL_T> to send escape to L1
M2100887-001-L2>l2
L2 command processor engaged, <CTRL-D> for console mode.
M2100887-001-L2>

Plugging in the second O300 brick...

Code: Select all

M2100887-001-L2>
M2100887-001-L2>hub.c: USB new device connect on bus1/1/3, assigned device number 9
Manufacturer: Silicon Graphics, Inc.
Product: SN1 L1 System Controller
SerialNumber: 00000000
sgil1.c: SGI L1 connected, minor: 66 device: 1.9
INFO: opened USB device at b1;p1/3;d9 (/dev/sgil1_2)
001?02 INFO: System serial number reassigned (8000) to M2100887 from attached L2.

M2100887-001-L2>
M2100887-001-L2>cfg
L2 10.10.10.107: - 001 (LOCAL)
L1 10.10.10.107:1:0      - 001r08
L1 10.10.10.107:2:0      - 001c02
L1 10.10.10.107:0:0      - 001c01
M2100887-001-L2>001c02 l1
entering L1 mode 001c02, <CTRL-T> to escape to L2

001c02-L1>serial
BSN: MMH445    SSN: M2100887    Time: 03/22/2012 14:16:37 CST
001c02-L1>
001c02-L1>dsp
revision: 2.0
line 1: "001c02     /"
line 2: "L1 running  "
leds:  PWR=off   SERVICE=off     FAULT=off
001c02-L1>


Initially, however, the second brick was not being seen as part of the system at the PROM level:

Code: Select all

M2100887-001-L2>^D
entering system console mode (001c01 console), <CTRL_T> to escape to L2



System Maintenance Menu

1) Start System
2) Install System Software
3) Run Diagnostics
4) Recover System
5) Enter Command Monitor

Option? 1


Starting up the system...

Unable to execute dksc(0,1,8)/sash:  no such device
Unable to load bootfile: no such device
Autoboot failed
Unable to continue; press <enter> to return to the menu:
Automatic update of PROM environment disabled
Installing PROM Device drivers ............
Base I/O Ethernet set to /dev/ethernet/ef0

Walking SCSI Adapter 0, (pci id 1)
1- 2- 3- 4- 5- 6- 7- 8- 9- 10- 11- 12- 13- 14- 15- = 0 device(s)


Walking SCSI Adapter 1, (pci id 1)
1- 2- 3- 4- 5- 6- 7- 8- 9- 10- 11- 12- 13- 14- 15- = 0 device(s)

Initializing PROM Device drivers ..........             DONE
Checking hardware inventory ...............
[color=#0040FF]***Warning: Board in module 001c02 is missing or disabled
It previously contained a node-board, barcode MMH445 laser 518a1d15

***Warning: Board in module 001c02 is missing or disabled
It previously contained a IBRICK board, barcode MJS307 laser 51450937

***Warning: Board in module 001c02 is missing or disabled
It previously contained a IBRICK board, barcode MJS307 laser 51450937
[/color]DONE


System Maintenance Menu

1) Start System
2) Install System Software
3) Run Diagnostics
4) Recover System
5) Enter Command Monitor

Option?


This persisted across some resetenv and reboot_l1 commands on 001c02. When the PROM initialized, it would still only see 1 object:

Code: Select all

>> reset
Resetting the system...
Starting PROM Boot process


IP35 PROM SGI Version 6.210  built 02:33:51 PM Aug 26, 2004
Testing/Initializing memory ...............             DONE
Copying PROM code to memory ...............             DONE
Discovering local IO ......................             DONE
Discovering NUMAlink connectivity .........
Local hub NUMAlink is down.
*** Local network link down
DONE
Found 1 objects (1 hubs, 0 routers) in 5895 usec
Waiting for peers to complete discovery....             DONE
No other nodes present; becoming global master


I powered everything down, un/plugged 001c02, and brought it all back up and that apparently did it:

Code: Select all

M2100887-001-L2>* power down
M2100887-001-L2>usb.c: USB disconnect on device 10
sgil1.c: SGI L1 disconnected, minor: 67 device: 1.10
INFO: closed connection to 001c02
hub.c: USB new device connect on bus1/1/3, assigned device number 11
Manufacturer: Silicon Graphics, Inc.
Product: SN1 L1 System Controller
SerialNumber: 00000000
sgil1.c: SGI L1 connected, minor: 66 device: 1.11
INFO: opened USB device at b1;p1/3;d11 (/dev/sgil1_2)
M2100887-001-L2>001r08 power up
M2100887-001-L2>001c02 pwr up
M2100887-001-L2>M2100887-001-L2>001c01 pwr up
entering system console mode (001c01 CPU0), <CTRL_T> to escape to L2
Starting PROM Boot process
Starting PROM Boot process


IP35 PROM SGI Version 6.210  built 02:33:51 PM Aug 26, 2004


IP35 PROM SGI Version 6.210  built 02:33:51 PM Aug 26, 2004
Testing/Initializing memory ..........Testing/Initializing memory ............D.
ONE
Copying PROM code to memory ...............             DONE
..Discovering local IO ......................           DONE
Discovering NUMAlink connectivity .........             DONE
Found 3 objects (2 hubs, 1 routers) in 106643 usec
Waiting for peers to complete discovery....             ....            DONE
Copying PROM code to memory ...............             DONE
Discovering local IO ......................             DONE
Discovering NUMAlink connectivity .........             DONE
Found 3 objects (2 hubs, 1 routers) in 22785 usec
Waiting for peers to complete discovery....             DONE
Global master is /hw/rack/001/bay/01
DONE
Global master is /hw/rack/001/bay/01
Intializing any CPUless nodes..............             DONE
Checking partitioning information .........             Checking partitioning in
formation .........             DONE
DONE
Local slave entering slave loop
Local slave entering slave loop
Local slave entering slave loop
Local master entering slave loop
Loading BASEIO prom .......................             Local slave entering sla
ve loop
Local slave entering slave loop
Local slave entering slave loop
DONE

BASEIO PROM Monitor SGI Version 6.210  built 02:30:38 PM Aug 26, 2004 (BE64)
8 CPUs on 2 nodes found.
Automatic update of PROM environment disabled
Installing PROM Device drivers ............
Base I/O Ethernet set to /dev/ethernet/ef0

Walking SCSI Adapter 0, (pci id 1)
1+ Device Vendor Product: IBM-SSG S53D073
2- 3- 4- 5- 6- 7- 8- 9- 10- 11- 12- 13- 14- 15- = 1 device(s)


Walking SCSI Adapter 1, (pci id 1)
1- 2- 3- 4- 5- 6- 7- 8- 9- 10- 11- 12- 13- 14- 15- = 0 device(s)

Initializing PROM Device drivers ..........             DONE
Checking hardware inventory ...............              DONE

**** System Configuration and Diagnostics Summary ****
CONFIG:
No. of NODEs enabled    = 2
No. of NODEs disabled   = 0
No. of CPUs enabled     = 8
No. of CPUs disabled    = 0
Mem enabled             = 8192 MB
Mem disabled            = 0 MB
No. of RTRs enabled     = 1
No. of RTRs disabled    = 0

DIAG RESULTS:
ALL DIAGS PASSED.
**** End System Configuration and Diagnostics Summary ****


System Maintenance Menu

1) Start System
2) Install System Software
3) Run Diagnostics
4) Recover System
5) Enter Command Monitor

Option? 5
Command Monitor.  Type "exit" to return to the menu.
>> hinv -v
IP35 Node Board, Module 001c01
ASIC BEDROCK Rev 2, 200 MHz, (nasid 1)
Processor A: 600 MHz R14000 Rev 2.4
Secondary Cache 4MB 300MHz Tap 0xa , (cpu 0)
R14010FPC Rev 2.4
Processor B: 600 MHz R14000 Rev 2.4
Secondary Cache 4MB 300MHz Tap 0xa , (cpu 1)
R14010FPC Rev 2.4
Processor C: 600 MHz R14000 Rev 2.4
Secondary Cache 4MB 300MHz Tap 0xa , (cpu 2)
R14010FPC Rev 2.4
Processor D: 600 MHz R14000 Rev 2.4
Secondary Cache 4MB 300MHz Tap 0xa , (cpu 3)
R14010FPC Rev 2.4
Memory on board, 4096 MBytes (Standard)
Bank 0, 1024 MBytes (Premium)  <-- (Software Bank 0)
Bank 1, 1024 MBytes (Premium)
Bank 2, 1024 MBytes (Premium)
Bank 3, 1024 MBytes (Premium)
IP35 Node Board, Module 001c02
ASIC BEDROCK Rev 2, 200 MHz, (nasid 0)
Processor A: 600 MHz R14000 Rev 2.4
Secondary Cache 4MB 300MHz Tap 0xa , (cpu 4)
R14010FPC Rev 2.4
Processor B: 600 MHz R14000 Rev 2.4
Secondary Cache 4MB 300MHz Tap 0xa , (cpu 5)
R14010FPC Rev 2.4
Processor C: 600 MHz R14000 Rev 2.4
Secondary Cache 4MB 300MHz Tap 0xa , (cpu 6)
R14010FPC Rev 2.4
Processor D: 600 MHz R14000 Rev 2.4
Secondary Cache 4MB 300MHz Tap 0xa , (cpu 7)
R14010FPC Rev 2.4
Memory on board, 4096 MBytes (Standard)
Bank 0, 1024 MBytes (Premium)  <-- (Software Bank 0)
Bank 1, 1024 MBytes (Premium)
Bank 2, 1024 MBytes (Premium)
Bank 3, 1024 MBytes (Premium)
IBRICK Bridge, Module 001c01
ASIC BRIDGE Rev 2, (widget 14)
adapter ID (Vendor 1000 Device 640 class c subclass c)
(pci id 1 function 0)
adapter ID (Vendor 1000 Device 640 class c subclass c)
(pci id 1 function 1)
IBRICK Bridge, Module 001c01
ASIC BRIDGE Rev 2, (widget 15)
adapter PCI (SCSI interface) Rev 6
(pci id 1)
peripheral DISK, BUS 0, ID 1, IBM-SSG S53D073
adapter IOC3 Rev 1
(pci id 4)
controller multi function SuperIO
controller Ethernet Rev 1
adapter USB (OHCI interface)
(pci id 5)
IBRICK Bridge, Module 001c02
ASIC BRIDGE Rev 2, (widget 14)
adapter ID (Vendor 1000 Device 640 class c subclass c)
(pci id 1 function 0)
adapter ID (Vendor 1000 Device 640 class c subclass c)
(pci id 1 function 1)
IBRICK Bridge, Module 001c02
ASIC BRIDGE Rev 2, (widget 15)
adapter PCI (SCSI interface) Rev 6
(pci id 1)
adapter IOC3 Rev 1
(pci id 4)
controller multi function SuperIO
controller Ethernet Rev 1
adapter USB (OHCI interface)
(pci id 5)
ASIC ROUTER , Module 001r08, (nasid 0)
ASIC XBOW Rev 2, on CBrick, Module 001c01
ASIC XBOW Rev 2, on CBrick, Module 001c02
>>
>> update
Writing 6 records...... DONE
Updated new configuration. Wrote 6 records.
>>
>> modnum
001c01 001c02
>>
>> boot
896+111372+16725+3848 entry: 0xa8000002012a6d5c
Standalone Shell SGI Version 6.5 ARCS   Oct  6, 2003 (64 Bit)
sash: boot
5172875+1102192+1061824 entry: 0xa8000002000418e0
IRIX Release 6.5 IP35 Version 10070055 System V - 64 Bit
Copyright 1987-2003 Silicon Graphics, Inc.
All Rights Reserved.

mem_alloc: pagesize is 1048576
Inside mem_alloc_init, total pages is 200
mem_alloc: path to MA device is /hw/mem_alloc
mem_alloc: path /hw/mem_alloc added
mem_alloc: name of MA device 0 is 0
mem_alloc: device 0 added under /hw/mem_alloc
mem_alloc: 0 pgs allocated, each 1048576 bytes
priority_lists initialized
Returning 0 from mem_alloc_init
QLFC: running as interrupt thread.
QLFC: using spinlocks.
NOTICE: pcibr_attach: /hw/module/001c01/Ibrick/xtalk/15/pci Bus holds a usb part
- settingbridge PCI_RETRY_HLD to 4
Setting hub ixtt.rrsp_ps field to 0x4e20
NOTICE: pcibr_attach: /hw/module/001c02/Ibrick/xtalk/15/pci Bus holds a usb part
- settingbridge PCI_RETRY_HLD to 4
Setting hub ixtt.rrsp_ps field to 0x4e20
Selecting Default Server
NOTICE: XVM mirrors disabled
NOTICE: XVM snapshot disabled
xvminit complete
The system is coming up.
network: WARNING: Failed to configure ef1 as gate-origin.
Warning:  Internet Gateway web server running as root.
Use "chkconfig webface_apache off" to disable.
inst:
inst: Software installation has installed new configuration files and/or saved
inst: the previous version in some cases.  You may need to update or merge
inst: old configuration files with the newer versions.  See the "Updating
inst: Configuration Files" section in the versions(1M) manual page for details.
inst: The shell command "versions changed" will list the affected files.
inst:
inst: These directories were unable to be moved properly during the
inst: installation process.  Check for any user-modified files, then
inst: delete the directories.
inst:    /usr/include/Vk.O



origin console login: root
Password:
IRIX Release 6.5 IP35 origin
Copyright 1987-2003 Silicon Graphics, Inc. All Rights Reserved.
Last login: Tue Nov 16 00:28:58 PST 2010 by [email protected]
TERM = (vt100)
origin 1# uname -aR
IRIX64 origin 6.5 6.5.22f 10070055 IP35
origin 2#


The OS install was left over from a test run so I'll scratch that, decide on .22 or .30, and load some Nekoware so I can put these CPUs and the Router through their paces.
Then? :IRIS3130: ... Now? :O3x02L: :A3504L: - :A3502L: :1600SW: +MLA :Fuel: :Octane2: :Octane: :Indigo2IMP: :Indy: ... Other: DEC :BA213: :BA123: Sun , DG AViiON , NeXT :Cube:
Adrenaline avatar
Adrenaline
From Austin, TX
Who joined Feb. 10, 2005, 12:37 p.m.
Wrote the following at March 22, 2012, 5:18 p.m...
Congrats on getting it all hooked up with an L2, one day I hope to get one too.
:Indigo: 33mhz R3k/48mb/XS24 :Indy: 150mhz R4400/256mb/XL24 :Fuel: 600mhz R14kA/2gb/V10 Image 8x1.4ghz Itanium 2/8GB :O3x08R: 32x600mhz R14kA/24GB :Tezro: 4x700mhz R16k/8GB/V12/DCD/SAS/FC/DM5 (2x) :O3x0: 4x700mhz R16k/4GB :PrismDT: 2x1.6ghz 8mb/12gb/SAS/2xFGL
smj avatar
smj
Donor
From Berkeley, CA, USA, NA, Earth, Sol
Who joined Nov. 12, 2007, 7:54 p.m.
Wrote the following at March 22, 2012, 6:02 p.m...
Adrenaline wrote: Congrats on getting it all hooked up with an L2, one day I hope to get one too.

Thanks - no drama, which I had half expected. The L2 Emulator from the L3 software package worked just fine, but this L2 was too good a deal to let get away. Ditto for the router. Though at this point all I've done is increased my electric bill for no change in performance... :?

In your case would you use it with O300s, A350s, or... both?

Having the L3 software running in a VM on a cheap laptop is cheap, makes for a convenient console, etc etc. I currently use a Thinkpad R52 with a 2GHz Pentium M - plenty fast enough for this, plus browsing Nekochan. And one of these days I'll look into the performance monitoring software that's in the L3 package.

This laptop also runs DINA in another VM, for fast installs or updates. A hard drive with a few dozen GBs provides plenty of room for IRIX and Nekoware. Highly recommended...
Then? :IRIS3130: ... Now? :O3x02L: :A3504L: - :A3502L: :1600SW: +MLA :Fuel: :Octane2: :Octane: :Indigo2IMP: :Indy: ... Other: DEC :BA213: :BA123: Sun , DG AViiON , NeXT :Cube:
Adrenaline avatar
Adrenaline
From Austin, TX
Who joined Feb. 10, 2005, 12:37 p.m.
Wrote the following at March 22, 2012, 8:25 p.m...
smj wrote:
Adrenaline wrote: Congrats on getting it all hooked up with an L2, one day I hope to get one too.

Thanks - no drama, which I had half expected. The L2 Emulator from the L3 software package worked just fine, but this L2 was too good a deal to let get away. Ditto for the router. Though at this point all I've done is increased my electric bill for no change in performance... :?

In your case would you use it with O300s, A350s, or... both?

Having the L3 software running in a VM on a cheap laptop is cheap, makes for a convenient console, etc etc. I currently use a Thinkpad R52 with a 2GHz Pentium M - plenty fast enough for this, plus browsing Nekochan. And one of these days I'll look into the performance monitoring software that's in the L3 package.

This laptop also runs DINA in another VM, for fast installs or updates. A hard drive with a few dozen GBs provides plenty of room for IRIX and Nekoware. Highly recommended...

I've got a second O300 on it's way at the end of the month. The A350s need an IO9, right now they're collecting dust :(

I'll have to look into the L3 software, thanks for the heads up!
:Indigo: 33mhz R3k/48mb/XS24 :Indy: 150mhz R4400/256mb/XL24 :Fuel: 600mhz R14kA/2gb/V10 Image 8x1.4ghz Itanium 2/8GB :O3x08R: 32x600mhz R14kA/24GB :Tezro: 4x700mhz R16k/8GB/V12/DCD/SAS/FC/DM5 (2x) :O3x0: 4x700mhz R16k/4GB :PrismDT: 2x1.6ghz 8mb/12gb/SAS/2xFGL
smj avatar
smj
Donor
From Berkeley, CA, USA, NA, Earth, Sol
Who joined Nov. 12, 2007, 7:54 p.m.
Wrote the following at March 26, 2012, 7:43 p.m...
Here's a picture of the system. The L2 controller is out of sight.
Then? :IRIS3130: ... Now? :O3x02L: :A3504L: - :A3502L: :1600SW: +MLA :Fuel: :Octane2: :Octane: :Indigo2IMP: :Indy: ... Other: DEC :BA213: :BA123: Sun , DG AViiON , NeXT :Cube: