Hi.

We bought a Dell PowerEdge R510 with Raid Controler PERC H700. I setup
RAID 6, and install solaris 10 x86 without problems.
When I start looking for raid HDD monitoring tools I can't find
anything.
Dell support said that they don't support solaris,
LSI - don't have monitoring tools for solaris, even for their cards
( Dell is installing own firmware in those cards)

Any suggestion how I can monitor this controller and get status of
HDD?

Thank you for help.

In article <efc4ba76-7bf9-4b95-9b12-a965d10ea756@j2g2000yqf.googlegroups.com>,
Mariusz Antonik  <mantonik@gmail.com> wrote:
>We bought a Dell PowerEdge R510 with Raid Controler PERC H700. I setup
>RAID 6, and install solaris 10 x86 without problems.

What it the PCI Vendor and Device ID for that PERC?
See scanpci(1).

John
groenveld@acm.org

Hi, Mariusz,

> We bought a Dell PowerEdge R510 with Raid Controler PERC H700. I setup
> RAID 6, and install solaris 10 x86 without problems.
> When I start looking for raid HDD monitoring tools I can't find
> anything.
> Any suggestion how I can monitor this controller and get status of
> HDD?

provided you�d installed solaris with a zfs-root-filesystem on the RAID-6
just try these in a root terminalsession (output should be similar to this):

# zpool list
NAME                    SIZE    ALLOC   FREE    CAP    HEALTH     ALTROOT
tank                       80.0G       22.3G   47.7G    28%    ONLINE     -
dozer                       1.2T        384G    816G    32%    ONLINE     -

and/or

# zpool status -x
all pools are healthy

Thomas 

On Oct 28, 12:48=A0pm, groen...@cse.psu.edu (John D Groenveld) wrote:
> In article <efc4ba76-7bf9-4b95-9b12-a965d10ea...@j2g2000yqf.googlegroups.=
com>,
> Mariusz Antonik =A0<manto...@gmail.com> wrote:
>
> >We bought a Dell PowerEdge R510 with Raid Controler PERC H700. I setup
> >RAID 6, and install solaris 10 x86 without problems.
>
> What it the PCI Vendor and Device ID for that PERC?
> See scanpci(1).
>
> John
> groenv...@acm.org

Hi
here is output from scanpci -v comand

pci bus 0x0002 cardnum 0x00 function 0x00: vendor 0x1000 device 0x0079
 LSI Logic / Symbios Logic LSI MegaSAS 9260
 CardVendor 0x1028 card 0x1f17 (Dell PERC H700 Integrated)
  STATUS    0x0010  COMMAND 0x0047
  CLASS     0x01 0x04 0x00  REVISION 0x04
  BIST      0x00  HEADER 0x00  LATENCY 0x00  CACHE 0x10
  BASE0     0x0000fc01  addr 0x0000fc00  I/O
  BASE1     0x00000000de9bc004  addr 0x00000000de9bc000  MEM 64BIT
  BASE3     0x00000000de9c0004  addr 0x00000000de9c0000  MEM 64BIT
  BASEROM   0xde900000  addr 0xde900000  not-decode-enabled
  MAX_LAT   0x00  MIN_GNT 0x00  INT_PIN 0x01  INT_LINE 0x0f

Thank you for help
Mariusz

In article <5a638ee3-b3bd-4b75-8842-f94abe81d0d3@u17g2000yqi.googlegroups.com>,
Mariusz Antonik  <mantonik@gmail.com> wrote:
>here is output from scanpci -v comand
>
>pci bus 0x0002 cardnum 0x00 function 0x00: vendor 0x1000 device 0x0079
> LSI Logic / Symbios Logic LSI MegaSAS 9260
> CardVendor 0x1028 card 0x1f17 (Dell PERC H700 Integrated)

FreeBSD uses mfi(4) driver and mfiutil(8) for that device.

Solaris 10 drives it with mega_sas(7D)?

It looks like Solaris 10's raidctl(1M) will work only with
mpt(7D) driven LSI controllers.

I don't whether any customers have filed any RFEs with Chuck Rozwat
and company to add that support to Solaris 10 raidctl(1M).

John
groenveld@acm.org

On 10/29/10 03:28 AM, Mariusz Antonik wrote:
> Hi.
>
> We bought a Dell PowerEdge R510 with Raid Controler PERC H700. I setup
> RAID 6, and install solaris 10 x86 without problems.
> When I start looking for raid HDD monitoring tools I can't find
> anything.
> Dell support said that they don't support solaris,
> LSI - don't have monitoring tools for solaris, even for their cards
> ( Dell is installing own firmware in those cards)
>
> Any suggestion how I can monitor this controller and get status of
> HDD?

Forget the hardware RAID and use ZFS.

-- 
Ian Collins

On Oct 28, 3:05=A0pm, Ian Collins <ian-n...@hotmail.com> wrote:
> On 10/29/10 03:28 AM, Mariusz Antonik wrote:
>
> > Hi.
>
> > We bought a Dell PowerEdge R510 with Raid Controler PERC H700. I setup
> > RAID 6, and install solaris 10 x86 without problems.
> > When I start looking for raid HDD monitoring tools I can't find
> > anything.
> > Dell support said that they don't support solaris,
> > LSI - don't have monitoring tools for solaris, even for their cards
> > ( Dell is installing own firmware in those cards)
>
> > Any suggestion how I can monitor this controller and get status of
> > HDD?
>
> Forget the hardware RAID and use ZFS.
>
> --
> Ian Collins

This will be another option, but how this effect performance?

Hardware mirroring is not faster than ZFS?

Maintenance part - with hardware raid I can just remove HDD  and put
new in and controler will sync data, with sofware mirroring - ZFS, I
will have to remove HDD from file system then remove, add new and then
add to ZFS - corect?
Those steps I was doing with mirrored HDD on solaris9 (md)

Mariusz

On Oct 28, 1:22=A0pm, Mariusz Antonik <manto...@gmail.com> wrote:
> On Oct 28, 3:05=A0pm, Ian Collins <ian-n...@hotmail.com> wrote:
>
>
>
> > On 10/29/10 03:28 AM, Mariusz Antonik wrote:
>
> > > Hi.
>
> > > We bought a Dell PowerEdge R510 with Raid Controler PERC H700. I setu=
p
> > > RAID 6, and install solaris 10 x86 without problems.
> > > When I start looking for raid HDD monitoring tools I can't find
> > > anything.
> > > Dell support said that they don't support solaris,
> > > LSI - don't have monitoring tools for solaris, even for their cards
> > > ( Dell is installing own firmware in those cards)
>
> > > Any suggestion how I can monitor this controller and get status of
> > > HDD?
>
> > Forget the hardware RAID and use ZFS.
>
> > --
> > Ian Collins
>
> This will be another option, but how this effect performance?
>
> Hardware mirroring is not faster than ZFS?
>
> Maintenance part - with hardware raid I can just remove HDD =A0and put
> new in and controler will sync data, with sofware mirroring - ZFS, I
> will have to remove HDD from file system then remove, add new and then
> add to ZFS - corect?
> Those steps I was doing with mirrored HDD on solaris9 (md)
>
> Mariusz

If you create a mirrored ZFS storage pool, your performance might
be scary good. :-)

Device replacement is generally performed with pool/file systems
available.

If I have a mirrored storage pool tank with two disks, I can
physically replace disk-1 and then let ZFS know like this:

# zpool replace tank disk-1

On some systems, you might need to unconfigure the disk first.

If you want to replace disk-1 in mirrored storage pool with
a disk at different physical location, then it is:

# zpool replace tank disk-1 disk-3

You can monitor pool devices with zpool status.

You can read more about ZFS is here:

http://www.solarisinternals.com/wiki/index.php/ZFS_Best_Practices_Guide

Thanks,

Cindy

On 10/28/2010 3:22 PM, Mariusz Antonik wrote:
> On Oct 28, 3:05 pm, Ian Collins<ian-n...@hotmail.com>  wrote:
>> On 10/29/10 03:28 AM, Mariusz Antonik wrote:
>>
>>> Hi.
>>
>>> We bought a Dell PowerEdge R510 with Raid Controler PERC H700. I setup
>>> RAID 6, and install solaris 10 x86 without problems.
>>> When I start looking for raid HDD monitoring tools I can't find
>>> anything.
>>> Dell support said that they don't support solaris,
>>> LSI - don't have monitoring tools for solaris, even for their cards
>>> ( Dell is installing own firmware in those cards)
>>
>>> Any suggestion how I can monitor this controller and get status of
>>> HDD?
>>
>> Forget the hardware RAID and use ZFS.
>>
>> --
>> Ian Collins
>
> This will be another option, but how this effect performance?
>
> Hardware mirroring is not faster than ZFS?
>
> Maintenance part - with hardware raid I can just remove HDD  and put
> new in and controler will sync data, with sofware mirroring - ZFS, I
> will have to remove HDD from file system then remove, add new and then
> add to ZFS - corect?
> Those steps I was doing with mirrored HDD on solaris9 (md)
>

How often do you have to replace a drive?  The life span of a hard disk 
drive is three to five years!  If you have dozens of disk drives you 
might have to replace a few drives every year.  Most people find this 
acceptable!

On 10/29/10 08:22 AM, Mariusz Antonik wrote:
> On Oct 28, 3:05 pm, Ian Collins<ian-n...@hotmail.com>  wrote:
>> On 10/29/10 03:28 AM, Mariusz Antonik wrote:
>>
>>> Hi.
>>
>>> We bought a Dell PowerEdge R510 with Raid Controler PERC H700. I setup
>>> RAID 6, and install solaris 10 x86 without problems.
>>> When I start looking for raid HDD monitoring tools I can't find
>>> anything.
>>> Dell support said that they don't support solaris,
>>> LSI - don't have monitoring tools for solaris, even for their cards
>>> ( Dell is installing own firmware in those cards)
>>
>>> Any suggestion how I can monitor this controller and get status of
>>> HDD?
>>
>> Forget the hardware RAID and use ZFS.
>>
>> --
>> Ian Collins
>
> This will be another option, but how this effect performance?
>
> Hardware mirroring is not faster than ZFS?

No, they're about equal.

> Maintenance part - with hardware raid I can just remove HDD  and put
> new in and controler will sync data, with sofware mirroring - ZFS, I
> will have to remove HDD from file system then remove, add new and then
> add to ZFS - corect?

You can use "zpool replace" to replace a drive.

Don't forget with ZFS mirroring your root pool isn't tied to a specific 
make and model of RAID card, it can easily be moved to another box if 
your system dies.

-- 
Ian Collins

Mariusz Antonik <mantonik@gmail.com> writes:
>On Oct 28, 3:05=A0pm, Ian Collins <ian-n...@hotmail.com> wrote:
>> Forget the hardware RAID and use ZFS.

>This will be another option, but how this effect performance?
>Hardware mirroring is not faster than ZFS?

Hardware RAID is just a *little* processor running on its own on the
RAID card that can do things on its own. The main benefit of having
hardware RAID in the past is that it didn't take up CPU time or the
main OS to do basic housekeeping functions. With ZFS, and Solaris
running on anything modern, the CPU has tons of idle time waiting for
I/O's to happen and tons of I/O ports on the hardware in general, and
if Solaris is driving all the RAID, then it controls the I/O channel,
it knows when there is a problem and can report things back to you.

I've taken apart some hardware RAID systems to find they were basicly 
linux kernels running on a little 50MHz GEode board, barely keeping up
with things (not something like the H700 you have, but these were more
external RAID boxes). 

I'd rather have Solaris driving everything directly with ZFS than
linux on an underpowered CPU keeping track of things.


>Maintenance part - with hardware raid I can just remove HDD  and put
>new in and controler will sync data, with sofware mirroring - ZFS, I
>will have to remove HDD from file system then remove, add new and then
>add to ZFS - corect?
>Those steps I was doing with mirrored HDD on solaris9 (md)

One step. 'zpool replace'

On Oct 28, 12:22=A0pm, Mariusz Antonik <manto...@gmail.com> wrote:
> On Oct 28, 3:05=A0pm, Ian Collins <ian-n...@hotmail.com> wrote:
>
>
>
> > On 10/29/10 03:28 AM, Mariusz Antonik wrote:
>
> > > Hi.
>
> > > We bought a Dell PowerEdge R510 with Raid Controler PERC H700. I setu=
p
> > > RAID 6, and install solaris 10 x86 without problems.
> > > When I start looking for raid HDD monitoring tools I can't find
> > > anything.
> > > Dell support said that they don't support solaris,
> > > LSI - don't have monitoring tools for solaris, even for their cards
> > > ( Dell is installing own firmware in those cards)
>
> > > Any suggestion how I can monitor this controller and get status of
> > > HDD?
>
> > Forget the hardware RAID and use ZFS.
>
> > --
> > Ian Collins
>
> This will be another option, but how this effect performance?
>
> Hardware mirroring is not faster than ZFS?
>
> Maintenance part - with hardware raid I can just remove HDD =A0and put
> new in and controler will sync data, with sofware mirroring - ZFS, I
> will have to remove HDD from file system then remove, add new and then
> add to ZFS - corect?
> Those steps I was doing with mirrored HDD on solaris9 (md)
>
> Mariusz

I've found hardware mirroring, with the LSI chip, to be substantially
slower
than ZFS; hours vs. minutes on a freshly-built system.  The LSI chip
builds
a block-for-block mirror; the zfs mirrors active data only.  Plus, zfs
has what I
consider better error detection and correction than hardware RAID.
Plug into cron a weekly "zpool scrub".

On the other hand if all you have to work with is ext3, ntfs, or ufs
then an LSI will do fine.

Regards, Scott

On Oct 30, 3:01=A0pm, Scott <spack...@gmail.com> wrote:
> On Oct 28, 12:22=A0pm, Mariusz Antonik <manto...@gmail.com> wrote:
>
>
>
>
>
>
>
>
>
> > On Oct 28, 3:05=A0pm, Ian Collins <ian-n...@hotmail.com> wrote:
>
> > > On 10/29/10 03:28 AM, Mariusz Antonik wrote:
>
> > > > Hi.
>
> > > > We bought a Dell PowerEdge R510 with Raid Controler PERC H700. I se=
tup
> > > > RAID 6, and install solaris 10 x86 without problems.
> > > > When I start looking for raid HDD monitoring tools I can't find
> > > > anything.
> > > > Dell support said that they don't support solaris,
> > > > LSI - don't have monitoring tools for solaris, even for their cards
> > > > ( Dell is installing own firmware in those cards)
>
> > > > Any suggestion how I can monitor this controller and get status of
> > > > HDD?
>
> > > Forget the hardware RAID and use ZFS.
>
> > > --
> > > Ian Collins
>
> > This will be another option, but how this effect performance?
>
> > Hardware mirroring is not faster than ZFS?
>
> > Maintenance part - with hardware raid I can just remove HDD =A0and put
> > new in and controler will sync data, with sofware mirroring - ZFS, I
> > will have to remove HDD from file system then remove, add new and then
> > add to ZFS - corect?
> > Those steps I was doing with mirrored HDD on solaris9 (md)
>
> > Mariusz
>
> I've found hardware mirroring, with the LSI chip, to be substantially
> slower
> than ZFS; hours vs. minutes on a freshly-built system. =A0The LSI chip
> builds
> a block-for-block mirror; the zfs mirrors active data only. =A0Plus, zfs
> has what I
> consider better error detection and correction than hardware RAID.
> Plug into cron a weekly "zpool scrub".
>
> On the other hand if all you have to work with is ext3, ntfs, or ufs
> then an LSI will do fine.
>
> Regards, Scott

Hi.
Thank you everybody for comments.

Which raid system should be better to choose for oracle 11gR2 DB
server

1. Raid 6 - all 8 HDD added to raid6 - loosing 2 hdd for parity
2. Raind 10
     1. stripe 4 HDD, create 3 slices for on each HDD and then stripe
it together for oracle HDD (log, data, index) those slices will start
from external cylinders.  example
cyl start - cyl end - part
1

How do you this about this design of HDD

On Oct 30, 3:01=A0pm, Scott <spack...@gmail.com> wrote:
> On Oct 28, 12:22=A0pm, Mariusz Antonik <manto...@gmail.com> wrote:
>
>
>
>
>
>
>
>
>
> > On Oct 28, 3:05=A0pm, Ian Collins <ian-n...@hotmail.com> wrote:
>
> > > On 10/29/10 03:28 AM, Mariusz Antonik wrote:
>
> > > > Hi.
>
> > > > We bought a Dell PowerEdge R510 with Raid Controler PERC H700. I se=
tup
> > > > RAID 6, and install solaris 10 x86 without problems.
> > > > When I start looking for raid HDD monitoring tools I can't find
> > > > anything.
> > > > Dell support said that they don't support solaris,
> > > > LSI - don't have monitoring tools for solaris, even for their cards
> > > > ( Dell is installing own firmware in those cards)
>
> > > > Any suggestion how I can monitor this controller and get status of
> > > > HDD?
>
> > > Forget the hardware RAID and use ZFS.
>
> > > --
> > > Ian Collins
>
> > This will be another option, but how this effect performance?
>
> > Hardware mirroring is not faster than ZFS?
>
> > Maintenance part - with hardware raid I can just remove HDD =A0and put
> > new in and controler will sync data, with sofware mirroring - ZFS, I
> > will have to remove HDD from file system then remove, add new and then
> > add to ZFS - corect?
> > Those steps I was doing with mirrored HDD on solaris9 (md)
>
> > Mariusz
>
> I've found hardware mirroring, with the LSI chip, to be substantially
> slower
> than ZFS; hours vs. minutes on a freshly-built system. =A0The LSI chip
> builds
> a block-for-block mirror; the zfs mirrors active data only. =A0Plus, zfs
> has what I
> consider better error detection and correction than hardware RAID.
> Plug into cron a weekly "zpool scrub".
>
> On the other hand if all you have to work with is ext3, ntfs, or ufs
> then an LSI will do fine.
>
> Regards, Scott

Hi.
Thank you everybody for comments.


Which raid system should be better to choose for oracle 11gR2 DB
server
1. Raid 6 - all 8 HDD added to raid6 - 2 hdd for parity. This create
one big HDD 1.6T
HDD slices:
1            10      swap - 2x memory 36G
11           20     /db_log    (stripe on 4 HDD size=3D4x100G)
20           31     /db_data (stripe on 4 HDD size=3D4x100G)
30           41     /db_index (stripe on 4 HDD size=3D4x100G)
40           50    / - root and zone partition

2. Raid 10
     stripe 4 HDD, create 3 slices for on each HDD and then stripe
it together for oracle HDD (log, data, index) those slices will start
from external cylinders.  example
cyl start - cyl end - part
1            10      swap - 2x memory 36G
11           20     /db_log    (stripe on 4 HDD size=3D4x100G)
20           31     /db_data (stripe on 4 HDD size=3D4x100G)
30           41     /db_index (stripe on 4 HDD size=3D4x100G)

Then create stripe on second set of 4 HDD, and mirror it each slice
(cylinder start-end is only to visual design)

How do you this about this design of HDD

Thank you for comments

On 11/1/2010 10:32 AM, Mariusz Antonik wrote:
> On Oct 30, 3:01 pm, Scott<spack...@gmail.com>  wrote:
>> On Oct 28, 12:22 pm, Mariusz Antonik<manto...@gmail.com>  wrote:
>>
>>
>>
>>
>>
>>
>>
>>
>>
>>> On Oct 28, 3:05 pm, Ian Collins<ian-n...@hotmail.com>  wrote:
>>
>>>> On 10/29/10 03:28 AM, Mariusz Antonik wrote:
>>
>>>>> Hi.
>>
>>>>> We bought a Dell PowerEdge R510 with Raid Controler PERC H700. I setup
>>>>> RAID 6, and install solaris 10 x86 without problems.
>>>>> When I start looking for raid HDD monitoring tools I can't find
>>>>> anything.
>>>>> Dell support said that they don't support solaris,
>>>>> LSI - don't have monitoring tools for solaris, even for their cards
>>>>> ( Dell is installing own firmware in those cards)
>>
>>>>> Any suggestion how I can monitor this controller and get status of
>>>>> HDD?
>>
>>>> Forget the hardware RAID and use ZFS.
>>
>>>> --
>>>> Ian Collins
>>
>>> This will be another option, but how this effect performance?
>>
>>> Hardware mirroring is not faster than ZFS?
>>
>>> Maintenance part - with hardware raid I can just remove HDD  and put
>>> new in and controler will sync data, with sofware mirroring - ZFS, I
>>> will have to remove HDD from file system then remove, add new and then
>>> add to ZFS - corect?
>>> Those steps I was doing with mirrored HDD on solaris9 (md)
>>
>>> Mariusz
>>
>> I've found hardware mirroring, with the LSI chip, to be substantially
>> slower
>> than ZFS; hours vs. minutes on a freshly-built system.  The LSI chip
>> builds
>> a block-for-block mirror; the zfs mirrors active data only.  Plus, zfs
>> has what I
>> consider better error detection and correction than hardware RAID.
>> Plug into cron a weekly "zpool scrub".
>>
>> On the other hand if all you have to work with is ext3, ntfs, or ufs
>> then an LSI will do fine.
>>
>> Regards, Scott
>
> Hi.
> Thank you everybody for comments.
>
>
> Which raid system should be better to choose for oracle 11gR2 DB
> server
> 1. Raid 6 - all 8 HDD added to raid6 - 2 hdd for parity. This create
> one big HDD 1.6T
> HDD slices:
> 1            10      swap - 2x memory 36G
> 11           20     /db_log    (stripe on 4 HDD size=4x100G)
> 20           31     /db_data (stripe on 4 HDD size=4x100G)
> 30           41     /db_index (stripe on 4 HDD size=4x100G)
> 40           50    / - root and zone partition
>
> 2. Raid 10
>       stripe 4 HDD, create 3 slices for on each HDD and then stripe
> it together for oracle HDD (log, data, index) those slices will start
> from external cylinders.  example
> cyl start - cyl end - part
> 1            10      swap - 2x memory 36G
> 11           20     /db_log    (stripe on 4 HDD size=4x100G)
> 20           31     /db_data (stripe on 4 HDD size=4x100G)
> 30           41     /db_index (stripe on 4 HDD size=4x100G)
>
> Then create stripe on second set of 4 HDD, and mirror it each slice
> (cylinder start-end is only to visual design)
>
> How do you this about this design of HDD
>
> Thank you for comments

It has been a few years since I last installed/supported Oracle.  Some 
of what I knew may possibly be out of date.

Oracle wants several *physical* disk drives!  ISTR that five disk drives 
was the MINIMUM.  You could use five RAID 1 sets and Oracle would be 
perfectly happy.   Five drives in a RAID 5 set would not
work well if that were your only disk storage.  Five RAID 5 sets would 
be a good choice if you needed a LOT of disk space.  I'm not familiar 
with RAID 6 and RAID 10; the last time I looked RAID 0-5 were the 
choices available but that was six years ago; new RAID types may have 
been developed in the interim.

On Nov 1, 8:32=A0am, Mariusz Antonik <manto...@gmail.com> wrote:
> On Oct 30, 3:01=A0pm, Scott <spack...@gmail.com> wrote:
>
>
>
> > On Oct 28, 12:22=A0pm, Mariusz Antonik <manto...@gmail.com> wrote:
>
> > > On Oct 28, 3:05=A0pm, Ian Collins <ian-n...@hotmail.com> wrote:
>
> > > > On 10/29/10 03:28 AM, Mariusz Antonik wrote:
>
> > > > > Hi.
>
> > > > > We bought a Dell PowerEdge R510 with Raid Controler PERC H700. I =
setup
> > > > > RAID 6, and install solaris 10 x86 without problems.
> > > > > When I start looking for raid HDD monitoring tools I can't find
> > > > > anything.
> > > > > Dell support said that they don't support solaris,
> > > > > LSI - don't have monitoring tools for solaris, even for their car=
ds
> > > > > ( Dell is installing own firmware in those cards)
>
> > > > > Any suggestion how I can monitor this controller and get status o=
f
> > > > > HDD?
>
> > > > Forget the hardware RAID and use ZFS.
>
> > > > --
> > > > Ian Collins
>
> > > This will be another option, but how this effect performance?
>
> > > Hardware mirroring is not faster than ZFS?
>
> > > Maintenance part - with hardware raid I can just remove HDD =A0and pu=
t
> > > new in and controler will sync data, with sofware mirroring - ZFS, I
> > > will have to remove HDD from file system then remove, add new and the=
n
> > > add to ZFS - corect?
> > > Those steps I was doing with mirrored HDD on solaris9 (md)
>
> > > Mariusz
>
> > I've found hardware mirroring, with the LSI chip, to be substantially
> > slower
> > than ZFS; hours vs. minutes on a freshly-built system. =A0The LSI chip
> > builds
> > a block-for-block mirror; the zfs mirrors active data only. =A0Plus, zf=
s
> > has what I
> > consider better error detection and correction than hardware RAID.
> > Plug into cron a weekly "zpool scrub".
>
> > On the other hand if all you have to work with is ext3, ntfs, or ufs
> > then an LSI will do fine.
>
> > Regards, Scott
>
> Hi.
> Thank you everybody for comments.
>
> Which raid system should be better to choose for oracle 11gR2 DB
> server
> 1. Raid 6 - all 8 HDD added to raid6 - 2 hdd for parity. This create
> one big HDD 1.6T
> HDD slices:
> 1 =A0 =A0 =A0 =A0 =A0 =A010 =A0 =A0 =A0swap - 2x memory 36G
> 11 =A0 =A0 =A0 =A0 =A0 20 =A0 =A0 /db_log =A0 =A0(stripe on 4 HDD size=3D=
4x100G)
> 20 =A0 =A0 =A0 =A0 =A0 31 =A0 =A0 /db_data (stripe on 4 HDD size=3D4x100G=
)
> 30 =A0 =A0 =A0 =A0 =A0 41 =A0 =A0 /db_index (stripe on 4 HDD size=3D4x100=
G)
> 40 =A0 =A0 =A0 =A0 =A0 50 =A0 =A0/ - root and zone partition
>
> 2. Raid 10
> =A0 =A0 =A0stripe 4 HDD, create 3 slices for on each HDD and then stripe
> it together for oracle HDD (log, data, index) those slices will start
> from external cylinders. =A0example
> cyl start - cyl end - part
> 1 =A0 =A0 =A0 =A0 =A0 =A010 =A0 =A0 =A0swap - 2x memory 36G
> 11 =A0 =A0 =A0 =A0 =A0 20 =A0 =A0 /db_log =A0 =A0(stripe on 4 HDD size=3D=
4x100G)
> 20 =A0 =A0 =A0 =A0 =A0 31 =A0 =A0 /db_data (stripe on 4 HDD size=3D4x100G=
)
> 30 =A0 =A0 =A0 =A0 =A0 41 =A0 =A0 /db_index (stripe on 4 HDD size=3D4x100=
G)
>
> Then create stripe on second set of 4 HDD, and mirror it each slice
> (cylinder start-end is only to visual design)
>
> How do you this about this design of HDD
>
> Thank you for comments

Hi Mariusz,

If you want to run an Oracle database on a recent Solaris release,
please see this white paper:

http://developers.sun.com/solaris/docs/wp-oraclezfsconfig-0510_ds_ac2.pdf

Thanks,

Cindy

>
> HiMariusz,
>
> If you want to run an Oracle database on a recent Solaris release,
> please see this white paper:
>
> http://developers.sun.com/solaris/docs/wp-oraclezfsconfig-0510_ds_ac2...
>
> Thanks,
>
> Cindy

Cindy, thank you for link.

To skip HDD controller and install system base on ZFS what I need set
in HDD controller? Right now I set each HDD as raid0 hardrive, There
is an option to enable controller bios - is this option should be turn
off, and then I will have direct access to all HDD?

Thank you
Mariusz

On Nov 5, 6:57=A0am, Mariusz Antonik <manto...@gmail.com> wrote:
> > HiMariusz,
>
> > If you want to run an Oracle database on a recent Solaris release,
> > please see this white paper:
>
> >http://developers.sun.com/solaris/docs/wp-oraclezfsconfig-0510_ds_ac2...
>
> > Thanks,
>
> > Cindy
>
> Cindy, thank you for link.
>
> To skip HDD controller and install system base on ZFS what I need set
> in HDD controller? Right now I set each HDD as raid0 hardrive, There
> is an option to enable controller bios - is this option should be turn
> off, and then I will have direct access to all HDD?
>
> Thank you
> Mariusz

Mariusz,

I'm not familiar with the HDD controller level steps so I hope
someone
else will jump in...

When you're ready to configure your storage pools, feel free to ask.

Thanks,

Cindy

On Nov 5, 10:48=A0am, cindy <cindy.swearin...@sun.com> wrote:
> On Nov 5, 6:57=A0am,MariuszAntonik<manto...@gmail.com> wrote:
>
>
>
>
>
>
>
>
>
> > > HiMariusz,
>
> > > If you want to run an Oracle database on a recent Solaris release,
> > > please see this white paper:
>
> > >http://developers.sun.com/solaris/docs/wp-oraclezfsconfig-0510_ds_ac2.=
...
>
> > > Thanks,
>
> > > Cindy
>
> > Cindy, thank you for link.
>
> > To skip HDD controller and install system base on ZFS what I need set
> > in HDD controller? Right now I set each HDD as raid0 hardrive, There
> > is an option to enable controller bios - is this option should be turn
> > off, and then I will have direct access to all HDD?
>
> > Thank you
> >Mariusz
>
> Mariusz,
>
> I'm not familiar with the HDD controller level steps so I hope
> someone
> else will jump in...
>
> When you're ready to configure your storage pools, feel free to ask.
>
> Thanks,
>
> Cindy

I am trying to find out how to do this as zfs is a new concept for
me.

I have 8HDD 300G
I want have one global zone
oracle zone
and cms zone (our application zone)

as I am reading best practice is to make zfs mirror on two HDD. but
then how I will cut small part for let say oracle index file system,
data, log?

Or should I make a raidz 2 (6+2) - allow work with failure of 2 HDD,
total space will be 6x300 - 1.8T then how I will assign 20G for oracle
zone, 20G for cms zone, and then split this size to other partitions
as 100G log, 100G index, 400G data that it will be independent, with
own size of sector?

Thank you for help
Mariusz

On 2010-11-05 18:31:27 +0000, Mariusz Antonik said:

> On Nov 5, 10:48�am, cindy <cindy.swearin...@sun.com> wrote:
>> On Nov 5, 6:57�am,MariuszAntonik<manto...@gmail.com> wrote:
>> 
>> 
>> 
>> 
>> 
>> 
>> 
>> 
>> 
>>>> HiMariusz,
>> 
>>>> If you want to run an Oracle database on a recent Solaris release,
>>>> please see this white paper:
>> 
>>>> http://developers.sun.com/solaris/docs/wp-oraclezfsconfig-0510_ds_ac2...
>> 
>>>> Thanks,
>> 
>>>> Cindy
>> 
>>> Cindy, thank you for link.
>> 
>>> To skip HDD controller and install system base on ZFS what I need set
>>> in HDD controller? Right now I set each HDD as raid0 hardrive, There
>>> is an option to enable controller bios - is this option should be turn
>>> off, and then I will have direct access to all HDD?
>> 
>>> Thank you
>>> Mariusz
>> 
>> Mariusz,
>> 
>> I'm not familiar with the HDD controller level steps so I hope
>> someone
>> else will jump in...
>> 
>> When you're ready to configure your storage pools, feel free to ask.
>> 
>> Thanks,
>> 
>> Cindy
> 
> I am trying to find out how to do this as zfs is a new concept for
> me.
> 
> I have 8HDD 300G
> I want have one global zone
> oracle zone
> and cms zone (our application zone)
> 
> as I am reading best practice is to make zfs mirror on two HDD. but
> then how I will cut small part for let say oracle index file system,
> data, log?

I have no idea whether this is a good idea for Oracle's purposes or 
not, but ZFS supports the creation of raw volumes inside a zpool, 
called zvols. No partitioning required, and you access it via a normal 
device path, eg /dev/<whatever>. You can dynamically increase zvol 
sizes.

The zvol takes advantage of any redundancy/resilience in the underlying zpool.

-- 
Chris

On Nov 5, 2:41=A0pm, Chris Ridd <chrisr...@mac.com> wrote:
> On 2010-11-05 18:31:27 +0000,MariuszAntoniksaid:
>
>
>
>
>
>
>
>
>
> > On Nov 5, 10:48=A0am, cindy <cindy.swearin...@sun.com> wrote:
> >> On Nov 5, 6:57=A0am,MariuszAntonik<manto...@gmail.com> wrote:
>
> >>>> HiMariusz,
>
> >>>> If you want to run an Oracle database on a recent Solaris release,
> >>>> please see this white paper:
>
> >>>>http://developers.sun.com/solaris/docs/wp-oraclezfsconfig-0510_ds_ac2=
....
>
> >>>> Thanks,
>
> >>>> Cindy
>
> >>> Cindy, thank you for link.
>
> >>> To skip HDD controller and install system base on ZFS what I need set
> >>> in HDD controller? Right now I set each HDD as raid0 hardrive, There
> >>> is an option to enable controller bios - is this option should be tur=
n
> >>> off, and then I will have direct access to all HDD?
>
> >>> Thank you
> >>>Mariusz
>
> >>Mariusz,
>
> >> I'm not familiar with the HDD controller level steps so I hope
> >> someone
> >> else will jump in...
>
> >> When you're ready to configure your storage pools, feel free to ask.
>
> >> Thanks,
>
> >> Cindy
>
> > I am trying to find out how to do this as zfs is a new concept for
> > me.
>
> > I have 8HDD 300G
> > I want have one global zone
> > oracle zone
> > and cms zone (our application zone)
>
> > as I am reading best practice is to make zfs mirror on two HDD. but
> > then how I will cut small part for let say oracle index file system,
> > data, log?
>
> I have no idea whether this is a good idea for Oracle's purposes or
> not, but ZFS supports the creation of raw volumes inside a zpool,
> called zvols. No partitioning required, and you access it via a normal
> device path, eg /dev/<whatever>. You can dynamically increase zvol
> sizes.
>
> The zvol takes advantage of any redundancy/resilience in the underlying z=
pool.
>
> --
> Chris

During installation I have option to select  UFS or ZFS, I select ZFS.
I have option to select one HDD for instalation. Is there option
during installation to setup mirroring of this HDD or setup RAIDZ 6+2,
and then create zvols for zones, or install system on one HDD then
mirror it with second HDD and create another pool RAIDZ 4+2?

Thank you
Mariusz

Mariusz

On 2010-11-05 19:35:28 +0000, Mariusz Antonik said:

> During installation I have option to select  UFS or ZFS, I select ZFS.

Good start :-)

> I have option to select one HDD for instalation. Is there option
> during installation to setup mirroring of this HDD or setup RAIDZ 6+2,

No. The Solaris grub doesn't support booting a pool which uses RAIDZ.

> and then create zvols for zones, or install system on one HDD then
> mirror it with second HDD and create another pool RAIDZ 4+2?

Yes. Install the root pool (normally called "rpool") on one disk, 
reboot, add a disk to turn the root pool into a mirrored pool. There's 
very good documentation for that - the only minor "gotcha" is that you 
have to install grub to the new disk as well. But that's documented too.

Then create additional pools using RAIDZ etc etc for your data.

Create zvols in whichever pools you want. You can do that before you 
set up the mirror, or afterwards, or whatever.

-- 
Chris

On Nov 5, 12:31=A0pm, Mariusz Antonik <manto...@gmail.com> wrote:
> On Nov 5, 10:48=A0am, cindy <cindy.swearin...@sun.com> wrote:
>
>
>
> > On Nov 5, 6:57=A0am,MariuszAntonik<manto...@gmail.com> wrote:
>
> > > > HiMariusz,
>
> > > > If you want to run an Oracle database on a recent Solaris release,
> > > > please see this white paper:
>
> > > >http://developers.sun.com/solaris/docs/wp-oraclezfsconfig-0510_ds_ac=
2...
>
> > > > Thanks,
>
> > > > Cindy
>
> > > Cindy, thank you for link.
>
> > > To skip HDD controller and install system base on ZFS what I need set
> > > in HDD controller? Right now I set each HDD as raid0 hardrive, There
> > > is an option to enable controller bios - is this option should be tur=
n
> > > off, and then I will have direct access to all HDD?
>
> > > Thank you
> > >Mariusz
>
> > Mariusz,
>
> > I'm not familiar with the HDD controller level steps so I hope
> > someone
> > else will jump in...
>
> > When you're ready to configure your storage pools, feel free to ask.
>
> > Thanks,
>
> > Cindy
>
> I am trying to find out how to do this as zfs is a new concept for
> me.
>
> I have 8HDD 300G
> I want have one global zone
> oracle zone
> and cms zone (our application zone)
>
> as I am reading best practice is to make zfs mirror on two HDD. but
> then how I will cut small part for let say oracle index file system,
> data, log?
>
> Or should I make a raidz 2 (6+2) - allow work with failure of 2 HDD,
> total space will be 6x300 - 1.8T then how I will assign 20G for oracle
> zone, 20G for cms zone, and then split this size to other partitions
> as 100G log, 100G index, 400G data that it will be independent, with
> own size of sector?
>
> Thank you for help
> Mariusz

Mariusz,

Do you have some internal disks that you could use for a mirrored
root pool? This would allow you more flexibility for a data pool.

An Oracle DB on ZFS performs best on a mirrored storage pool or
on hardware RAID. RAIDZ isn't a good choice for an Oracle DB.

I would try to use a mirrored pool for the data, index, and archive.
A separate pool is recommended for the redo logs.

Thanks,

Cindy

>
> Do you have some internal disks that you could use for a mirrored
> root pool? This would allow you more flexibility for a data pool.
>
> An Oracle DB on ZFS performs best on a mirrored storage pool or
> on hardware RAID. RAIDZ isn't a good choice for an Oracle DB.
>
> I would try to use a mirrored pool for the data, index, and archive.
> A separate pool is recommended for the redo logs.
>
> Thanks,
>
> Cindy


Chriss,Cindy - thank you for comments,

I found documentation and I was able to install and mirror HDD -
rpool.
One concern is that in case of primary HDD failure we have to update
HDD controler bios to boot from second HDD.

from rest  6 HDD I make raidz2
zpool create data raidz2 c0t1d0 c0t2d0 c0t3d0 c0t4d0 c0t5d0 c0t6d0

zpool status show everything nice and online,

Now I remove HDD 5 from server

zpool status still show all HDD online!
any idea why?

Cindy,
hardware raid will be simplest for us, but I don't find any software
which allow us to monitor HDD status on PERC H-700

Mariusz