NetApp: Difference between revisions

From CSCWiki
Jump to navigation Jump to search
(iscsi setup part 1)
(→‎iSCSI setup procedure: Makefile for copying user homedirs)
Line 61: Line 61:
* RAID-DP - Double Parity RAID6
* RAID-DP - Double Parity RAID6


==iSCSI setup procedure==
==iSCSI setup log==
* on the netapp,
1. on the netapp,
** start the iscsi stuff. Set up a client user/pass (Marc: please fill this part out at some point)
* start the iscsi stuff. Set up a client user/pass (m4burns: please fill this part out at some point)


* set up aspartame to talk with the netapp. (all commands were run on aspartame)
2. set up aspartame to talk with the netapp. (all commands were run on aspartame)
** installed open-iscsi
* installed open-iscsi
** set discovery.sendtargets.auth.* and node.session.auth.* in /etc/iscsi/iscsid.conf (users and passwords are the same)
* set discovery.sendtargets.auth.* and node.session.auth.* in /etc/iscsi/iscsid.conf (users and passwords are the same)
** start open-iscsi with service open-iscsi start
* start open-iscsi with service open-iscsi start
⚫
* to verify that the netapp is exporting the iSCSI interface properly,
** iscsiadm -m discovery --type st -p psilodump
iscsiadm -m discovery --type st -p psilodump
⚫
to verify that the netapp is exporting the iSCSI interface properly
*
⚫
iscsiadm --mode node --targetname "iqn.1992-08.com.netapp:psilodump.csclub.uwaterloo.ca" --portal 129.97.134.130:3260 --login


3. set up ginseng the same way as aspartame
⚫
** iscsiadm --mode node --targetname "iqn.1992-08.com.netapp:psilodump.csclub.uwaterloo.ca" --portal 129.97.134.130:3260 --login


* set up the netapp filesystem:
4. set up the netapp filesystem and transfer old files from ginseng:
** entire thing is an ext4 primary partition
* on ginseng, use parted to set up the mounted iscsi drive as an ext4 primary partition (setting up a partition of size >2TB requires care)
* installed star as root on ginseng
* transferred files with the following Makefile (make -j8):
foo := $(wildcard /export/users/*)
bar := $(patsubst /export/users/%,/mnt/iscsi/%,$(foo))
all: $(bar)
/mnt/iscsi/%: /export/users/%
# echo $@ $<
~/star-1.5.2/star/OBJ/x86_64-linux-cc/star \
-copy -p artype=exustar \
-C /export/users $(notdir $<) /mnt/iscsi
*

Revision as of 23:08, 3 February 2013

As of 2013, the CSC has a NetApp FAS3000 series which is capable of hosting network shares. It was donated to us by CSCF. It is also pretty old.

Documentation

All the manuals are hosted in ~sysadmin/netapp-docs/

Relevant docs for storage modification are: smg.pdf, sysadmin.pdf

iSCSI documentation is in ontop/bsag.pdf

Access

Currently it is accessible via serial interface via ascorbic-acid.

(Later, this will be accessible via aspartame, through its network interface+serial interface).

Permissions

The NetApp does not support extended ACLs on NFSv4, so extended ACLs are supported via CIFS. This is particularly important for club accounts, and for some users hosting git repos out of their homedirs.

Commands

aggr status -r aggr<num>
  Shows aggregate status
disk show -v
  Shows disks, and which filer they are owned by (currently all by psilodump)
storage
  storage related things
disk assign
  Assigns orphaned disks to a filer
vol
  Volume stuffs

Layout

  • shelf 1
    • 10,000 RPM FibreChannel disks
    • Currently set to standalone filer+shelf, not set up
  • shelf 2
    • 10,000 RPM FibreChannel disks
    • Currently assigned to phlogiston, not set up (phlogiston is off)
  • shelf 3
    • 7,200 RPM ATA disks
    • Currently assigned to psilodump
  • shelf 4
    • 7,200 RPM ATA disks
    • Currently assigned to psilodump

Aggregates

  • aggr0
    • Root aggregate volume, in RAID-DP
  • aggr1
    • Music aggregate volume, in RAID-DP
  • aggr2
    • Users aggregate volume, in RAID-DP

Volumes

  • /vol/vol0
    • Root volume
  • /vol/vol1music
    • Music volume
  • /vol/vol2users
    • Users volume

Terminology

  • RAID-DP - Double Parity RAID6

iSCSI setup log

1. on the netapp,

  • start the iscsi stuff. Set up a client user/pass (m4burns: please fill this part out at some point)

2. set up aspartame to talk with the netapp. (all commands were run on aspartame)

  • installed open-iscsi
  • set discovery.sendtargets.auth.* and node.session.auth.* in /etc/iscsi/iscsid.conf (users and passwords are the same)
  • start open-iscsi with service open-iscsi start
  • to verify that the netapp is exporting the iSCSI interface properly,
iscsiadm  -m discovery --type st -p psilodump

iscsiadm   --mode node  --targetname "iqn.1992-08.com.netapp:psilodump.csclub.uwaterloo.ca"  --portal 129.97.134.130:3260 --login

3. set up ginseng the same way as aspartame

4. set up the netapp filesystem and transfer old files from ginseng:

  • on ginseng, use parted to set up the mounted iscsi drive as an ext4 primary partition (setting up a partition of size >2TB requires care)
  • installed star as root on ginseng
  • transferred files with the following Makefile (make -j8):
foo := $(wildcard /export/users/*)
bar := $(patsubst /export/users/%,/mnt/iscsi/%,$(foo))
all: $(bar)
/mnt/iscsi/%: /export/users/%
	# echo $@ $<
	~/star-1.5.2/star/OBJ/x86_64-linux-cc/star \
	    -copy -p artype=exustar \
	    -C /export/users $(notdir $<) /mnt/iscsi
Retrieved from "https://wiki.csclub.uwaterloo.ca/index.php?title=NetApp&oldid=3365"