Adding a L2ARC cache USB pendrive panics

Moderators: jhartley, MSR734, nola

Adding a L2ARC cache USB pendrive panics

Post by amteza » Fri Nov 02, 2012 7:54 am

Hi there,

I was trying to test performance using a USB pendrive as L2ARC cache for my pool, but after adding it, it panics.

Mountain Lion 10.8.2 and ZEVO Community Edition 1.1.1

Just to let you know I tried several different USB pendrives.

Cheers.
amteza Offline


 
Posts: 22
Joined: Wed Oct 17, 2012 4:40 am
Location: Spain

Re: Adding a L2ARC cache USB pendrive panics

Post by si-ghan-bi » Fri Nov 02, 2012 1:28 pm

I tried only one and it's still working fine. Can you give additional info about your configuration, like drives and commands issued?
si-ghan-bi Offline


 
Posts: 145
Joined: Sat Sep 15, 2012 5:55 am

Re: Adding a L2ARC cache USB pendrive panics

Post by amteza » Sat Nov 03, 2012 3:16 am

si-ghan-bi wrote:I tried only one and it's still working fine. Can you give additional info about your configuration, like drives and commands issued?


Code: Select all
 zfs list

NAME                 USED   AVAIL   REFER  MOUNTPOINT
ZFSPool             423Gi  93,2Gi   132Ki  /Volumes/ZFSPool
ZFSPool/Parallels  15,0Gi  93,2Gi  15,0Gi  /Volumes/ZFSPool/Parallels
ZFSPool/Users      22,9Gi  93,2Gi  22,3Gi  /Users
ZFSPool/local       100Mi  93,2Gi  99,8Mi  /Volumes/ZFSPool/local
ZFSPool/media       385Gi  93,2Gi   385Gi  /Volumes/ZFSPool/media


I was trying to attach it to that pool. I formatted and created 1 partition in my pendrive with Disk Utility and issued the command:
Code: Select all
zpool add ZFSPool cache /dev/disk4


As you can see nothing fancy.

Cheers.
amteza Offline


 
Posts: 22
Joined: Wed Oct 17, 2012 4:40 am
Location: Spain

Re: Adding a L2ARC cache USB pendrive panics

Post by grahamperrin » Sat Nov 03, 2012 5:02 am

Please paste the content of one of the .panic files.

Comparison

Here, too, no problems wish a USB flash drive as a cache:

Code: Select all
macbookpro08-centrim:~ gjp22$ zpool history zhandy | grep 2012-11
2012-11-02.18:07:06 zpool scrub zhandy
2012-11-02.20:08:37 zpool add zhandy cache /dev/disk5
2012-11-02.20:08:49 zpool online zhandy GPTE_EC9A371E-C089-4E64-A8AA-F270CB9FB4B6
macbookpro08-centrim:~ gjp22$ sudo zpool status -v zhandy
  pool: zhandy
 state: ONLINE
 scan: scrub repaired 0 in 13h23m with 0 errors on Sat Nov  3 07:30:53 2012
config:

   NAME                                         STATE     READ WRITE CKSUM
   zhandy                                       ONLINE       0     0     0
     GPTE_1928482A-7FE4-482D-B692-3EC6B03159BA  ONLINE       0     0     0  at disk3s2
   cache
     GPTE_EC9A371E-C089-4E64-A8AA-F270CB9FB4B6  ONLINE       0     0     0  at disk2s2

errors: No known data errors
macbookpro08-centrim:~ gjp22$


Code: Select all
macbookpro08-centrim:~ gjp22$ zpool list
NAME      SIZE   ALLOC    FREE     CAP  HEALTH  ALTROOT
gjp22    572Gi   382Gi   190Gi     66%  ONLINE  -
tall    1.82Ti  1.78Ti  34.9Gi     98%  ONLINE  -
zhandy   592Gi   506Gi  86.1Gi     85%  ONLINE  -


disk3s2 for the pool zhandy is on one of two USB high speed buses of a MacBookPro5,2 with 8 GB memory running OS X 10.8.2. Central port.

disk2s2 for cache is on the other USB high speed bus. Frontmost port, alongside the Built-in iSight:

Code: Select all
Store n Go Drive:

  Capacity:   4.02 GB (4,023,386,112 bytes)
  Removable Media:   Yes
  Detachable Drive:   Yes
  BSD Name:   disk2
  Product ID:   0x0238
  Vendor ID:   0x18a5
  Version:   11.00
  Serial Number:   361120100079078
  Speed:   Up to 480 Mb/sec
  Manufacturer:   Verbatim
  Location ID:   0x24100000 / 2
  Current Available (mA):   500
  Current Required (mA):   500
  Partition Map Type:   GPT (GUID Partition Table)
  S.M.A.R.T. status:   Not Supported
  Volumes:
    disk2s1:
      Capacity:   209.7 MB (209,715,200 bytes)
      BSD Name:   disk2s1
      Content:   EFI
    disk2s2:
      Capacity:   3.68 GB (3,679,412,224 bytes)
      BSD Name:   disk2s2
      Content:   ZFS


Screenshots at http://www.wuala.com/grahamperrin/publi ... de=gallery show a storage pool health notification when a cache is added, but no panic.

Code: Select all
macbookpro08-centrim:~ gjp22$ zpool get all zhandy
NAME    PROPERTY       VALUE      SOURCE
zhandy  size           592Gi      -
zhandy  capacity       85%        -
zhandy  altroot        -          default
zhandy  health         ONLINE     -
zhandy  guid           4688397874579579662  default
zhandy  version        28         default
zhandy  failmode       continue   default
zhandy  listsnapshots  off        default
zhandy  autoexpand     off        default
zhandy  free           86.1Gi     -
zhandy  allocated      506Gi      -
zhandy  readonly       off        -
zhandy  ashift         0          default
macbookpro08-centrim:~ gjp22$ zfs get all zhandy
NAME    PROPERTY              VALUE                  SOURCE
zhandy  type                  filesystem             -
zhandy  creation              Wed Mar 14 17:29 2012  -
zhandy  used                  506Gi                  -
zhandy  available             76.9Gi                 -
zhandy  referenced            409Gi                  -
zhandy  compressratio         1.16x                  -
zhandy  mounted               yes                    -
zhandy  quota                 none                   default
zhandy  reservation           none                   default
zhandy  recordsize            128Ki                  default
zhandy  mountpoint            /Volumes/zhandy        default
zhandy  checksum              on                     default
zhandy  compression           on                     local
zhandy  atime                 off                    local
zhandy  devices               on                     default
zhandy  exec                  on                     default
zhandy  setuid                on                     default
zhandy  readonly              off                    default
zhandy  snapdir               visible                local
zhandy  canmount              on                     default
zhandy  copies                1                      local
zhandy  version               5                      -
zhandy  utf8only              off                    -
zhandy  normalization         none                   -
zhandy  casesensitivity       insensitive            -
zhandy  refquota              none                   default
zhandy  refreservation        none                   default
zhandy  primarycache          all                    default
zhandy  secondarycache        all                    default
zhandy  usedbysnapshots       46.3Gi                 -
zhandy  usedbydataset         409Gi                  -
zhandy  usedbychildren        50.3Gi                 -
zhandy  usedbyrefreservation  0                      -
zhandy  logbias               latency                default


The primary disk in the pool is a 640 GB StoreJet Transcend (0x2329) similar to models at http://www.transcend-info.com/Products/ ... &ModNo=293
grahamperrin Offline

User avatar
 
Posts: 1596
Joined: Fri Sep 14, 2012 10:21 pm
Location: Brighton and Hove, United Kingdom

Re: Adding a L2ARC cache USB pendrive panics

Post by amteza » Sun Nov 04, 2012 1:47 pm

grahamperrin wrote:Please paste the content of one of the .panic files.


There it goes:
Code: Select all
Wed Oct 31 22:27:12 2012
panic(cpu 0 caller 0xffffff8004c43d8e): "a freed zone element has been modified in zone: kqueue"@/SourceCache/xnu/xnu-2050.18.24/osfmk/kern/zalloc.c:219
Backtrace (CPU 0), Frame : Return Address
0xffffff807d1f3d50 : 0xffffff8004c1d626
0xffffff807d1f3dc0 : 0xffffff8004c43d8e
0xffffff807d1f3e00 : 0xffffff8004c435d2
0xffffff807d1f3ee0 : 0xffffff8004f4dde6
0xffffff807d1f3f10 : 0xffffff8004f4e26f
0xffffff807d1f3f50 : 0xffffff8004fe182a
0xffffff807d1f3fb0 : 0xffffff8004cced33

BSD process name corresponding to current thread: backupd-helper

Mac OS version:
12C60

Kernel version:
Darwin Kernel Version 12.2.0: Sat Aug 25 00:48:52 PDT 2012; root:xnu-2050.18.24~1/RELEASE_X86_64
Kernel UUID: 69A5853F-375A-3EF4-9247-478FD0247333
Kernel slide:     0x0000000004a00000
Kernel text base: 0xffffff8004c00000
System model name: iMac9,1 (Mac-F2218EA9)

System uptime in nanoseconds: 25981216129
last loaded kext at 21728252354: com.apple.driver.AGPM   100.12.69 (addr 0xffffff7f86ef4000, size 90112)
loaded kexts:
com.Cycling74.driver.Soundflower   1.5.3
com.getgreenbytes.driver.zfs   2012.09.14
com.getgreenbytes.filesystem.zfs   2012.09.23
com.rogueamoeba.InstantOn   5.0.2
com.apple.driver.AGPM   100.12.69
com.apple.driver.AppleTyMCEDriver   1.0.2d2
com.apple.driver.AppleHDAHardwareConfigDriver   2.3.1f2
com.apple.driver.AppleHDA   2.3.1f2
com.apple.driver.AppleMikeyHIDDriver   122
com.apple.iokit.IOBluetoothUSBDFU   4.0.9f33
com.apple.iokit.BroadcomBluetoothHCIControllerUSBTransport   4.0.9f33
com.apple.driver.AudioAUUC   1.60
com.apple.driver.AppleLPC   1.6.0
com.apple.iokit.IOUserEthernet   1.0.0d1
com.apple.iokit.IOBluetoothSerialManager   4.0.9f33
com.apple.Dont_Steal_Mac_OS_X   7.0.0
com.apple.driver.ApplePolicyControl   3.2.11
com.apple.driver.AppleMikeyDriver   2.3.1f2
com.apple.driver.ACPI_SMC_PlatformPlugin   1.0.0
com.apple.driver.AppleMuxControl   3.2.11
com.apple.driver.AppleBacklight   170.2.3
com.apple.filesystems.autofs   3.0
com.apple.driver.AppleUpstreamUserClient   3.5.10
com.apple.driver.AppleMCCSControl   1.0.33
com.apple.GeForce   8.0.0
com.apple.driver.AppleFireWireStorage   3.1.0
com.apple.driver.initioFWBridge   3.1.0
com.apple.driver.IOFireWireSerialBusProtocolSansPhysicalUnit   3.1.0
com.apple.driver.LSI_FW_500   3.1.0
com.apple.driver.Oxford_Semi   3.1.0
com.apple.driver.StorageLynx   3.1.0
com.apple.driver.AppleIRController   320.15
com.apple.driver.AppleFileSystemDriver   3.0.1
com.apple.AppleFSCompression.AppleFSCompressionTypeDataless   1.0.0d1
com.apple.AppleFSCompression.AppleFSCompressionTypeZlib   1.0.0d1
com.apple.BootCache   34
com.apple.iokit.SCSITaskUserClient   3.5.1
com.apple.driver.XsanFilter   404
com.apple.iokit.IOAHCIBlockStorage   2.2.2
com.apple.driver.AirPort.Brcm4331   602.15.22
com.apple.driver.AppleFWOHCI   4.9.6
com.apple.driver.AppleAHCIPort   2.4.1
com.apple.nvenet   2.0.19
com.apple.driver.AppleUSBHub   5.2.5
com.apple.driver.AppleEFINVRAM   1.6.1
com.apple.driver.AppleUSBEHCI   5.4.0
com.apple.driver.AppleUSBOHCI   5.2.5
com.apple.driver.AppleHPET   1.7
com.apple.driver.AppleRTC   1.5
com.apple.driver.AppleACPIButtons   1.6
com.apple.driver.AppleSMBIOS   1.9
com.apple.driver.AppleACPIEC   1.6
com.apple.driver.AppleAPIC   1.6
com.apple.driver.AppleIntelCPUPowerManagementClient   196.0.0
com.apple.nke.applicationfirewall   4.0.39
com.apple.security.quarantine   2
com.apple.driver.AppleIntelCPUPowerManagement   196.0.0
com.apple.driver.DspFuncLib   2.3.1f2
com.apple.iokit.IOFireWireIP   2.2.5
com.apple.iokit.AppleBluetoothHCIControllerUSBTransport   4.0.9f33
com.apple.driver.AppleHDAController   2.3.1f2
com.apple.iokit.IOHDAFamily   2.3.1f2
com.apple.iokit.IOAudioFamily   1.8.9fc10
com.apple.kext.OSvKernDSPLib   1.6
com.apple.iokit.IOSurface   86.0.3
com.apple.iokit.IOSerialFamily   10.0.6
com.apple.iokit.IOBluetoothFamily   4.0.9f33
com.apple.driver.AppleSMC   3.1.4d2
com.apple.driver.IOPlatformPluginLegacy   1.0.0
com.apple.driver.IOPlatformPluginFamily   5.2.0d16
com.apple.driver.AppleSMBusPCI   1.0.10d0
com.apple.driver.AppleGraphicsControl   3.2.11
com.apple.driver.AppleBacklightExpert   1.0.4
com.apple.kext.triggers   1.0
com.apple.driver.AppleSMBusController   1.0.10d0
com.apple.nvidia.nv50hal   8.0.0
com.apple.NVDAResman   8.0.0
com.apple.iokit.IONDRVSupport   2.3.5
com.apple.iokit.IOGraphicsFamily   2.3.5
com.apple.iokit.IOSCSIBlockCommandsDevice   3.5.1
com.apple.iokit.IOFireWireSerialBusProtocolTransport   2.1.1
com.apple.iokit.IOFireWireSBP2   4.2.0
com.apple.driver.AppleUSBHIDKeyboard   165.5
com.apple.driver.AppleHIDKeyboard   165.5
com.apple.iokit.IOUSBHIDDriver   5.2.5
com.apple.driver.AppleUSBMergeNub   5.2.5
com.apple.driver.AppleUSBComposite   5.2.5
com.apple.iokit.IOSCSIMultimediaCommandsDevice   3.5.1
com.apple.iokit.IOBDStorageFamily   1.7
com.apple.iokit.IODVDStorageFamily   1.7.1
com.apple.iokit.IOCDStorageFamily   1.7.1
com.apple.iokit.IOAHCISerialATAPI   2.5.0
com.apple.iokit.IOSCSIArchitectureModelFamily   3.5.1
com.apple.iokit.IO80211Family   500.15
com.apple.iokit.IOFireWireFamily   4.5.5
com.apple.iokit.IOAHCIFamily   2.2.1
com.apple.iokit.IONetworkingFamily   3.0
com.apple.iokit.IOUSBUserClient   5.2.5
com.apple.iokit.IOUSBFamily   5.4.0
com.apple.driver.NVSMU   2.2.9
com.apple.driver.AppleEFIRuntime   1.6.1
com.apple.iokit.IOHIDFamily   1.8.0
com.apple.iokit.IOSMBusFamily   1.1
com.apple.security.sandbox   220
com.apple.kext.AppleMatch   1.0.0d1
com.apple.security.TMSafetyNet   7
com.apple.driver.DiskImages   344
com.apple.iokit.IOStorageFamily   1.8
com.apple.driver.AppleKeyStore   28.21
com.apple.driver.AppleACPIPlatform   1.6
com.apple.iokit.IOPCIFamily   2.7.2
com.apple.iokit.IOACPIFamily   1.4
com.apple.kec.corecrypto   1.0
 
amteza Offline


 
Posts: 22
Joined: Wed Oct 17, 2012 4:40 am
Location: Spain

Re: Adding a L2ARC cache USB pendrive panics

Post by amteza » Sun Nov 04, 2012 1:56 pm

Ok, after I saw that my kernel panic was related to the proccess backups-helper I disabled Time Machine and tried it again. It worked!
amteza Offline


 
Posts: 22
Joined: Wed Oct 17, 2012 4:40 am
Location: Spain

Re: Adding a L2ARC cache USB pendrive panics

Post by grahamperrin » Sun Nov 04, 2012 2:17 pm

Interesting.

Here: Time Machine on, with extremely rare connection to a backup volume. I guess that Mobile Time Machine is enabled but I haven't bothered to Enter Time Machine for a long time.

First thoughts …

Code: Select all
macbookpro08-centrim:~ gjp22$ sudo launchctl list | grep mtm
Password:
macbookpro08-centrim:~ gjp22$ sudo launchctl list | grep backup
-   0   com.apple.var-db-dslocal-backup
-   0   com.apple.backupd
-   0   com.apple.backupd-wake
-   0   com.apple.backupd-auto
-   0   com.apple.backupd-attach


Code: Select all
macbookpro08-centrim:~ gjp22$ sudo launchctl list com.apple.backupd
{
   "Label" = "com.apple.backupd";
   "LimitLoadToSessionType" = "System";
   "OnDemand" = true;
   "LastExitStatus" = 0;
   "TimeOut" = 30;
   "Program" = "/System/Library/CoreServices/backupd";
   "EnableTransactions" = true;
   "MachServices" = {
      "com.apple.backupd" = mach-port-object;
      "com.apple.backupd.xpc" = mach-port-object;
      "com.apple.backupd-status" = mach-port-object;
      "com.apple.backupd.sandbox.xpc" = mach-port-object;
   };
};
macbookpro08-centrim:~ gjp22$ sudo launchctl list com.apple.backupd-wake
{
   "Label" = "com.apple.backupd-wake";
   "LimitLoadToSessionType" = "System";
   "OnDemand" = true;
   "LastExitStatus" = 0;
   "TimeOut" = 30;
   "ProgramArguments" = (
      "/System/Library/CoreServices/backupd.bundle/Contents/Resources/backupd-helper";
      "-wake";
   );
   "EnableTransactions" = true;
};
macbookpro08-centrim:~ gjp22$ sudo launchctl list com.apple.backupd-attach
{
   "Label" = "com.apple.backupd-attach";
   "LimitLoadToSessionType" = "System";
   "OnDemand" = true;
   "LastExitStatus" = 0;
   "TimeOut" = 30;
   "ProgramArguments" = (
      "/System/Library/CoreServices/backupd.bundle/Contents/Resources/backupd-helper";
      "-attach";
   );
   "EnableTransactions" = true;
};
macbookpro08-centrim:~ gjp22$ sw_vers
ProductName:   Mac OS X
ProductVersion:   10.8.2
BuildVersion:   12C60
macbookpro08-centrim:~ gjp22$


Without aiming to reproduce a kernel panic: if you re-enable your helper, how does your launchctl environment compare? Maybe particular interest in output from:

Code: Select all
sudo launchctl list com.apple.backupd-attach
grahamperrin Offline

User avatar
 
Posts: 1596
Joined: Fri Sep 14, 2012 10:21 pm
Location: Brighton and Hove, United Kingdom

Re: Adding a L2ARC cache USB pendrive panics

Post by grahamperrin » Sun Nov 04, 2012 2:28 pm

amteza wrote:… 
panic(cpu 0 caller 0xffffff8004c43d8e): "a freed zone element has been modified in zone: kqueue"@/SourceCache/xnu/xnu-2050.18.24/osfmk/kern/zalloc.c:219
… 


Elsewhere, beyond ZEVO: http://duckduckgo.com/?q=%22a+freed+zon ... in+zone%22
but nothing to match the
kqueue"@/SourceCache/xnu/xnu-2050.18.24/osfmk/kern/zalloc.c:219
part of the string in your case.

In Apple Open Source: http://www.opensource.apple.com/source/ ... n/zalloc.c
grahamperrin Offline

User avatar
 
Posts: 1596
Joined: Fri Sep 14, 2012 10:21 pm
Location: Brighton and Hove, United Kingdom

kernel panic when the cache to be added was in an old hub

Post by grahamperrin » Thu Dec 20, 2012 1:47 am

If I recall correctly, I once had a kernel panic when the drive to be added was in a hub.

Kingston DataTraveler 400
product ID 0x1614

Sitecom USB 2.0 Dock CN-022
product ID 0x0022

With the drive connected to the MacBookPro5,2: so far, no problems.
grahamperrin Offline

User avatar
 
Posts: 1596
Joined: Fri Sep 14, 2012 10:21 pm
Location: Brighton and Hove, United Kingdom

Re: Adding a L2ARC cache USB pendrive panics

Post by si-ghan-bi » Thu Jan 03, 2013 9:16 pm

I always used it connected to a Hama USB2.0 hub, but I think I got the KPs after removing that stick. Unfortunately, I don't remember exactly and right now I moved all the ZFS disks to a dedicated server without any L2ARC (18 GB RAM are already enough).
si-ghan-bi Offline


 
Posts: 145
Joined: Sat Sep 15, 2012 5:55 am

Next

Return to General Discussion

Who is online

Users browsing this forum: No registered users and 1 guest

cron