[Twg] TWG meeting minutes for 2012-03-08

[John Carrier]

Here are the advertised minutes.

From: discuss-bounces at lists.opensfs.org [mailto:discuss-bounces at lists.opensfs.org] On Behalf Of John Carrier
Sent: Thursday, March 15, 2012 12:05 AM
To: twg at lists.opensfs.org; discuss at lists.opensfs.org
Subject: [Discuss] TWG meeting minutes for 2012-03-08

Attached are the meeting minutes from last week's TWG call.  This meeting continued the discussion of features that the TWG should consider as we update our requirements and roadmaps document.

We will continue this discussion this week (3/15).
Date/Time :  03/15/2011 @ 9:30a PDT/12:30p EDT
Dial: 1-715-726-4994,  1-866-304-8294
ID & Password: 72090

Please post corrections/questions/comments to discuss at lists.opensfs.org<mailto:discuss at lists.opensfs.org>

--jc


-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.opensfs.org/pipermail/twg_lists.opensfs.org/attachments/20120315/1d4c8e9e/attachment.html>
-------------- next part --------------
OpenSFS Technical Working Group
Meeting minutes : 2012-03-08

Concall: start : 9:30a PT, adjourn : 10:25a PT

Next meeting: Thursday, 03/15/2011 @ 9:30a PDT/12:30p EDT
   Dial-in numbers are 1-715-726-4994 or 1-866-304-8294
   Meeting ID and password are 72090

Attending : 
   Name                 Organization   email
   -----------------    -------------- ----------------------------
   Diego Moreno         Bull           Diego.Moreno-Lazaro at bull.net
   Cory Spitz           Cray           spitzcor at cray.com
   John Carrier         Cray           carrier at cray.com
   Alex Kulyavtsev      FNAL           aik at fnal.gov
   Joshua Walgenbach    IU             jjw at indiana.edu
   Richard Vanderbilt   NetApp         Richard.Vanderbilt at netapp.com
   Dave Dillow          ORNL           dillowda at ornl.gov
   Evan Felix           PNL            Evan.Felix at pnl.gov
   Nathan Rutman        Xyratex        nathan_rutman at xyratex.com

Agenda
   - update on OSFS test cluster
   - continue requirements & roadmap discussion

Test cluster at IU

   The OSFS board has approved purchase of small test cluster for lustre
   development at IU to include 24 client nodes, 4 MDS, 4 OSS and
   storage.  IU will host the system for OpenSFS.

   The cluster will be available to the OpenSFS Community for Lustre
   testing without citizenship restrictions. Initial use will be for
   testing the DNE feature (multiple MDTs, failover).  Dave asked the
   TWG for feedback on how to manage allocations and usage of this
   community resource.  This will be a topic for discussion at the TWG
   meeting at LUG.

   Josh will send the system specs to the TWG reflector.

Roadmap / Requirements

= version compatability ? 
   John asked about tools to verify client/server compatability. A more
   complete compatability matrix could help, but Cray was thinking more
   about a utility that system vendors could use to verify server
   functionality since Lustre will soon be deployed on a range of server
   appliances.  This would be a tool used to test compatibility without
   having to deploy a system with storage.

   Lustre already has automatic version or feature control since the
   client and server negotiate which features each client can use. Can
   look at client or server proc files to see what was negotiated.
   Hence, most felt this feature wasn't required. 

= HSM 
   Diego talked to CEA. HSM patches are waiting for integration. CEA is
   waiting to complete the inspection for inclusion in 2.2 and 2.3. It
   was reported that Johann Lombardi is the inspector at whamcloud for
   the HSM patches. Many will land in 2.3, with full HSM support in 2.4.

   There is concern that HSM isn't getting sufficient attention to
   complete integration.   John is to ask the CDWG on behalf of the TWG
   about the priority of HSM for upcoming releases.

   Diego said the community can get involved by testing CEA's patches.

= NRS 
   Nathan said Xyratex is actively working on NRS and will present their
   work with different policies at LUG.   After Xyratex proves no
   regressions during large scale testing they will land the
   infrastructure for a release. As a result, there is nothing for the
   TWG to do to support NRS.

= replication 
   Alex asked about the API's that Xyratex described in their migration
   whitepaper. Nathan explained that the software will move a lustre
   file system, but it is not a snapshot.  Xyratex's tool doesn't walk
   the namespace, instead using the changelog to move the file system.

   Xyratex has two tools: a migrator and repliator.   The migrator makes
   a one time move from 1.8.x to 2.x MDS by adding true FIDS to the MDS.
   The replicator is a brute force copy to duplicate an entire file
   system.
   
= benchmarking working group
   John introduced Richard Vanderbilt as the co-chair of the new
   benchmarking working group.  Sarp Oral is the other co-chair.  The
   new WG will focus on identifying I/O workloads and tools to emulate
   them. 

   The benchmarking working group will have a F2F the Sunday before LUG.
   (The TWG and CDWG will have F2F the Wednesday after LUG.)
   
[meeting ended 10:25a PT]