From peter.a.jones at intel.com Sun Aug 3 14:03:53 2014 From: peter.a.jones at intel.com (Jones, Peter A) Date: Sun, 3 Aug 2014 14:03:53 +0000 Subject: [cdwg] [HPDD-discuss] Lustre 2.6.0 released In-Reply-To: References: Message-ID: Hi Eli 2.6 is a feature release and is not intended to be a maintenance release stream. See https://wiki.hpdd.intel.com/display/PUB/Lustre+Releases Peter On 8/3/14, 6:49 AM, "E.S. Rosenberg" > wrote: What does this mean for 2.4.x and 2.5.x? Originally 2.4.x was supposed to be the version that would be supported for a long persiod, then 2.5.x became that version because of HFS as far as I understand. Thanks, Eli On Thu, Jul 31, 2014 at 4:03 AM, Jones, Peter A > wrote: We are pleased to announce that the Lustre 2.6.0 Release has been declared GA and is available for download . You can also grab the source from git This major release includes new features: MDT-OST Consistency Check and Repair (LFSCK Phase 2)- Allows the MDS to verify the consistency of a Lustre filesystem while it is mounted and in use. The latest enhancements are to check and repair the validity of OST objects of regular files and to identify and optionally remove or link into lost+found OST objects that are not referenced by any files on the MDS. This development is funded by OpenSFS (LU-1267) Single Client Performance Improvements – Single thread per process IO performance has been improved. This work was discussed in details at LUG (LU-3321) Striped Directories -Enables a single directory to be striped across multiple MDTs to improve single directory performance and scalability. This is a technology preview of part of the DNE phase 2 work funded by OpenSFS that will be fully available in a future Lustre release (LU-3531) Fuller details can be found in the change log, the scope statement and the test matrix The following are known issues in the Lustre 2.6 Release: LU-5057 - A rare race condition can lead to an LASSERT when unmounting an OST. LU-5150 - Empty access control lists (ACLs) will be stored for copied files when using a ZFS MDS. It does not affect ldiskfs MDSes. LU-4367 - Metadata performance is affected for unlinking files in a single shared directory in a manner common with mdtest benchmark pattern. LU-5420 - DNE configurations with multiple MDTs sharing a single node with an MGS may hang during MDT mount or fail to mount an MDT after unclean shutdown. Work is in progress for these issues. NOTE: Users should note that usage of the e2fsprogs-based lfsck has been deprecated and replaced by "lctl lfsck_start”. Using older e2fsprogs-based lfsck may lead to filesystem corruption. Once available, it is also recommended to use e2fsprogs-1.42.11.wc2 (or newer). Please log any issues found in the issue tracking system We would like to thank OpenSFS, for their contributions towards the cost of the release and also to all Lustre community members who have contributed to the release with code and/or testing. _______________________________________________ HPDD-discuss mailing list HPDD-discuss at lists.01.org https://lists.01.org/mailman/listinfo/hpdd-discuss From peter.a.jones at intel.com Sun Aug 3 14:14:29 2014 From: peter.a.jones at intel.com (Jones, Peter A) Date: Sun, 3 Aug 2014 14:14:29 +0000 Subject: [cdwg] [HPDD-discuss] Lustre 2.6.0 released In-Reply-To: References: Message-ID: It may still get updates but there is no fixed schedule for these. On 8/3/14, 7:12 AM, "E.S. Rosenberg" > wrote: But will 2.4.x still get updates or was 2.4.3 the last? On Sun, Aug 3, 2014 at 5:03 PM, Jones, Peter A > wrote: Hi Eli 2.6 is a feature release and is not intended to be a maintenance release stream. See https://wiki.hpdd.intel.com/display/PUB/Lustre+Releases Peter On 8/3/14, 6:49 AM, "E.S. Rosenberg" >> wrote: What does this mean for 2.4.x and 2.5.x? Originally 2.4.x was supposed to be the version that would be supported for a long persiod, then 2.5.x became that version because of HFS as far as I understand. Thanks, Eli On Thu, Jul 31, 2014 at 4:03 AM, Jones, Peter A >> wrote: We are pleased to announce that the Lustre 2.6.0 Release has been declared GA and is available for download . You can also grab the source from git This major release includes new features: MDT-OST Consistency Check and Repair (LFSCK Phase 2)- Allows the MDS to verify the consistency of a Lustre filesystem while it is mounted and in use. The latest enhancements are to check and repair the validity of OST objects of regular files and to identify and optionally remove or link into lost+found OST objects that are not referenced by any files on the MDS. This development is funded by OpenSFS (LU-1267) Single Client Performance Improvements – Single thread per process IO performance has been improved. This work was discussed in details at LUG (LU-3321) Striped Directories -Enables a single directory to be striped across multiple MDTs to improve single directory performance and scalability. This is a technology preview of part of the DNE phase 2 work funded by OpenSFS that will be fully available in a future Lustre release (LU-3531) Fuller details can be found in the change log, the scope statement and the test matrix The following are known issues in the Lustre 2.6 Release: LU-5057 - A rare race condition can lead to an LASSERT when unmounting an OST. LU-5150 - Empty access control lists (ACLs) will be stored for copied files when using a ZFS MDS. It does not affect ldiskfs MDSes. LU-4367 - Metadata performance is affected for unlinking files in a single shared directory in a manner common with mdtest benchmark pattern. LU-5420 - DNE configurations with multiple MDTs sharing a single node with an MGS may hang during MDT mount or fail to mount an MDT after unclean shutdown. Work is in progress for these issues. NOTE: Users should note that usage of the e2fsprogs-based lfsck has been deprecated and replaced by "lctl lfsck_start”. Using older e2fsprogs-based lfsck may lead to filesystem corruption. Once available, it is also recommended to use e2fsprogs-1.42.11.wc2 (or newer). Please log any issues found in the issue tracking system We would like to thank OpenSFS, for their contributions towards the cost of the release and also to all Lustre community members who have contributed to the release with code and/or testing. _______________________________________________ HPDD-discuss mailing list HPDD-discuss at lists.01.org> https://lists.01.org/mailman/listinfo/hpdd-discuss From esr+hpdd-discuss at mail.hebrew.edu Sun Aug 3 13:49:03 2014 From: esr+hpdd-discuss at mail.hebrew.edu (E.S. Rosenberg) Date: Sun, 3 Aug 2014 16:49:03 +0300 Subject: [cdwg] [HPDD-discuss] Lustre 2.6.0 released In-Reply-To: References: Message-ID: What does this mean for 2.4.x and 2.5.x? Originally 2.4.x was supposed to be the version that would be supported for a long persiod, then 2.5.x became that version because of HFS as far as I understand. Thanks, Eli On Thu, Jul 31, 2014 at 4:03 AM, Jones, Peter A wrote: > We are pleased to announce that the Lustre 2.6.0 Release has been declared > GA and is available for download< > https://downloads.hpdd.intel.com/public/lustre/latest-feature-release/> . > You can also grab the source from git< > http://git.whamcloud.com/fs/lustre-release.git/commit/73ea776053d99f74a9f5679fe55ec5d9461b8a89 > > > > This major release includes new features: > > MDT-OST Consistency Check and Repair (LFSCK Phase 2)- Allows the MDS to > verify the consistency of a Lustre filesystem while it is mounted and in > use. The latest enhancements are to check and repair the validity of OST > objects of regular files and to identify and optionally remove or link into > lost+found OST objects that are not referenced by any files on the MDS. > This development is funded by OpenSFS (LU-1267< > https://jira.hpdd.intel.com/browse/LU-1267>) > Single Client Performance Improvements – Single thread per process IO > performance has been improved. This work was discussed in details at LUG< > http://cdn.opensfs.org/wp-content/uploads/2014/04/D1_S6_LustreClientIOPerformanceImprovements.pdf> > (LU-3321) > > Striped Directories -Enables a single directory to be striped across > multiple MDTs to improve single directory performance and scalability. This > is a technology preview of part of the DNE phase 2 work funded by OpenSFS > that will be fully available in a future Lustre release (LU-3531< > https://jira.hpdd.intel.com/browse/LU-3531>) > > Fuller details can be found in the change log< > https://wiki.hpdd.intel.com/display/PUB/Changelog+2.6>, the scope > statement< > https://wiki.hpdd.intel.com/display/PUB/Lustre+2.6+Scope+Statement> < > https://wiki.hpdd.intel.com/display/PUB/Lustre+2.6+Scope+Statement> and > the test matrix< > https://wiki.hpdd.intel.com/display/PUB/Lustre+2.6> > The following are known issues in the Lustre 2.6 Release: > > LU-5057 - A rare race > condition can lead to an LASSERT when unmounting an OST. > LU-5150 - Empty access > control lists (ACLs) will be stored for copied files when using a ZFS MDS. > It does not affect ldiskfs MDSes. > LU-4367 - Metadata > performance is affected for unlinking files in a single shared directory in > a manner common with mdtest benchmark pattern. > LU-5420 - DNE configurations > with multiple MDTs sharing a single node with an MGS may hang during MDT > mount or fail to mount an MDT after unclean shutdown. > Work is in progress for these issues. > > NOTE: Users should note that usage of the e2fsprogs-based lfsck has been > deprecated and replaced by "lctl lfsck_start”. Using older e2fsprogs-based > lfsck may lead to filesystem corruption. Once available, it is also > recommended to use e2fsprogs-1.42.11.wc2 (or newer). > Please log any issues found in the issue tracking system< > https://jira.hpdd.intel.com/> > > We would like to thank OpenSFS, for their > contributions towards the cost of the release and also to all Lustre > community members who have contributed to the release with code and/or > testing. > > _______________________________________________ > HPDD-discuss mailing list > HPDD-discuss at lists.01.org > https://lists.01.org/mailman/listinfo/hpdd-discuss > -------------- next part -------------- An HTML attachment was scrubbed... URL: From esr at cs.huji.ac.il Sun Aug 3 14:12:38 2014 From: esr at cs.huji.ac.il (E.S. Rosenberg) Date: Sun, 3 Aug 2014 17:12:38 +0300 Subject: [cdwg] [HPDD-discuss] Lustre 2.6.0 released In-Reply-To: References: Message-ID: But will 2.4.x still get updates or was 2.4.3 the last? On Sun, Aug 3, 2014 at 5:03 PM, Jones, Peter A wrote: > Hi Eli > > 2.6 is a feature release and is not intended to be a maintenance release > stream. See https://wiki.hpdd.intel.com/display/PUB/Lustre+Releases > > Peter > > On 8/3/14, 6:49 AM, "E.S. Rosenberg" > wrote: > > What does this mean for 2.4.x and 2.5.x? > > Originally 2.4.x was supposed to be the version that would be supported > for a long persiod, then 2.5.x became that version because of HFS as far as > I understand. > > Thanks, > Eli > > > On Thu, Jul 31, 2014 at 4:03 AM, Jones, Peter A > wrote: > We are pleased to announce that the Lustre 2.6.0 Release has been declared > GA and is available for download< > https://downloads.hpdd.intel.com/public/lustre/latest-feature-release/> . > You can also grab the source from git< > http://git.whamcloud.com/fs/lustre-release.git/commit/73ea776053d99f74a9f5679fe55ec5d9461b8a89 > > > > This major release includes new features: > > MDT-OST Consistency Check and Repair (LFSCK Phase 2)- Allows the MDS to > verify the consistency of a Lustre filesystem while it is mounted and in > use. The latest enhancements are to check and repair the validity of OST > objects of regular files and to identify and optionally remove or link into > lost+found OST objects that are not referenced by any files on the MDS. > This development is funded by OpenSFS (LU-1267< > https://jira.hpdd.intel.com/browse/LU-1267>) > Single Client Performance Improvements – Single thread per process IO > performance has been improved. This work was discussed in details at LUG< > http://cdn.opensfs.org/wp-content/uploads/2014/04/D1_S6_LustreClientIOPerformanceImprovements.pdf> > (LU-3321) > > Striped Directories -Enables a single directory to be striped across > multiple MDTs to improve single directory performance and scalability. This > is a technology preview of part of the DNE phase 2 work funded by OpenSFS > that will be fully available in a future Lustre release (LU-3531< > https://jira.hpdd.intel.com/browse/LU-3531>) > > Fuller details can be found in the change log< > https://wiki.hpdd.intel.com/display/PUB/Changelog+2.6>, the scope > statement< > https://wiki.hpdd.intel.com/display/PUB/Lustre+2.6+Scope+Statement> < > https://wiki.hpdd.intel.com/display/PUB/Lustre+2.6+Scope+Statement> and > the test matrix< > https://wiki.hpdd.intel.com/display/PUB/Lustre+2.6> > The following are known issues in the Lustre 2.6 Release: > > LU-5057 - A rare race > condition can lead to an LASSERT when unmounting an OST. > LU-5150 - Empty access > control lists (ACLs) will be stored for copied files when using a ZFS MDS. > It does not affect ldiskfs MDSes. > LU-4367 - Metadata > performance is affected for unlinking files in a single shared directory in > a manner common with mdtest benchmark pattern. > LU-5420 - DNE configurations > with multiple MDTs sharing a single node with an MGS may hang during MDT > mount or fail to mount an MDT after unclean shutdown. > Work is in progress for these issues. > > NOTE: Users should note that usage of the e2fsprogs-based lfsck has been > deprecated and replaced by "lctl lfsck_start”. Using older e2fsprogs-based > lfsck may lead to filesystem corruption. Once available, it is also > recommended to use e2fsprogs-1.42.11.wc2 (or newer). > Please log any issues found in the issue tracking system< > https://jira.hpdd.intel.com/> > > We would like to thank OpenSFS, for their > contributions towards the cost of the release and also to all Lustre > community members who have contributed to the release with code and/or > testing. > > _______________________________________________ > HPDD-discuss mailing list > HPDD-discuss at lists.01.org > https://lists.01.org/mailman/listinfo/hpdd-discuss > > -------------- next part -------------- An HTML attachment was scrubbed... URL: From morrone2 at llnl.gov Tue Aug 12 02:22:31 2014 From: morrone2 at llnl.gov (Christopher J. Morrone) Date: Mon, 11 Aug 2014 19:22:31 -0700 Subject: [cdwg] Introducing the Lustre Working Group! Message-ID: <53E97A67.8060500@llnl.gov> Hi folks! As I fortold in my previous email on July 30th, the Technical Working Group and the Community Development Working have merged. The resulting working group is named simply the Lustre Working Group, or LWG for short. I made a first pass at a wiki page for the Lustre Working Group here: http://wiki.opensfs.org/Lustre_Working_Group The TWG and CDWG pages are preserved for posterity, but have warnings at the top of the page directing folks to the LWG page. There is a calendar for the new LWG's activities (I reused and renamed the CDWG calendar for this purpose). See the link on the wiki page. There is also new mailing list. You have _NOT_ been automatically subscribed to the new mailing list! If you want to participate in LWG activities, you will need to subscribe to the new mailing list yourself. Please see this page: http://lists.opensfs.org/listinfo.cgi/lwg-opensfs.org The TWG and CDWG mailing lists will soon be disabled, but our intent is to keep the mailing list archives intact. The first meeting of the LWG will occur on Wednesday August 13 at 9am PDT. Details for that meeting and its agenda will be sent in a separate email. One thing we will discuss is whether there would be a better time for the new LWG meetings. The leaders and members of the TWG PACs that oversee the TWG development contracts have served OpenSFS well. We foresee no immediate change to staffing or activities of the TWG PACs, save that they will now occasionally report on their activities to the new LWG. I hope hope to see you all in the new LWG! Chris Morrone From morrone2 at llnl.gov Tue Aug 12 22:56:26 2014 From: morrone2 at llnl.gov (Christopher J. Morrone) Date: Tue, 12 Aug 2014 15:56:26 -0700 Subject: [cdwg] Lustre Working Group Call 2014-08-13 Message-ID: <53EA9B9A.1060709@llnl.gov> Hi everyone, The first official meeting of the Lustre Working Group will be tomorrow, Wednesday, August 13, 2014. The time will be 9AM PDT. Call-in: 866-914-3976 (925-424-8105) Passcode: 786734# Please be aware that this is the last announcement about the LWG that I will send to the TWG and CDWG mailing lists. If you want to participate in the LWG, you will need to sign up for the LWG mailing list yourself (see the LWG page on wiki.opensfs.org for a link to the mailing list). Agenda: * Overview of LWG formation and discuss possible alternate call times * Decide level for support of RHEL7 in Lustre 2.7.0 * Discussion about software quality I would like to keep the first two agenda items to under 15 minutes and leave the rest of the time for the software quality discussion. For the third agenda item, I will be quickly presenting and then leading discussion about the following slides, so please download them and be ready to follow along: http://wiki.opensfs.org/images/f/f4/Renewed_Focus_Lustre_Software_Structural_Quality_v2.pdf I look forward to talking with you tomorrow! Chris