From hamilton5 at llnl.gov Tue Jan 3 19:54:25 2012 From: hamilton5 at llnl.gov (Hamilton, Pam) Date: Tue, 3 Jan 2012 11:54:25 -0800 Subject: [cdwg] OpenSFS Community Development WG call tomorrow, 1/4, at 9am Pacific Message-ID: When: Wednesday, January 04, 2012 9:00 AM-10:00 AM (UTC-08:00) Pacific Time (US & Canada). Where: Call-in: 866-914-3976 (925-424-8105) Passcode: 534986# Note: The GMT offset above does not reflect daylight saving time adjustments. *~*~*~*~*~*~*~*~*~* Hi all, We will have an OpenSFS Community Development Working Group conference call on 1/4 at 9am Pacific. The main topic for the call will be to review the first quarterly report from Whamcloud for the Lustre Development Community Tree Maintenance contract. Attached are the notes from our last call to refresh your memories regarding our discussions of the report format. Regards, Pam -------------- next part -------------- An HTML attachment was scrubbed... URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: not available Type: text/calendar Size: 2385 bytes Desc: not available URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: CDWG 12.21_V2.doc Type: application/msword Size: 34816 bytes Desc: CDWG 12.21_V2.doc URL: From hamilton5 at llnl.gov Wed Jan 4 05:21:15 2012 From: hamilton5 at llnl.gov (Hamilton, Pam) Date: Tue, 3 Jan 2012 21:21:15 -0800 Subject: [cdwg] OpenSFS Community Tree Q4 2011 report Message-ID: Hi all, Attached is the OpenSFS Community Tree Q4 2011 report prepared by Whamcloud for the work accomplished against the OpenSFS Lustre Development Community Tree Maintenance contract. We'll be discussing its contents on the 9am call. Regards, Pam ___________________________________ Pam Hamilton Lawrence Livermore National Lab P.O. Box 808, L-556 Livermore, CA  94551-9900 E-Mail:  pgh at llnl.gov Phone:  925-423-1332          Fax:  925-423-8719 -------------- next part -------------- A non-text attachment was scrubbed... Name: OpenSFS-Whamcloud Tree Report - Q4 2011.pdf Type: application/pdf Size: 376504 bytes Desc: OpenSFS-Whamcloud Tree Report - Q4 2011.pdf URL: From pjones at whamcloud.com Fri Jan 6 22:32:18 2012 From: pjones at whamcloud.com (Peter Jones) Date: Fri, 06 Jan 2012 14:32:18 -0800 Subject: [cdwg] Lustre 2.2 update - January 6th 2012 Message-ID: <4F077672.5090001@whamcloud.com> Hi there Here is an update on the Lustre 2.2 release. Features Landed To Date ====================== - Asynchronous glimpse (LU925) - Client parallel checksums (LU884) - Imperative Recovery (LU580) - Large xattrs (a.k.a "Wide Striping" Note: the core Lustre changes have landed but some additional userspace and e2fsprogs changes are needed before this functionality can be utilized) (LU80) - Multi threaded ptlrpcd - OSD API (LU909) - Parallel directory operations (pDirOps) (LU50) - Quota protocol/code improvements (LU847) - SLES11 server patches (LU335)(Note: landed to tree but not built into automated testing) - Statahead (LU389) Minor Enhancements ================== -Several more of the patches to provide support for Fedora 15 Lustre clients have been landed; the remaining four patches are undergoing testing\inspections and should be ready to land shortly (LU506) -RHEL 6.2 server\client support in progress (LU751) Testing ======= -Ongoing effort has been put into extending the degree of test automation; recovery testing is believed to be ready to roll out and we will make this switch over after the feature freeze -After the feature freeze we expect to create a new tag and test; the focus going forward will be to find and fix any bugs that would be a blocker to 2.2 going GA Feature Candidates ================== The targeted release date remains March 2012. At the time of writing there is still some final testing taking place on patches relating to some of the below feature candidates and we may see one or more of them land before the feature freeze. - Data Version Per File (LU827) - Layout Lock (LU169) - Manage Dirty Flag for HSM (LU941) - Mds-survey (LU593/LU633) Those that are not ready in time will likely be in the 2.3 release scheduled for September 2012. We plan to create a new tag on Monday and will start an intensive period of testing and bugfixing. We will continue to provide periodic updates on our progress on this release. In the meantime, you can always see the landings as they happen at http://git.whamcloud.com/?p=fs/lustre-release.git;a=shortlog;h=refs/heads/master and follow the patch reviews and testing at http://review.whamcloud.com/#q,status:open+project:fs/lustre-release+branch:master,n,z Regards Peter -- Peter Jones Whamcloud, Inc. www.whamcloud.com -------------- next part -------------- An HTML attachment was scrubbed... URL: From shay at opensfs.org Mon Jan 9 23:48:18 2012 From: shay at opensfs.org (Shay Seager) Date: Mon, 9 Jan 2012 15:48:18 -0800 Subject: [cdwg] LUG 2012 Registration is open Message-ID: Hello! Happy New Year! We here at OpenSFS hope that you have had a wonderful start to your 2011. OpenSFS would like to invite you to enjoy spring in beautiful Austin Tx - LUG 2012 will be held at the Hyatt Regency Austin, Downtown on the Lake, Monday, April 23rd 2012 through Wednesday, April 25th 2012. This 2 1/2 day event is the primary venue for discussion and seminars on open source parallel file system technologies with a unique focus on the Lustre™ parallel file system. To Register please follow this link http://www.opensfs.org/lug/registration LUG is a user-led event whose organizing committee is made up of representatives from Indiana University (IU), Naval Research Laboratory (NRL), Oak Ridge National Laboratory (ORNL), Sandia National Laboratories (SNL), Lawrence Livermore National Laboratory (LLNL), and Texas Advanced Computing Center (TACC). Feel free to contact me with any questions. Best, Shay - - - Shay Seager Open SFS Secretary www.opensfs.org (925) 290-7641 shay at opensfs.org -------------- next part -------------- An HTML attachment was scrubbed... URL: From hamilton5 at llnl.gov Tue Jan 17 15:09:33 2012 From: hamilton5 at llnl.gov (Hamilton, Pam) Date: Tue, 17 Jan 2012 07:09:33 -0800 Subject: [cdwg] OpenSFS Community Development WG call tomorrow, 1/18, at 9am Pacific Message-ID: When: Wednesday, January 18, 2012 9:00 AM-10:00 AM (UTC-08:00) Pacific Time (US & Canada). Where: Call-in: 866-914-3976 (925-424-8105) Passcode: 534986# Note: The GMT offset above does not reflect daylight saving time adjustments. *~*~*~*~*~*~*~*~*~* Hi all, We will have an OpenSFS Community Development Working Group conference call on 1/18 at 9am Pacific. Attached is an updated version of the first quarterly report from Whamcloud for the Lustre Development Community Tree Maintenance contract. This version includes an appendix with a timeline for Luster v2.2. We are now past the freeze date for 2.2 so we can discuss what features made the cut. Regards, Pam -------------- next part -------------- An HTML attachment was scrubbed... URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: not available Type: text/calendar Size: 2412 bytes Desc: not available URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: OpenSFS-Whamcloud Tree Report - Q4 2011.pdf Type: application/pdf Size: 380566 bytes Desc: OpenSFS-Whamcloud Tree Report - Q4 2011.pdf URL: From hamilton5 at llnl.gov Wed Jan 18 18:04:20 2012 From: hamilton5 at llnl.gov (Hamilton, Pam) Date: Wed, 18 Jan 2012 10:04:20 -0800 Subject: [cdwg] Canceled: OpenSFS Community Development WG call Message-ID: When: Wednesday, February 01, 2012 9:00 AM-10:00 AM (UTC-08:00) Pacific Time (US & Canada). Where: Call-in: 866-914-3976 (925-424-8105) Passcode: 534986# Note: The GMT offset above does not reflect daylight saving time adjustments. *~*~*~*~*~*~*~*~*~* Hi all, The call on February 1st is cancelled. I will send out a call for agenda items prior to the next scheduled call which is February 15th. Regards, Pam -------------- next part -------------- An HTML attachment was scrubbed... URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: not available Type: text/calendar Size: 2684 bytes Desc: not available URL: From pjones at whamcloud.com Fri Jan 20 16:28:15 2012 From: pjones at whamcloud.com (Peter Jones) Date: Fri, 20 Jan 2012 08:28:15 -0800 Subject: [cdwg] Lustre 2.2 update - January 20th 2012 Message-ID: <4F19961F.8060108@whamcloud.com> Hi there Here is an update on the Lustre 2.2 release. Features Landed =============== - Asynchronous glimpse (LU925) - Client parallel checksums (LU884) - Imperative Recovery (LU580) - Large xattrs (a.k.a "Wide Striping" Note: the core Lustre changes have landed but some additional userspace and e2fsprogs changes are needed before this functionality can be utilized) (LU80) - Mds-survey (LU593/LU633) - Multi threaded ptlrpcd - OSD API (LU909) - Parallel directory operations (pDirOps) (LU50) - Quota protocol/code improvements (LU847) - SLES11 server patches (LU335)(Note: landed to tree but not built into automated testing) - Statahead (LU389) Minor Enhancements ================== -One patch remains to complete FC15 client support; it should land by the next report (LU506) -Landing the RHEL 6.2 server\client support has taken a little longer than expected due to complexities with external ofed builds and autotest; we expect this to be resolved shortly (LU751) Testing ======= Testing has been taking place on the 2.1.54 tag; I have created a JIRA Filter "Lustre 2.2 Blockers" for anyone interested in seeing the issues that have been reported to date; you may need to go into your filter options (Manage Filters - My) to find it We will continue to provide periodic updates on our progress on this release. In the meantime, you can always see the landings as they happen at http://git.whamcloud.com/?p=fs/lustre-release.git;a=shortlog;h=refs/heads/master and follow the patch reviews and testing at http://review.whamcloud.com/#q,status:open+project:fs/lustre-release+branch:master,n,z Regards Peter -- Peter Jones Whamcloud, Inc. www.whamcloud.com -------------- next part -------------- An HTML attachment was scrubbed... URL: From hamilton5 at llnl.gov Mon Jan 23 23:17:51 2012 From: hamilton5 at llnl.gov (Hamilton, Pam) Date: Mon, 23 Jan 2012 15:17:51 -0800 Subject: [cdwg] Lustre Development Community Tree Maintenance Q4 2011 report Message-ID: Hi all, Attached is the final version of the first quarterly report from Whamcloud for the Lustre Development Community Tree Maintenance contract. Please let me know if you have any questions/comments. Regards, Pam ___________________________________ Pam Hamilton Lawrence Livermore National Lab P.O. Box 808, L-556 Livermore, CA  94551-9900 E-Mail:  pgh at llnl.gov Phone:  925-423-1332          Fax:  925-423-8719 -------------- next part -------------- A non-text attachment was scrubbed... Name: OpenSFS-Whamcloud Tree Report - Q4 2011 FINAL.pdf Type: application/pdf Size: 380539 bytes Desc: OpenSFS-Whamcloud Tree Report - Q4 2011 FINAL.pdf URL: From peter_bojanic at xyratex.com Tue Jan 24 00:01:26 2012 From: peter_bojanic at xyratex.com (Peter Bojanic) Date: Mon, 23 Jan 2012 20:01:26 -0400 Subject: [cdwg] Lustre Development Community Tree Maintenance Q4 2011 report In-Reply-To: References: Message-ID: <123569EC-B0A5-45D5-A06A-05B058080769@xyratex.com> Hi Pam, Is there any kind of test or other quality report that shows: - defect density before and over the course of development (defects injected; latent defects discovered; defects removed) - tests executed; number of tests passed vs. failed per test case - what is the release criteria for 2.2, particularly with respect to quality attributes (e.g. zero blocker or critical defects) - manifest and description of new regression test cases added corresponding to new features This way OpenSFS can monitor not only the success landing of deliverables but also the overall health of the release branch. Many thanks, Bojanic On 2012-01-23, at 19:17 , Hamilton, Pam wrote: > Hi all, > > Attached is the final version of the first quarterly report from Whamcloud for the Lustre Development Community Tree Maintenance contract. Please let me know if you have any questions/comments. > > Regards, > Pam > > ___________________________________ > Pam Hamilton > Lawrence Livermore National Lab > P.O. Box 808, L-556 > Livermore, CA 94551-9900 > E-Mail: pgh at llnl.gov > Phone: 925-423-1332 Fax: 925-423-8719 > > > _______________________________________________ > cdwg mailing list > cdwg at lists.opensfs.org > http://lists.opensfs.org/listinfo.cgi/cdwg-opensfs.org From pjones at whamcloud.com Wed Jan 25 12:16:47 2012 From: pjones at whamcloud.com (Peter Jones) Date: Wed, 25 Jan 2012 04:16:47 -0800 Subject: [cdwg] Lustre Development Community Tree Maintenance Q4 2011 report In-Reply-To: <123569EC-B0A5-45D5-A06A-05B058080769@xyratex.com> References: <123569EC-B0A5-45D5-A06A-05B058080769@xyratex.com> Message-ID: <4F1FF2AF.6050302@whamcloud.com> Hi Peter Thanks for your feedback. I agree that having a way to monitor what tests are being run and the outcome over time is a very useful way of tracking quality over time. To that end Whamcloud has been working on dynamic reports that create a visual comparison of test results over time. The kinks are still being worked through, but you can see the latest reports at https://maloo.whamcloud.com/reports. The release criteria for 2.2 would be to achieve zero blockers. For anyone interested in tracking the number of blockers for 2.2, there is a public filter in JIRA which can accessed through the Manage Filters link on the bottom right of the JIRA dashboard and then selecting Popular from the options on the left. You can run it from there or if you highlight the star then the filter will be added to your dashboard so that you get a dynamic update whenever you use JIRA. Details relating to the features are probably out of scope for reporting in this contract, but I agree that details of the tests that relate to the features might be of interest. I'll aim to provide this information on my next biweekly update. Regards Peter On 12-01-23 4:01 PM, Peter Bojanic wrote: > Hi Pam, > > Is there any kind of test or other quality report that shows: > - defect density before and over the course of development (defects injected; latent defects discovered; defects removed) > - tests executed; number of tests passed vs. failed per test case > - what is the release criteria for 2.2, particularly with respect to quality attributes (e.g. zero blocker or critical defects) > - manifest and description of new regression test cases added corresponding to new features > > This way OpenSFS can monitor not only the success landing of deliverables but also the overall health of the release branch. > > Many thanks, > Bojanic > > On 2012-01-23, at 19:17 , Hamilton, Pam wrote: > >> Hi all, >> >> Attached is the final version of the first quarterly report from Whamcloud for the Lustre Development Community Tree Maintenance contract. Please let me know if you have any questions/comments. >> >> Regards, >> Pam >> >> ___________________________________ >> Pam Hamilton >> Lawrence Livermore National Lab >> P.O. Box 808, L-556 >> Livermore, CA 94551-9900 >> E-Mail: pgh at llnl.gov >> Phone: 925-423-1332 Fax: 925-423-8719 >> >> >> _______________________________________________ >> cdwg mailing list >> cdwg at lists.opensfs.org >> http://lists.opensfs.org/listinfo.cgi/cdwg-opensfs.org > _______________________________________________ > cdwg mailing list > cdwg at lists.opensfs.org > http://lists.opensfs.org/listinfo.cgi/cdwg-opensfs.org -- Peter Jones Whamcloud, Inc. www.whamcloud.com From peter_bojanic at xyratex.com Wed Jan 25 12:22:34 2012 From: peter_bojanic at xyratex.com (Peter Bojanic) Date: Wed, 25 Jan 2012 08:22:34 -0400 Subject: [cdwg] Lustre Development Community Tree Maintenance Q4 2011 report In-Reply-To: <4F1FF2AF.6050302@whamcloud.com> References: <123569EC-B0A5-45D5-A06A-05B058080769@xyratex.com> <4F1FF2AF.6050302@whamcloud.com> Message-ID: <6F40421F-FF04-4564-98EF-90F9D7F7A0B9@xyratex.com> Thanks, pjones. I guess what I'm subtly suggesting is that quality metrics and release criteria definition should be part of the on-going reporting related to the Lustre Development Community Tree Maintenance contract with OpenSFS. The roadmap and landing metrics are of course very useful and quality metrics included in the will round out the picture. Cheers, Bojanic On 2012-01-25, at 08:16 , Peter Jones wrote: > Hi Peter > > Thanks for your feedback. > > I agree that having a way to monitor what tests are being run and the outcome over time is a very useful way of tracking quality over time. To that end Whamcloud has been working on dynamic reports that create a visual comparison of test results over time. The kinks are still being worked through, but you can see the latest reports at https://maloo.whamcloud.com/reports. > > The release criteria for 2.2 would be to achieve zero blockers. For anyone interested in tracking the number of blockers for 2.2, there is a public filter in JIRA which can accessed through the Manage Filters link on the bottom right of the JIRA dashboard and then selecting Popular from the options on the left. You can run it from there or if you highlight the star then the filter will be added to your dashboard so that you get a dynamic update whenever you use JIRA. > > Details relating to the features are probably out of scope for reporting in this contract, but I agree that details of the tests that relate to the features might be of interest. I'll aim to provide this information on my next biweekly update. > > Regards > > Peter > > On 12-01-23 4:01 PM, Peter Bojanic wrote: >> Hi Pam, >> >> Is there any kind of test or other quality report that shows: >> - defect density before and over the course of development (defects injected; latent defects discovered; defects removed) >> - tests executed; number of tests passed vs. failed per test case >> - what is the release criteria for 2.2, particularly with respect to quality attributes (e.g. zero blocker or critical defects) >> - manifest and description of new regression test cases added corresponding to new features >> >> This way OpenSFS can monitor not only the success landing of deliverables but also the overall health of the release branch. >> >> Many thanks, >> Bojanic >> >> On 2012-01-23, at 19:17 , Hamilton, Pam wrote: >> >>> Hi all, >>> >>> Attached is the final version of the first quarterly report from Whamcloud for the Lustre Development Community Tree Maintenance contract. Please let me know if you have any questions/comments. >>> >>> Regards, >>> Pam >>> >>> ___________________________________ >>> Pam Hamilton >>> Lawrence Livermore National Lab >>> P.O. Box 808, L-556 >>> Livermore, CA 94551-9900 >>> E-Mail: pgh at llnl.gov >>> Phone: 925-423-1332 Fax: 925-423-8719 >>> >>> >>> _______________________________________________ >>> cdwg mailing list >>> cdwg at lists.opensfs.org >>> http://lists.opensfs.org/listinfo.cgi/cdwg-opensfs.org >> _______________________________________________ >> cdwg mailing list >> cdwg at lists.opensfs.org >> http://lists.opensfs.org/listinfo.cgi/cdwg-opensfs.org > > -- > Peter Jones > Whamcloud, Inc. > www.whamcloud.com > > _______________________________________________ > cdwg mailing list > cdwg at lists.opensfs.org > http://lists.opensfs.org/listinfo.cgi/cdwg-opensfs.org From pjones at whamcloud.com Wed Jan 25 12:30:31 2012 From: pjones at whamcloud.com (Peter Jones) Date: Wed, 25 Jan 2012 04:30:31 -0800 Subject: [cdwg] Lustre Development Community Tree Maintenance Q4 2011 report In-Reply-To: <6F40421F-FF04-4564-98EF-90F9D7F7A0B9@xyratex.com> References: <123569EC-B0A5-45D5-A06A-05B058080769@xyratex.com> <4F1FF2AF.6050302@whamcloud.com> <6F40421F-FF04-4564-98EF-90F9D7F7A0B9@xyratex.com> Message-ID: <4F1FF5E7.3020702@whamcloud.com> Hi Peter Yes, I can certainly incorporate these elements into future quarterly reports. Regards Peter On 12-01-25 4:22 AM, Peter Bojanic wrote: > Thanks, pjones. > > I guess what I'm subtly suggesting is that quality metrics and release criteria definition should be part of the on-going reporting related to the Lustre Development Community Tree Maintenance contract with OpenSFS. The roadmap and landing metrics are of course very useful and quality metrics included in the will round out the picture. > > Cheers, > Bojanic > > On 2012-01-25, at 08:16 , Peter Jones wrote: > >> Hi Peter >> >> Thanks for your feedback. >> >> I agree that having a way to monitor what tests are being run and the outcome over time is a very useful way of tracking quality over time. To that end Whamcloud has been working on dynamic reports that create a visual comparison of test results over time. The kinks are still being worked through, but you can see the latest reports at https://maloo.whamcloud.com/reports. >> >> The release criteria for 2.2 would be to achieve zero blockers. For anyone interested in tracking the number of blockers for 2.2, there is a public filter in JIRA which can accessed through the Manage Filters link on the bottom right of the JIRA dashboard and then selecting Popular from the options on the left. You can run it from there or if you highlight the star then the filter will be added to your dashboard so that you get a dynamic update whenever you use JIRA. >> >> Details relating to the features are probably out of scope for reporting in this contract, but I agree that details of the tests that relate to the features might be of interest. I'll aim to provide this information on my next biweekly update. >> >> Regards >> >> Peter >> >> On 12-01-23 4:01 PM, Peter Bojanic wrote: >>> Hi Pam, >>> >>> Is there any kind of test or other quality report that shows: >>> - defect density before and over the course of development (defects injected; latent defects discovered; defects removed) >>> - tests executed; number of tests passed vs. failed per test case >>> - what is the release criteria for 2.2, particularly with respect to quality attributes (e.g. zero blocker or critical defects) >>> - manifest and description of new regression test cases added corresponding to new features >>> >>> This way OpenSFS can monitor not only the success landing of deliverables but also the overall health of the release branch. >>> >>> Many thanks, >>> Bojanic >>> >>> On 2012-01-23, at 19:17 , Hamilton, Pam wrote: >>> >>>> Hi all, >>>> >>>> Attached is the final version of the first quarterly report from Whamcloud for the Lustre Development Community Tree Maintenance contract. Please let me know if you have any questions/comments. >>>> >>>> Regards, >>>> Pam >>>> >>>> ___________________________________ >>>> Pam Hamilton >>>> Lawrence Livermore National Lab >>>> P.O. Box 808, L-556 >>>> Livermore, CA 94551-9900 >>>> E-Mail: pgh at llnl.gov >>>> Phone: 925-423-1332 Fax: 925-423-8719 >>>> >>>> >>>> _______________________________________________ >>>> cdwg mailing list >>>> cdwg at lists.opensfs.org >>>> http://lists.opensfs.org/listinfo.cgi/cdwg-opensfs.org >>> _______________________________________________ >>> cdwg mailing list >>> cdwg at lists.opensfs.org >>> http://lists.opensfs.org/listinfo.cgi/cdwg-opensfs.org >> -- >> Peter Jones >> Whamcloud, Inc. >> www.whamcloud.com >> >> _______________________________________________ >> cdwg mailing list >> cdwg at lists.opensfs.org >> http://lists.opensfs.org/listinfo.cgi/cdwg-opensfs.org -- Peter Jones Whamcloud, Inc. www.whamcloud.com