From morrone2 at llnl.gov Tue Jul 1 22:00:23 2014 From: morrone2 at llnl.gov (Christopher J. Morrone) Date: Tue, 01 Jul 2014 15:00:23 -0700 Subject: [cdwg] OpenSFS CDWG Call Message-ID: <53B32F77.5020603@llnl.gov> Hi all, This is a reminder that we will have a Community Development Working Group (CDWG) call on Wednesday, July 2, at 9:00am PDT. Agenda: * Lustre 2.6.0 status * Open Discussion Call-in: 866-914-3976 (925-424-8105) Passcode: 786734# Regards, Chris From morrone2 at llnl.gov Fri Jul 11 03:01:25 2014 From: morrone2 at llnl.gov (Christopher J. Morrone) Date: Thu, 10 Jul 2014 20:01:25 -0700 Subject: [cdwg] asciidoc Message-ID: <53BF5385.7080000@llnl.gov> Hi folks, On the last CDWG call we discussed documentation a bit, and I mentioned the asciidoc tool. Here is a link: http://www.methods.co.nz/asciidoc/ Justin asked if it could generate man pages, and I guessed that it did not. Happily, I was wrong! It does in fact support man pages as well: http://www.methods.co.nz/asciidoc/chunked/ch24.html I first learned about asciidoc from the 0mq project: http://zeromq.org/ Their documents use that, here is an example: http://zguide.zeromq.org/page:all Notice the diagrams. Those are converted to SVG format from ascii art that is embedded right in the asciidoc document. To perform the conversion they use asciitosvg: https://bitbucket.org/dhobsd/asciitosvg Another program with a similar ascii-art-to-graphics-format goal is call ditaa. It is written in java, but its downside is that it directly generates png files rather than the much more desirable vector graphics files. http://ditaa.sourceforge.net/ Chris From morrone2 at llnl.gov Tue Jul 15 20:11:59 2014 From: morrone2 at llnl.gov (Christopher J. Morrone) Date: Tue, 15 Jul 2014 13:11:59 -0700 Subject: [cdwg] OpenSFS CDWG Call Message-ID: <53C58B0F.9000306@llnl.gov> Hi all, This is a reminder that we will have a Community Development Working Group (CDWG) call on Wednesday, July 16, at 9:00am PDT. Agenda: * Lustre 2.6.0 status * Lustre 2.7.0 planning * Open Discussion Call-in: 866-914-3976 (925-424-8105) Passcode: 786734# Regards, Chris From morrone2 at llnl.gov Tue Jul 29 23:49:24 2014 From: morrone2 at llnl.gov (Christopher J. Morrone) Date: Tue, 29 Jul 2014 16:49:24 -0700 Subject: [cdwg] OpenSFS CDWG Call Message-ID: <53D83304.4030507@llnl.gov> Hi all, This is a reminder that we will have a Community Development Working Group (CDWG) call on Wednesday, July 30, at 9:00am PDT. Agenda: * Lustre 2.6.0 status * Shifting OpenSFS's Lustre focus from adding new features to making Lustre maintable * One Lustre Working Group To Rule Them All Call-in: 866-914-3976 (925-424-8105) Passcode: 786734# Regards, Chris From aurelien.degremont at cea.fr Wed Jul 30 14:04:06 2014 From: aurelien.degremont at cea.fr (DEGREMONT Aurelien) Date: Wed, 30 Jul 2014 16:04:06 +0200 Subject: [cdwg] OpenSFS CDWG Call In-Reply-To: <53D83304.4030507@llnl.gov> References: <53D83304.4030507@llnl.gov> Message-ID: <53D8FB56.1020405@cea.fr> Hello I cannot attend the meetings but I'm interested in following what's said there. Is there some minutes somewhere? (or some recordings I can listen to during my sport jogging ;)) Aurélien Le 30/07/2014 01:49, Christopher J. Morrone a écrit : > Hi all, > > This is a reminder that we will have a Community Development Working > Group (CDWG) call on Wednesday, July 30, at 9:00am PDT. > > Agenda: > > * Lustre 2.6.0 status > * Shifting OpenSFS's Lustre focus from adding new features to making > Lustre maintable > * One Lustre Working Group To Rule Them All > > Call-in: 866-914-3976 (925-424-8105) Passcode: 786734# > > Regards, > Chris > > _______________________________________________ > cdwg mailing list > cdwg at lists.opensfs.org > http://lists.opensfs.org/listinfo.cgi/cdwg-opensfs.org From morrone2 at llnl.gov Wed Jul 30 18:35:56 2014 From: morrone2 at llnl.gov (Christopher J. Morrone) Date: Wed, 30 Jul 2014 11:35:56 -0700 Subject: [cdwg] OpenSFS CDWG Call In-Reply-To: <53D8FB56.1020405@cea.fr> References: <53D83304.4030507@llnl.gov> <53D8FB56.1020405@cea.fr> Message-ID: <53D93B0C.2060801@llnl.gov> Minutes are almost always available under the CDWG's page at http://wiki.opensfs.org. I don't always get them out immediately, but usually within a few days. We do not currently have recordings. There's been a new development on the "one working group" topic that we did not cover in the call this morning. I'll give a little more info on the list later today. Chris On 07/30/2014 07:04 AM, DEGREMONT Aurelien wrote: > Hello > > I cannot attend the meetings but I'm interested in following what's said > there. > Is there some minutes somewhere? (or some recordings I can listen to > during my sport jogging ;)) > > Aurélien > > Le 30/07/2014 01:49, Christopher J. Morrone a écrit : >> Hi all, >> >> This is a reminder that we will have a Community Development Working >> Group (CDWG) call on Wednesday, July 30, at 9:00am PDT. >> >> Agenda: >> >> * Lustre 2.6.0 status >> * Shifting OpenSFS's Lustre focus from adding new features to making >> Lustre maintable >> * One Lustre Working Group To Rule Them All >> >> Call-in: 866-914-3976 (925-424-8105) Passcode: 786734# >> >> Regards, >> Chris >> >> _______________________________________________ >> cdwg mailing list >> cdwg at lists.opensfs.org >> http://lists.opensfs.org/listinfo.cgi/cdwg-opensfs.org > > From spitzcor at cray.com Wed Jul 30 18:45:22 2014 From: spitzcor at cray.com (Cory Spitz) Date: Wed, 30 Jul 2014 18:45:22 +0000 Subject: [cdwg] Combo working group logistics Message-ID: If we go with a combo CDWG+TWG, what will we call the group? Will we change the mission(s) at all? I'd suggest that we keep the 'community development' as it can/does cover new features (and maybe technology). The we simply just dissolve the TWG in name only. Thoughts on that? Also, I think that marketing the switch and carrying out all the logistics with the web pages and mailing address might take a while. It would be nice to wrap it up around LAD'14 so that we could more easily get the word out. -Cory -------------- next part -------------- An HTML attachment was scrubbed... URL: From morrone2 at llnl.gov Wed Jul 30 20:44:01 2014 From: morrone2 at llnl.gov (Christopher J. Morrone) Date: Wed, 30 Jul 2014 13:44:01 -0700 Subject: [cdwg] Combo working group logistics In-Reply-To: References: Message-ID: <53D95911.3010005@llnl.gov> On 07/30/2014 11:45 AM, Cory Spitz wrote: > If we go with a combo CDWG+TWG, what will we call the group? Will we > change the mission(s) at all? I'd suggest that we keep the 'community > development' as it can/does cover new features (and maybe technology). > The we simply just dissolve the TWG in name only. Thoughts on that? Well, I was a little worried about bike shedding, but since you asked...:) I'd like to change the name. Too many folks have seemed to confuse the "Community Development" group's purpose to be to be a non-technical group that focuses on Development of a Community. It is, in fact, the a group with the goal to coordinate the software development efforts of the community. Here are my suggestions: Lustre Working Group Lustre Development Working Group Lustre Software Development Working Group. The new group will take a more holistic view of the Lustre software development life cycle. Features will be treated as another part of software development. > Also, I think that marketing the switch and carrying out all the > logistics with the web pages and mailing address might take a while. It > would be nice to wrap it up around LAD'14 so that we could more easily > get the word out. I don't think that will be too much of a problem. I can handle the wiki page, I'll get our web czar to update the opensfs.org pages. I would like to make sign up to the new group's mailing list voluntary. I will make announcements on the old lists that they are going away, and convert them to read-only (for the archives). If I don't still know the correct passwords to OpenSFS's dreamhost account, I will engage VTM folks to get the appropriate changes made. Chris From morrone2 at llnl.gov Thu Jul 31 00:00:44 2014 From: morrone2 at llnl.gov (Christopher J. Morrone) Date: Wed, 30 Jul 2014 17:00:44 -0700 Subject: [cdwg] The CDWG and TWG are merging! Message-ID: <53D9872C.2010402@llnl.gov> Hello CDWG and TWG members, Jason Hill and I received official approval from the OpenSFS Board today: the CDWG and TWG will be merging into a single working group. This working group will take a more holistic view of the Lustre software development lifecycle. Most obviously, a major goal of the new working group will be to better incorporate new feature planning into the overall software development planning, allowing us to better weigh new features versus other necessary development activities. So first, we need a name for the working group. We have a discussion thread about that topic already started on the CDWG mailing list, so come and voice your opinion soon if you have one. The most obvious changes you can expect to see in the near term are as follows. 1) New email mailing list created. An announcement about the new list will be sent to these lists, and these two lists will stop accepting new messages (the archives will be preserved). Most likely you will need to actively register yourself for the new list. 2) New wiki.opensfs.org pages for the WG will be created, merging information from the current groups. 3) The www.opensfs.org web pages will be updated to reflect the new WG. I look forward to continuing to participate in Lustre software development with all of you under this new and improved working group structure. Chris From peter.a.jones at intel.com Thu Jul 31 01:03:22 2014 From: peter.a.jones at intel.com (Jones, Peter A) Date: Thu, 31 Jul 2014 01:03:22 +0000 Subject: [cdwg] Lustre 2.6.0 released Message-ID: We are pleased to announce that the Lustre 2.6.0 Release has been declared GA and is available for download . You can also grab the source from git This major release includes new features: MDT-OST Consistency Check and Repair (LFSCK Phase 2)- Allows the MDS to verify the consistency of a Lustre filesystem while it is mounted and in use. The latest enhancements are to check and repair the validity of OST objects of regular files and to identify and optionally remove or link into lost+found OST objects that are not referenced by any files on the MDS. This development is funded by OpenSFS (LU-1267) Single Client Performance Improvements – Single thread per process IO performance has been improved. This work was discussed in details at LUG (LU-3321) Striped Directories -Enables a single directory to be striped across multiple MDTs to improve single directory performance and scalability. This is a technology preview of part of the DNE phase 2 work funded by OpenSFS that will be fully available in a future Lustre release (LU-3531) Fuller details can be found in the change log, the scope statement and the test matrix The following are known issues in the Lustre 2.6 Release: LU-5057 - A rare race condition can lead to an LASSERT when unmounting an OST. LU-5150 - Empty access control lists (ACLs) will be stored for copied files when using a ZFS MDS. It does not affect ldiskfs MDSes. LU-4367 - Metadata performance is affected for unlinking files in a single shared directory in a manner common with mdtest benchmark pattern. LU-5420 - DNE configurations with multiple MDTs sharing a single node with an MGS may hang during MDT mount or fail to mount an MDT after unclean shutdown. Work is in progress for these issues. NOTE: Users should note that usage of the e2fsprogs-based lfsck has been deprecated and replaced by "lctl lfsck_start”. Using older e2fsprogs-based lfsck may lead to filesystem corruption. Once available, it is also recommended to use e2fsprogs-1.42.11.wc2 (or newer). Please log any issues found in the issue tracking system We would like to thank OpenSFS, for their contributions towards the cost of the release and also to all Lustre community members who have contributed to the release with code and/or testing.