[Twg] T10 End-to-End Data Integrity HLD

[Nathan Rutman]

On Apr 11, 2012, at 7:03 AM, John Carrier wrote:

> I thought Sun's Merkle tree solution was tied to ZFS.   
That's right.  The ptlrpc change will be flexible enough to describe multiple schemes.
> 
> I don't see any requirement of the backend file system in this doc.  Given the OSD work being done at LLNL to separate the Lustre servers from the details of the backend storage, we will need to add DIX to OSD so that there is a mechanism for passing the protection information between Lustre and the disk file system.  
> 
> In fact, adding OSD support will be required for whatever end-to-end data integrity solution we devise, whether it is T10PI or Sun's Merkle tree or something else.  Otherwise we violate the clean layering OSD will provide. 

This is very true.  I will ask Andrew to look into the current Orion code as well and propose interface changes if needed.

> 
> 
> --jc
> 
> 	
> -----Original Message-----
> From: twg-bounces at lists.opensfs.org [mailto:twg-bounces at lists.opensfs.org] On Behalf Of Christopher J. Morrone
> Sent: Tuesday, April 10, 2012 7:32 PM
> To: Nathan Rutman
> Cc: twg at lists.opensfs.org; Andrew Perepechko
> Subject: Re: [Twg] T10 End-to-End Data Integrity HLD
> 
> How will this work with OSD?
> 
> How does this solution compare to the long standing plan to use merkle 
> trees for end-to-end checksums?
> 
> 
> On 04/10/2012 12:53 PM, Nathan Rutman wrote:
>> Hi all,
>> I'm posting our T10 HLD here for public review.  I'll be talking about this at LUG, but if you want a sneak peak or more detail, read on.
>> 
>> 
> 
> _______________________________________________
> twg mailing list
> twg at lists.opensfs.org
> http://lists.opensfs.org/listinfo.cgi/twg-opensfs.org