[11:54:12] <pradyunsg> https://github.com/pypa/wheel/blob/publicapi/src/wheel/wheelfile.py#L231 -- IIUC, we're basically guaranteed to have UTF-8 files only in dist-info (as a result of implementations).
[11:56:05] <agronholm> I'd rather not do such decoding in the wheelfile class
[11:56:22] <agronholm> it's trivial to do afterwards and might limit the uses of wheelfile
[11:57:43] <pradyunsg> regarding read_file -- dholth had said that "I think you can count on random access to the files in the .dist-info directory and encourage sequential access to the rest of the data.".
[11:59:42] <agronholm> well, all I can say that after a few rounds of comments from packaging library authors/authorities, this is what I came up with
[12:00:09] <agronholm> if you find something essential to be missing from the API, I will add it
[12:00:27] <agronholm> practical implementations should be able to point out any problems with the design
[12:03:26] <pradyunsg> If I understand correctly, dholth's comment was a result of the discussion at https://discuss.python.org/t/3810, with the intent being to be able to make minimal changes to these APIs if we make a change like that (i.e. compression for the contents of .data).
[12:04:22] <pradyunsg> I think that specific design choice comes down to how much you wanna anticipate the future and accommodate for it. ;)
[12:06:30] <agronholm> don't you think my API could accommodate compression?
[12:08:35] <pradyunsg> how would read_file work if there's an additional layer of multi-file compression (tar.gz-like) for files in .data?
[12:09:38] <agronholm> the WheelFile class would have to know about it, wouldn't it?
[12:10:13] <agronholm> right, you mean the sequential-only nature of tar files
[12:10:45] <agronholm> I have not heard of any plans to move to such a format
[12:11:26] <agronholm> the only suggested change I've heard is (zip or 7zip) inside a zip
[12:12:06] <agronholm> (which I am also against, for the record)
[12:12:59] <agronholm> LZMA support would be trivial to add to wheel, if the PyPA decides that
[12:13:21] <pradyunsg> there's certainly no plans AFAIK, but it was discussed in the aforementioned thread. :)
[12:13:42] <agronholm> yeeah...let's not cross that bridge for now
[15:13:35] <devesh> pradyusng: May I DM you? Had some questions about the triage bit.
[16:40:20] <dstufft> agronholm: pradyunsg FWIW I do want to do the compressed container inside of a zip thing at some point, I just haven't gotten the spare cycles tgo push on it yet
[16:42:38] <dstufft> whether the interior xontainer is a zip or a tarfile doesn't really matter, non sequential access to it is probably going to be slow
[16:45:50] <dstufft> just adding LZMA support to wheel file isn't nearly as good, becasuse that compression operates on a file by file basis, which eliminates a large chunk of potential compressionablity
[19:18:46] <travis-ci> pypa/pip#17510 (master - 89d8cba : Chris Hunt): The build passed.