Log file Viewer

[00:00:01] <techalchemy> at some point

[00:01:01] <dalley> tl;dr each type of content (RPM, Python, Container, Debian, Ruby, etc.) has a plugin that knows how to parse the metadata for that type and feed it into the pipeline

[00:01:31] <dalley> the pipeline takes the natural keys of the packages in the metadata and compares it against existing packages in the database, and saves new records for unknown ones

[00:02:03] <dalley> then a bunch of database relationships get set up so that it knows what is present in each repo

[00:03:04] <dalley> then artifacts get downloaded (maybe, unless you're using lazy sync, in which case we save a placeholder that stores where that package can be fetched from)

[00:06:20] <dalley> (either way, Pulp expects to be dealing with a URL at this point)

[00:12:12] <dalley> that's the sync pipeline.. each plugin also knows how to turn the set of content in each repo (defined by the database) back into repo metadata, and then that "publication" can be made available through "distributions" which is just a URL at "/pulp/content/..?/..?/.."

[00:15:34] <dalley> and it's served by a live app rather than a set of symlinks files living in a directory served by nginx

[00:39:06] <dalley> that last bit will likely need some caching in order to scale up to high # of requests, but we haven't gotten there yet.

[06:33:11] <travis-ci> pypa/pip#16666 (master - 85ce4df : Pradyun Gedam): The build passed.

[06:33:11] <travis-ci> Change view : https://github.com/pypa/pip/compare/cdeb377a3633...85ce4dfd2c81

[06:33:11] <travis-ci> Build details : https://travis-ci.org/pypa/pip/builds/694525992

[16:49:24] <cooperlees> techalchemy + dalley +1 on lazy download to bandersnatch - but it would need to be part of running a daemon - So would go into banderfront idea I mentioned on your PR

[16:49:45] <cooperlees> dalley: feel free to come annoy asmacdo in #bandersnatch like i do :D

[16:50:46] <dalley> will do - probably best not to spam this channel with our conversations :)

[16:56:11] <cooperlees> On the inverse it's nice for others to see bandersnatch talk

[16:56:20] <cooperlees> But when we get super deep might be better in #bandersnatch

[17:02:16] <travis-ci> pypa/pip#16671 (master - d3ce025 : Paul Moore): The build passed.

[17:02:16] <travis-ci> Change view : https://github.com/pypa/pip/compare/85ce4dfd2c81...d3ce025e8dac

[17:02:16] <travis-ci> Build details : https://travis-ci.org/pypa/pip/builds/694719683

[23:11:25] <travis-ci> pypa/pip#16679 (master - 7a60395 : Pradyun Gedam): The build passed.

[23:11:25] <travis-ci> Change view : https://github.com/pypa/pip/compare/d3ce025e8dac297fe550e2acfa730288d715b6a7...7a60395dbd646401192252c4c2834607ff05fa96

[23:11:25] <travis-ci> Build details : https://travis-ci.org/pypa/pip/builds/694834490