PMXBOT Log file Viewer

Help | Karma | Search:

#pypa-dev logs for Monday the 23rd of February, 2015

(Back to #pypa-dev overview) (Back to channel listing) (Animate logs)
[00:00:11] <ionelmc> r1chardj0n3s: what book?
[00:00:26] <r1chardj0n3s> so, at lev distance 1, only names > 4 characters, there's 6172 hits :/
[00:00:32] <r1chardj0n3s> Head First Python
[00:02:01] <ionelmc> quite weird, they put some packaging examples with the nested evil thing?
[00:05:16] <r1chardj0n3s> nested evil?
[00:06:27] <ionelmc> r1chardj0n3s: the nested list printer
[00:07:19] <r1chardj0n3s> ionelmc: yep, one of the exercises is "make a package and submit it to pypi"
[00:08:25] <Ivo> and they hadnt heard of the test pypi i guess
[00:09:38] <dstufft> did test pypi exist back then?
[00:10:24] <r1chardj0n3s> it did, but the author didn't know about it
[00:11:11] <dstufft> Obviously PyPI is just a really good place to when you want to print nested lists
[00:11:17] <dstufft> to look*
[00:11:17] <r1chardj0n3s> oh yeah
[00:29:30] <r1chardj0n3s> https://pypi.python.org/pypi/urllib5
[00:33:02] <Ivo> well.
[00:33:43] <Ivo> what if i want urllib6
[00:35:19] <Ivo> hey pip2! the future of pip!
[00:36:55] <Ivo> well there are some lost hopes and dreams
[00:36:57] <Ivo> https://github.com/osupython/pip2/blob/develop/setup.py#L13-L17
[00:41:16] <r1chardj0n3s> Ivo: if you'd like I can forward you the list of names that I found, and you can wander through to find other gems :)
[00:41:37] <r1chardj0n3s> to be honest, I feel I should do something with this list, but I'm not sure what that should be. maybe I'll just post it to twitter
[00:41:57] <Ivo> you slackivist you! /s
[00:42:20] <r1chardj0n3s> thinking about setting up a twitter bot that posts lev-distance-1 project registrations
[00:50:29] <r1chardj0n3s> ugh, there's 234 packages in that list with "nester" in the name :/
[00:50:49] <Ivo> spoilt for choice
[00:51:10] <Ivo> r1chardj0n3s: make a witty blog post about it and get lots of internet points
[00:51:21] <r1chardj0n3s> Ivo: already did that ;)
[00:59:21] <r1chardj0n3s> oh... dstufft, store.gen_file_path doesn't appear to be generating absolute paths any longer...
[00:59:48] <dstufft> r1chardj0n3s: No, PyPI doesn't actually directly manipulate the filesystem anymore, it uses an abstraction now
[01:00:02] <dstufft> that abstraction is still pointed at the filesystem for the time being though
[01:00:12] <dstufft> but soon (hopefully) it'll start pointing at some sort of object store
[01:00:18] <r1chardj0n3s> dstufft: right. so. how do I open the file then?
[01:00:39] <r1chardj0n3s> (nested nuker needs to examine the contents)
[01:01:02] <dstufft> self.package_fs.getcontents(path, "rb")
[01:01:18] <dstufft> will give you a string
[01:01:22] <r1chardj0n3s> ok, I'll poke around that, thanks
[01:01:44] <dstufft> It's using this https://pypi.python.org/pypi/fs/0.5.1
[01:02:28] <dstufft> http://docs.pyfilesystem.org/en/latest/interface.html package_fs should have that interface
[01:05:31] <r1chardj0n3s> \o/ stringio :/
[01:12:29] <r1chardj0n3s> right, that's another 243 nesters dead
[01:14:13] <r1chardj0n3s> dstufft: this code works, but could you eyeball it for sanity from your perspective pls? https://bitbucket.org/pypa/pypi/pull-request/73/use-the-fs-abstraction-layer/diff
[01:14:56] <dstufft> r1chardj0n3s: seems legit to me
[01:15:21] <r1chardj0n3s> cheers
[07:21:24] <Ivo> r1chardj0n3s_afk: is that code always to run on python2
[07:21:49] <Ivo> otherwise you'll get transparent en/decoding of the file contents, I'd guess
[07:22:03] <r1chardj0n3s_afk> Ivo: py2
[07:23:01] <Ivo> pip has had some "fun" straddling stringio & bytesio between py2 & 3 in the past, IIRC
[07:23:20] <r1chardj0n3s_afk> yeah, well "luckily" pypi will never, ever see py3k ;)
[07:23:50] <Ivo> oh ok im guessing this is the current cheeseshop impl, not warehouse
[07:23:54] <r1chardj0n3s_afk> (I probably shouldn't have said "never, ever" 'cos warehouse isn't deployed yet...)
[07:24:00] <r1chardj0n3s_afk> Ivo: ya
[07:24:47] <Ivo> pls dont suggest possibility of warehouse going the way of distutils2, you'll give me nightmares
[07:24:54] <Ivo> >_<
[07:26:02] <r1chardj0n3s_afk> Ivo: warehouse has been in development for a *long* time :/
[07:27:02] <Ivo> sure, but it is big project, only part-time funding for one developer to actually work on it, rest volunteer, to do a painless switch-over
[07:27:33] <Ivo> I'd say completely expected as long as its making some steady progress
[07:27:34] <r1chardj0n3s_afk> I'm well aware *why* it's not live yet
[07:28:21] <Ivo> I wonder if, <Python.org> would ever consider something like funding bountysources for issues related to it
[07:28:31] <r1chardj0n3s_afk> Ivo: who's going to manage that? :)
[07:28:53] <r1chardj0n3s_afk> I remember *last pycon* saying that if psf needs one thing, it needs a project manager
[07:29:29] <Ivo> Well, after whatever beaurocracy approved x funding, I'd guess to Nick C to either directly manage or delegate someone to do
[07:29:50] <r1chardj0n3s_afk> who? seriously. there is already a lack of volunteers :)
[07:30:09] <r1chardj0n3s_afk> (no, nick wouldn't do that, he's already got enough on his plate)
[07:30:28] <Ivo> well ok dstufft is main contender
[07:30:35] <Ivo> or any of pypa members could put up their hand
[07:30:44] <Ivo> just floating an idea though
[07:31:27] <Ivo> I see in the last like.. 5 years, crowd funding has gotten ridiculously effective for quite a few creative things on the internet
[07:32:18] <Ivo> big OSS *should* be barging in on that
[07:32:44] <r1chardj0n3s_afk> I don't doubt that. I think you either under-estimate the amount of effort that would be required to manage that, or over-estimate the volunteer resource pool to draw managers from
[07:33:38] <Ivo> well my specific idea only needs very-part-time management from one person, mostly being trusted to effectivel dole out imaginary source of money
[07:34:28] <Ivo> because I'm totally reasonably imagining PSF has oodles of money it can't figure out how to spend :D
[07:35:01] <dstufft> I am a terrible project manager
[07:35:04] <dstufft> I don't know how to do it
[07:35:06] <r1chardj0n3s_afk> and liase with other volunteers to determine tasks, scope/spec them, manage listings on funding site(s), manage applicants, handle book-keeping, manage on-going task assignments, ...
[07:35:17] <dstufft> and I don't know ho wto delegate (see also why I have too much ion my plate)
[07:35:22] <r1chardj0n3s_afk> that's just some of the stuff off the top of my head ;)
[07:35:29] <dstufft> specific to warehouse though, I'm working on it right now!
[07:35:30] <r1chardj0n3s_afk> dstufft does not know how to delegate ;)
[07:35:37] <Ivo> just one possible avenue if we were desparate to speed up warehouse avenue
[07:35:49] <r1chardj0n3s> see previous comment about delegation ;)
[07:35:58] <Ivo> *warehouse development
[07:36:15] <r1chardj0n3s> I've had sprint rooms at pycon with 8 people wanting to help; the big problem was finding something they could usefully work on.
[07:36:28] <r1chardj0n3s> (I'm really, really not making this a dig at dstufft, please don't take it that way)
[07:36:30] <dstufft> I'm focusing on warehouse right now that pip 6 is out
[07:36:45] <r1chardj0n3s> yep. when do you transition to new position? or has that happened?
[07:36:49] <dstufft> r1chardj0n3s: it's the truth, I'm super bad at delegating
[07:37:03] <r1chardj0n3s> dstufft: yeah, but you're also not alone ;)
[07:37:09] <dstufft> r1chardj0n3s: I'm on the DRG now at Rackspace yea, since the 2nd of Feb
[07:37:14] <r1chardj0n3s> cool
[07:37:16] <dstufft> or DevEx
[07:37:17] <dstufft> whatever we're called now
[07:37:20] <r1chardj0n3s> :)
[07:37:27] <Ivo> *the dstuffts beatings will continue until the ΔLoC improves*
[07:37:37] <r1chardj0n3s> the people *I* should be working for so I don't have to fight so much to get funding to go to pycon ;)
[07:38:00] <r1chardj0n3s> also, I could work on warehouse and not feel bad about abandoning my other responsibilities
[07:38:20] <dstufft> I'm doing a massive big refactor of warehouse so that it's not "sit and wait for dstufft to figure out how we should do X in WArehouse since Warehouse is basically a custom framework written by dstufft"
[07:38:31] <dstufft> which is almost done
[07:38:34] <r1chardj0n3s> \o/
[07:38:43] <Ivo> what is it on atm, werkzeug?
[07:38:53] <Ivo> or did you bump it up to flask
[07:38:55] <dstufft> the master branch is werkzeug + shit I wrote around it
[07:39:00] <r1chardj0n3s> please to be done with that by pycon. also, having a good list of sprint tasks by pycon would be *really* good
[07:39:02] <Ivo> okies
[07:39:18] <dstufft> there's a flaskify branch, but I'm not a huge fan of flask for anytihng more than small things
[07:39:55] <Ivo> i was only thinking of the codebase-familiar-to-more-people angle
[07:41:54] <r1chardj0n3s> dstufft: fwiw the Horizon folk have finally pulled their fingers out of their collective arses and we're finally making progress on a bunch of stuff. Which unfortunately means my predicted Warehouse time has whittled away to nada :(
[07:42:47] <r1chardj0n3s> I didn't get much further with anything to do with pypi name collisions today because Horizon, and I'm not likely to tomorrow either :/
[07:44:17] <dstufft> r1chardj0n3s: :(
[07:44:53] <r1chardj0n3s> on the one hand, progress in Horizon is good (hey, it's what I'm paid to do) but on the other hand...
[07:45:15] <Ivo> ask if they'll give you 20% time? :D
[07:45:24] <r1chardj0n3s> ok, I gotta AFK again, most likely for the rest of the evening. catch y'all tomorrow :)
[07:45:36] <Ivo> night!
[07:45:36] <r1chardj0n3s> heh Ivo, if you can figure out how they can do that, lemme know ;)
[07:46:03] <dstufft> r1chardj0n3s: as far as progress goes, there's user login and logout, user profile (no templating or anything done for them), the detial pages for projects are mostly done (needs some themeing, but layout wise is ok), still needs simple API and search to match where we were at with warehouse
[07:46:07] <dstufft> oops
[07:46:09] <dstufft> see ya r1chardj0n3s_afk !
[07:46:45] <Ivo> dstufft: how about api connection with pip type stuff
[07:46:54] <dstufft> Ivo: what do you mean?
[07:47:18] <Ivo> providing api for pip to query, search & download packages
[07:48:02] <Ivo> where current is through /simple/ directory and XML-RPC search interface
[07:48:07] <Ivo> iirc
[07:48:16] <dstufft> Warehouse is focusing primarily on replicating PyPI's functionality and APIs so we can replace the old code base, once WArehouse *is* PyPI then further enhancement is on the table
[07:48:43] <Ivo> so have you replicated that ^ yet, or not yet
[07:51:10] <dstufft> Warehouse master has /simple/, and I think it has XMLRPC
[07:51:16] <dstufft> the refactor doesn't have that ported over yet
[17:19:04] <msabramo> oh are you killing the nester packages? Yay!
[17:20:03] <msabramo> I thought of sending a PR that checks for "nester" in the name on upload and then says "Are you sure you don't want to use https://testpypi.python.org/pypi?"
[19:06:18] <msabramo> so I'm playing with a package that overrides a stdlib module (pdb); when installed not as a wheel, the egg ends up at the head of sys.path and it overrides; when installed as a wheel, it cannot override; any way to make a wheel take precedence?
[19:12:43] <qwcode> msabramo, if you don't know, it's helpful to know that the egg override is happening due to last line of easy-intall.pth (in site-packages)