PMXBOT Log file Viewer

Help | Karma | Search:

#pypa-dev logs for Thursday the 18th of December, 2014

(Back to #pypa-dev overview) (Back to channel listing) (Animate logs)
[00:23:32] <herrwolfe> silly question - does passing '--no-wheel-install' guarantee that the package will not be installed using a wheel?
[00:23:57] <herrwolfe> I'm trying to workout a test case and am being confounded by an error not being raised
[00:24:13] <dstufft> it's --no-use-wheel
[00:24:21] <herrwolfe> ergh - sorry that's what I meant to type
[00:24:35] <dstufft> and it should promise that it will not be installed as aw heel
[00:24:38] <dstufft> if it does that's likely a bug
[00:24:38] <herrwolfe> ok
[00:25:30] <herrwolfe> that or I've miswritten my test case
[00:26:41] <herrwolfe> thanks though
[03:37:40] <msabramo1> cool
[08:03:34] <msabramo1> https://github.com/pypa/pip/pull/2219
[08:05:28] <msabramo1> @dstufft: #2221 is #2207 (display versions of installed packages) but without the `project==version` format
[13:40:17] <pmxbot> jaraco pushed 7 commits to setuptools (https://bitbucket.org/pypa/setuptools/) :
[13:40:17] <pmxbot> Don't warn on empty non PEP 440 versions
[13:40:17] <pmxbot> Merge pull request #20 from dstufft/dont-warn-empty
[13:40:17] <pmxbot> Add a PEP440Warning to make it easier to silence these warnings
[13:40:17] <pmxbot> Merge pull request #21 from dstufft/subclass-warning
[13:40:17] <pmxbot> Upgrade packaging to 14.5
[13:40:17] <pmxbot> Merge pull request #22 from dstufft/upgrade-packaging
[13:40:17] <pmxbot> Update changelog
[13:41:37] <pmxbot> jaraco pushed 3 commits to setuptools (https://bitbucket.org/pypa/setuptools/) :
[13:41:37] <pmxbot> Bumped to 8.1 in preparation for next release.
[13:41:37] <pmxbot> Added tag 8.1 for changeset 3f87370b6863
[13:41:37] <pmxbot> Bumped to 8.2 in preparation for next release.
[14:05:39] <pmxbot> jaraco pushed 1 commit to setuptools (https://bitbucket.org/pypa/setuptools/) :
[14:05:39] <pmxbot> Merge with 8.1
[14:09:25] <pmxbot> jaraco pushed 2 commits to setuptools (https://bitbucket.org/pypa/setuptools/) :
[14:09:25] <pmxbot> Added tag 8.2 for changeset 995f6d965131
[14:09:25] <pmxbot> Bumped to 8.3 in preparation for next release.
[14:17:02] <jaraco> dstufft, I've released your three PRs as 8.1 (mainly because of the added classes). Since 'packaging' support is stabilizing and unlikely to be backed out, I've also released 8.2 with the pending changes in master.
[14:17:18] <dstufft> jaraco: awesome, thanks!
[14:17:30] <dstufft> I'm trying to figure out how to reference PEP440Warning on the CLI :(
[14:17:51] <dstufft> python -W ignore::PEP440Warning and python -W ignore::pkg_resources.PEP440Warning doesn't seem to work
[14:18:30] <dstufft> of course python -W ignore::RuntimeWarning works, since it's a sublcass, and PEP440Warning works when called programatically
[14:18:33] <dstufft> not sure the right synax :|
[14:18:36] <jaraco> Can't say I've ever tried that. I don't know the mechanism.
[14:19:36] <dstufft> might not be able to do that fine grained from the CLI hmm
[14:19:37] <dstufft> oh well
[14:25:32] <dstufft> jaraco: I think we can say that setuptools has probably stabilized now? I had folks stop submitting PRs places to update their version of setuptools (like Homebrew etc) until we got it stablized
[14:26:32] <jaraco> dstufft, I would hope so, but given that we _just_ made a release, I'd give it a couple of days more.
[14:57:52] <herrwolfe> dstufft: I'm a little confused by pip.req.req_set.Requirement.prepare_files and am wondering if I might be missing something - is there a functional reason why a pkg_resources.Distribution object is only created for wheels installs?
[14:58:19] <dstufft> herrwolfe: not sure, I don't know that code very well :/
[14:58:22] <herrwolfe> ok
[14:58:36] <herrwolfe> dstufft: no worries - I'll keep looking for the answer
[14:59:26] <msabramo1> prepare_files is a pretty monstrous function
[14:59:29] <xafer> herrwolfe, I don't think so cf https://github.com/pypa/pip/pull/2153 :)
[15:00:33] <msabramo1> thoughts on https://bitbucket.org/pypa/pypi/pull-request/60/fix-bb-214-make-rst-rendering-not-fail-for/diff ?
[15:00:47] <herrwolfe> xafer: awesome, I'll take a look at this, I was kind of feeling around and trying to do that myself
[15:02:01] <herrwolfe> xafer: but, I think I was getting a bit bogged down in some of the test failures that were caused by what I was trying to accomplish
[15:02:10] <dstufft> msabramo1: I think I might just modify pypi to use readme already instead of waiting for warehouse to start using that
[15:04:04] <msabramo1> dstufft: oh yeah?
[15:04:08] <xafer> herrwolfe, yup, parse_editable was putting dict inside req_to_install.extras which dist.requires doesnt like (therefore the first commit of the PR)
[15:04:37] <msabramo1> I had been thinking it would be nice for pypi to use readme but I didn't know if richardjones was up for a biggish change like that
[15:05:29] <msabramo1> ^ r1chardj0n3s
[15:05:39] <msabramo1> I can send a PR though
[15:05:44] <sigmavirus24> msabramo1: almost certainly not
[15:06:01] <sigmavirus24> I think PyPI is mostly in maintenance mode (from discussions I've had with Richard)
[15:06:11] <dstufft> it is, but we also do modify it sometimes
[15:06:15] <dstufft> mostly it's a case by case basis
[15:06:35] <dstufft> switching to readme would bring the benefit that people can test their readme's against whatever PyPI is going to use to render it
[15:06:48] <msabramo1> I think in my head I imagine r1chardj0n3s thinking of PyPI like a particular legacy system that I maintain at work, which I try to minimize spending time on :)
[15:07:06] <dstufft> I think that's about right
[15:07:12] <dstufft> I can merge on pypi tho ;P
[15:07:20] <msabramo1> yeah that would be awesome to make readme the standard
[15:07:31] <msabramo1> because there are not great ways to validate your README.rst
[15:07:35] <msabramo1> so a lot of them end up being broken
[15:07:50] <msabramo1> like, uh https://github.com/pypa/packaging/issues/23 for example :)
[15:08:21] <dstufft> yea
[15:08:25] <dstufft> readme is intended to be that
[15:08:29] <msabramo1> distutils has `python setup.py check —restructuredtext` I discovered recently, but it's broken :-(
[15:08:40] <msabramo1> http://bugs.python.org/issue23063
[15:08:42] <dstufft> I was planning on jsut rolling it out in warehouse, but then things happened and warehouse took longer then intended
[15:09:04] <msabramo1> yeah I gathered warehouse hit some delays
[15:09:12] <msabramo1> I'd be interested in helping expedite it
[15:09:59] <msabramo1> let's make PyPI use readme and then piece by piece replace bits of PyPI with warehouse :)
[15:10:07] <dstufft> ha
[15:10:08] <dstufft> well
[15:10:10] <dstufft> after pip 6
[15:10:15] <dstufft> warehouse becomes my focus
[15:10:17] <msabramo1> frog in boiling water yada yada
[15:10:30] <msabramo1> sweet
[15:11:09] <msabramo1> a nicer PyPI would be loved by many
[15:11:35] <xafer> was wondering if there was a planning for pip 7 ?
[15:13:10] <dstufft> xafer: what kind of plan are you looking for
[15:13:47] <xafer> an approximate release date
[15:14:06] <xafer> is it 3, 6, 12 months ?
[15:16:06] <dstufft> not sure, we're going to try to release faster than we have in the past, but unless we make backwards compat changes we'll release it as 6.Y
[15:16:15] <dstufft> but we can put new features and stuff in a 6.Y
[15:16:51] <xafer> I was thinking of all the RemovedInPip7Warning and the code that could be removed with them :)
[15:17:18] <dstufft> yea that stuff, probably we'd want to wait at least 6 months before releasing 7
[15:17:27] <xafer> k
[15:17:43] <msabramo1> https://github.com/pypa/packaging/pull/22
[15:27:55] <msabramo1> dstufft: Maybe we should merge something like https://bitbucket.org/pypa/pypi/pull-request/58/add-tests-test_description_utilspy/diff before changing PyPI to use pypa/readme?
[16:41:05] <xafer> dstufft, did you have time to rethink the logger issue of https://github.com/pypa/pip/pull/2153 ?
[16:48:38] <dstufft> xafer: not yet
[16:58:38] <dstufft> jaraco: ping
[16:58:54] <jaraco> pong dstufft
[17:00:30] <dstufft> jaraco: I've got someone arguing that the PEP 440 warning is going to confuse end users and I wanted to get your opinion here, I see two possible situations -> a) An End user is doing something, gets the warning and it helps them solve a problem because the failure condition without it isn't the greatest and b) The end user isn't doing anything, might not even know python is involved and things are working fine but they get a warning that
[17:00:31] <dstufft> confuses them
[17:00:42] <dstufft> this person is worried that option b) is more signifcant than option a)
[17:01:07] <dstufft> Do you think we should silence the warning by default, and make it possible for people to re-enable it using Python's warning control
[17:01:47] <jaraco> I imagine https://bitbucket.org/pypa/setuptools/issue/306/setuptools-82-spews-end-user-error is also relevant to that discussion.
[17:02:03] <dstufft> heh
[17:02:08] <dstufft> sdague is who I'm talking to
[17:03:12] <jaraco> I imagine that (b) is pretty substantial, especially if system packages typically get non-PEP440 version numbers.
[17:03:29] <dstufft> I don't entirely agree that option (A) isn't signifcant, for instance I've seen an issue where it was useful already, but I don't know if (b) is more signifcant or not
[17:03:50] <dstufft> in particular devstack only gets this because they force upgrade to the latest setuptools intoo the system python, and not for instance in a virtualenv or anything
[17:03:52] <jaraco> It's a lot like the DeprecationWarning debate which eventually settled on disabling it by default, but having certain tooling enable it (unittests).
[17:04:08] <dstufft> yea
[17:04:18] <dstufft> so Python's warnings module makes it possible for us to do that
[17:06:24] <dstufft> jaraco: do you think we should just have PEP440Warning be silent by default?
[17:06:54] <jaraco> I think so.
[17:07:00] <dstufft> ok
[17:07:04] <dstufft> I'll make a patch
[17:07:08] <dstufft> 8.0-maint or master?
[17:07:14] <jaraco> master at this point. Thanks.
[17:07:37] <dstufft> ok
[17:12:48] <dstufft> jaraco: I'm thinking maybe we should have the setup() function turn it back on?
[17:13:17] <dstufft> printing the warning while installing will probably cover most of (a)
[17:14:23] <jaraco> dstufft, That sounds exactly right, and consistent with what sdague has recommended (on during install/removal).
[17:19:30] <dstufft> jaraco: so there's actually another warning already that happens during setup.py execution if the version passed to setup.py isn't kosher, do we still want to do anything but silence PEP440Warning by default? The big difference will be that if we just silence PEP440Warning by default, and someone does ``setup.py install`` on a thing whose version is fine, but there is something it depends on already installed with a wierd version you won't
[17:19:31] <dstufft> get a warning about that other thing, but if we turn on PEP440Warning during install you will
[17:21:46] <jaraco> dstufft: I'm not sure. I'm starting to think the warning should only happen during a build step.
[17:23:34] <dstufft> jaraco: I think I have it, I'll just turn this particular noisy warning off by default (because it happens in pkg_resources, and pkg_resources gets used for lots of stuff), and I'll turn it back on inside of pip
[17:23:42] <dstufft> pip isn't used except in a "manage my packages" sort of way
[17:24:07] <dstufft> that'll probably get good enough coverage of the warning for people to fix things, without spamming end users
[17:24:12] <jaraco> That seems reasonable. Maybe it should be equivalently enabled during easy_install.
[17:25:08] <dstufft> jaraco: yea, let me see if I can figure out a good place to do that
[17:31:46] <dstufft> jaraco: https://github.com/jaraco/setuptools/pull/23
[17:32:00] <dstufft> seems to work for easy_install without catching anything else
[17:32:51] <dstufft> jaraco: also let me just say, thank you again for accepting PRs on github, it's like 1000x easier for me :D
[17:33:09] <dstufft> jaraco: and I do have a TODO item still to figure out what all needs done to make github.com/pypa/setuptools happen ;)
[17:35:00] <jaraco> My pleasure. I do feel a bit of sadness that Mercurial is losing mindshare in the Python community, but that's just the way it is.
[17:35:30] <sigmavirus24> jaraco: it's winning mindshare in the mercurial community though
[17:38:19] <dstufft> jaraco: heh, yea
[17:38:25] <dstufft> jaraco: I used to sue Mercurial, a loooong time ago
[17:38:33] <sigmavirus24> dstufft: you're a lawyer?
[17:38:35] <dstufft> I switched early on to git mostly for Github
[17:38:38] <dstufft> sigmavirus24: only on the internet
[17:38:41] <sigmavirus24> what'd you sue them for? intellectual property?
[17:42:42] <sigmavirus24> http://i.imgur.com/WZyURav.png
[17:42:48] <dstufft> sigmavirus24: lol
[17:45:25] <sigmavirus24> I was one of those kids thought they'd be a kernel hacker when they grew up so I learned git first
[18:02:30] <sigmavirus24> dstufft: stupid question: with entry_points, what are extras meant to be and how are they declared?
[18:02:57] <dstufft> sigmavirus24: think optional opt in sets of dependencies
[18:03:17] <sigmavirus24> okay so they can't describe something on the entry point itself, like metadata
[18:03:30] <sigmavirus24> not what I want then =P
[18:04:41] <sigmavirus24> in good news, py32 works https://travis-ci.org/pypa/pip/builds/44484041
[18:04:52] <sigmavirus24> now it's pypy that is slow =P
[18:23:59] <dstufft> jaraco: do you have an estimated time for when you plan on merging https://github.com/jaraco/setuptools/pull/23 and cutting a release? I ask only to plan my day better ;)
[18:30:19] <jaraco> dstufft, I might wait until later this afternoon. I'm pretty busy right now.
[18:30:29] <dstufft> jaraco: ok cool, no worries
[18:30:35] <dstufft> thanks!
[19:24:46] <msabramo1> @dstufft, @pf_moore: See https://github.com/pypa/pip/pull/2219 and https://github.com/pypa/pip/pull/2221 when you get a chance
[19:56:45] <pf_moore> I'm OK with #2219, and it looks like qwcode is too.
[19:57:02] <pf_moore> dstufft: any last minute objections before I merge it?
[19:57:34] <dstufft> the outcome is fine with me, didn't lok at the code at all, go for it
[19:58:29] <qwcode> to be clear, it will log stuff like this, right: Sphinx 1.2.3 (<path>/lib/python2.7/site-packages)
[19:59:21] <qwcode> sorry, not the path
[19:59:24] <pf_moore> Just "Sphinx 1.2.3" (no path...)
[19:59:59] <pf_moore> Yes
[20:00:54] <pf_moore> I'm not so sure about 2221 (the install one) - as qwcode said, the inconsistency bothers me (the format is different as well, "Sphinx-1.2.3" if I'm reading the code properly
[20:01:04] <pf_moore> I haven't run it, just read the code...
[20:18:55] <pf_moore> I've just noticed that 2219 (the uninstall one) relies on the string representation of a dist. I'd rather the format was explicit. Proper comments inline, but I'm holding off on merging for now.
[21:58:54] <msabramo1> ok think I'll create another PR
[21:59:08] <msabramo1> thanks for the reviews
[22:00:01] <msabramo1> I would love for https://bitbucket.org/pypa/pypi/pull-request/58/add-tests-test_description_utilspy/diff to land at some point, it will help with my WIP to make PyPI use pypa/readme
[22:57:38] <tomprince> dstufft: I think local versions are mostly broken. :(
[23:02:52] <dstufft> tomprince: pip 1.5.6 doesn't understand local versions
[23:02:59] <dstufft> you have to wait for pip 6
[23:03:57] <tomprince> They don't even work with devel currently, I don't think.
[23:05:00] <tomprince> At least, wheels don't seem to.
[23:08:58] <dstufft> tomprince: can you expand on what command you're running and what the error is?
[23:09:03] <msabramo> what are local versions?
[23:09:05] <dstufft> and ensure you're using the latest develop
[23:09:09] <dstufft> msabramo: 1.0+local.1
[23:09:30] <msabramo> hmmm interesting
[23:10:57] <tomprince> dstufft: pip install apache_libcloud-0.16.0+clusterhq.0-py2.py3-none-any.whl
[23:12:20] <dstufft> tomprince: does it work if you do pip install --no-index --find-links . apache_libcloud==0.16.0+clusterhq.0
[23:14:47] <tomprince> dstufft: Doesn't find it.
[23:17:03] <dstufft> tomprince: you're using the develop branch not the master branch right?
[23:18:18] <tomprince> pip install 'git+https://github.com/pypa/pip#egg-info=pip'
[23:18:36] <tomprince> pip 6.0.dev1
[23:18:36] <dstufft> I think that'll get you the master branch
[23:18:41] <dstufft> oh does it get you devleop?
[23:18:42] <dstufft> hmm
[23:18:44] <dstufft> ok
[23:18:45] <dstufft> sec
[23:27:24] <dstufft> tomprince: ok I see, it doesn't seem to be able to parse it out of a wheel file, it can parse it out of a .tar.gz
[23:27:39] <dstufft> I'll get that fixed
[23:32:12] <msabramo> dstufft: https://github.com/pypa/readme/pull/13
[23:34:29] <dstufft> msabramo: are we generating HTML with class ona nything other than span?
[23:36:06] <msabramo> dstufft: Yes. If you look at https://bitbucket.org/pypa/pypi/pull-request/58/add-tests-test_description_utilspy/diff, you'll see that PyPI generates HTML for span, pre, and a