Log file Viewer

[10:24:54] <ssc> Hi, are there recent statistics regarding the distribution of Python versions on PyPI (for package downloads)?

[11:08:30] <ronny> dstufft: ping?

[11:14:57] <ronny> mm, i suppose 6 in the morning?

[14:25:42] <ssc> I have a package with extra requirements.

[14:25:52] <ssc> When I locally install it via "pip install -e .[MsgPack]", the extra requirements get installed properly.

[14:26:20] <ssc> When I try to install it from PyPI (via "pip install aiomas[MsgPack]"), they don't get installed.

[14:30:17] <ssc> http://setuptools.readthedocs.org/en/latest/setuptools.html#declaring-extras-optional-features-with-their-own-dependencies

[14:30:51] <ssc> No idea what I did wrong :/

[14:33:19] <ronny> ssc: link to current setup.py?

[14:33:49] <ssc> ronny: https://bitbucket.org/ssc/aiomas/src/61b6d46fa3e6ce5e864ea3283254de7b8bb743a6/setup.py?at=default

[14:35:50] <ronny> looks correct at first glanncem pip/setuptools version at the install site?

[14:36:10] <ssc> newest releases

[14:36:30] <ssc> 6.0.8 and 12.0.5

[14:36:42] <ssc> okay, setuptools is not the newest :)

[14:37:24] <ssc> but this shouldn't affact pip install I guess? I mean, it works when I install it from my local clone.

[14:37:47] <ronny> ssc: it all looks ok :/

[14:38:01] <ronny> ssc: did you upload a release or a dev version?

[14:38:26] <ssc> A normal release -> https://pypi.python.org/pypi/aiomas

[14:38:46] <xafer> it looks like a bug with the wheel installer that does not like case sensitive extras

[14:39:23] <xafer> you could use pip install aiomas[MsgPack] --no-use-wheel as a work around

[14:39:39] <qwcode> yea, ditto.

[14:39:59] <qwcode> btw, the sdist install is failing for python2, only works for python3

[14:40:39] <qwcode> TypeError: 'encoding' is an invalid keyword argument for this function

[14:41:16] <xafer> ssc, could you create an issue on https://github.com/pypa/pip/issues ?

[14:41:29] <ssc> its a python3-only package

[14:41:44] <qwcode> ah

[14:42:46] <ssc> So uploading a new package with all-lower identifiers for the extra should fix it?

[14:43:18] <ronny> ssc: can you still report a bug?

[14:43:41] <ssc> sure. to wheel or to pip?

[14:43:50] <ronny> i think pip

[14:44:09] <ronny> wheel itself doesnt handle dependencies

[14:44:49] <ronny> ssc: that lib looks interesting

[14:45:25] <ssc> thx. :) still in early development, though.

[14:46:47] <ronny> ssc: i experimented with something similar for a while, being more explicit about actors and messages, seeing yours i realize that might have been a bad idea

[14:47:57] <ronny> hmm, i wonder how easy/hard integrating it with execnet would be

[14:50:17] <lps> Hi I am trying to install pyv8 using pip, but it's failing. Help needed!

[14:50:44] <lps> https://code.google.com/p/pyv8/

[14:53:31] <ssc> ronny: I have no idea. It depends on the protocol that execnet is using for its socket communication.

[14:53:33] <ssc> btw, https://github.com/pypa/pip/issues/2518

[14:54:35] <ronny> ssc: execnet currently does not support asyncio, i plan to add asyncio, after that agents look like nice repressentations for gateways in a network)

[14:54:39] <ssc> ronny: aiomas uses the same protocol as simpy.io when the JSON codec is used. Here is a short explanation of it: http://mosaik.readthedocs.org/en/latest/mosaik-api/low-level.html#the-low-level-api

[14:55:21] <ronny> (the goal is to have execnet 2.x be able to start up groups of persistent remote interpreter and bootstrap their communication)

[14:56:27] <ssc> Unfortunately, I’ve never worked with execnet. I’ve only heard hpk talking about it when we discussed building our own CI in Python at a Pycon ;-)

[15:00:11] <ronny> ssc: heh, yes, ci is one of my stretch goals ^^ your lib just looked like a nice potential building block

[15:00:52] <ssc> Too bad I just decided to not go to EuroPython this year.

[15:01:10] <ronny> im also not clear on EP yet

[15:01:26] <ronny> ssc: you on pyconde?

[15:01:38] <ssc> ronny: If there's one this year

[15:01:58] <doismellburning> ooh where's PyConDE usually held?

[15:02:09] <ssc> It was in Leipzig and Köln

[15:02:12] <ronny> doismellburning: not sure where its this year

[15:02:21] <ssc> last year there was a Python Unconf in Hamburg

[15:02:27] <doismellburning> (I'm in London, but employer is in München)

[15:03:44] <ronny> at the end of march there will be the pythonbarcamp in cologne

[15:07:51] <ssc> ronny: I’m on vacation then.

[15:08:00] <qwcode> ssc, ronny pretty sure the extra problem is setuptools/pkg_resources problem. logging the issue now in the setuptools tracker

[15:09:19] <ssc> qwcode: plz let me know if I can help you with anything.

[15:10:45] <ronny> qwcode: as far as i understood it happens when pip installs the wheel, it doesnt happen when pip installs the sdist, so its clearly a pip problem

[15:11:11] <ronny> ssc: in about 2-3 motnhs i'd like to talk ^^

[15:11:20] <ronny> wrt the networking/ci/other stuff

[15:11:45] <xafer> ronny, pip uses pkg_resources to get the metadata

[15:11:47] <qwcode> ronny, pip defers to pkg_resource's Distribution objects to get extras requirements. that's where the problems seems to be. hold for issue link...

[15:12:34] <ronny> qwcode: i suspect then it might be hidden down in the vendored packaging code that parses dist-info

[15:12:43] <xafer> extra = safe_extra(extra.strip()) :-/

[15:13:09] <qwcode> ronny, pip's pkg_resources is vendored from setuptools

[15:13:38] <ronny> qwcode: oh wtf>

[15:13:59] <ronny> its time for some serious devendoring ^^

[15:14:05] <qwcode> : )

[15:16:19] <qwcode> ronny, ssc xafer https://bitbucket.org/pypa/setuptools/issue/362/case-sensitive-extras-not-handled-for-dist

[15:17:40] <ronny> qwcode: nicely done, thanks

[15:18:56] <xafer> qwcode, the stange thing is that it seems voluntary: https://bitbucket.org/pypa/setuptools/src/18eceee63709bc70c06b51a609f3dbd2eab07ef4/pkg_resources/__init__.py?at=default#cl-1349

[15:19:19] <xafer> as if extras were expected to be lowercased

[15:22:50] <ronny> xafer: they are normalized to lowercase

[15:22:58] <qwcode> for both the wheel and sdist, d.extras returns a lowercase list, so thinking it's in the DistInfoDistribution class somewhere not handling it correctly.... not sure at this point. it *could* theoretically end up being wheel bug if the metadata has a problem

[15:23:05] <ronny> even the examples have them uppercase and mixedcase

[15:27:07] <ssc> qwcode, xafer, ronny: I could live with lowercased extras, but the docs should state that.

[15:27:45] <qwcode> it's a bug

[15:28:53] <ronny> what he said

[15:54:37] <ssc> ronny, doismellburning: Looks like they want to do a PyconDE this year, but they don't have a location yet (and no idea). It won't be Hamburg, because they want to focus on this years python unconf.