Log file Viewer

[01:12:46] <bobbyrward> I'm running into some strange problems with namespace packages (paste, pastedeploy, pastescript) that only started happening in the last few months. The three pacakages are installed with pip install -r requirements.txt. PasteDeploy is installed into /usr/local/.../dist-pacakages/PasteDeploy-<version>.egg/ The other two are installed flat, with PasteScript using a -nspkg.pth. When trying to import pas

[01:12:52] <bobbyrward> te.deploy then, I get "no module named deploy"

[01:13:09] <bobbyrward> If I reinstall PasteDeploy, it installs as a wheel and everything is fine

[01:14:14] <bobbyrward> I'm not sure why the first time it installs as an egg and why it decides to change to a wheel the second time

[01:15:07] <bobbyrward> Anyone have any guidance on any of this?

[01:58:48] <bobbyrward> PasteDeploy is getting is getting installed by "setup.py install" from a package it's depending on. That's why it's an egg the first time. Paste and PasteScript are not installed as part of that dependency.

[02:09:24] <bobbyrward> So if a zip_safe package is included in install_requires, it will always be installed as an egg? Is there a way around this particular namespace issue that doesn't involve removing it from install_requires and installing manually with pip?

[02:31:48] <kennethreitz> pypi 500ing on setup.py register one second, not the next

[02:31:50] <kennethreitz> no changes

[03:00:42] <[Tritium]> kennethreitz: pypi.python.org is slowly falling in on itself. mailing list seams to indicate that pypi.io is more reliable for uploads

[03:02:21] <kennethreitz> [Tritium] that's good information, but i have strong doubts all the users of the service will be in-the-know :-/

[03:03:02] <[Tritium]> kennethreitz: Indeed

[13:27:42] <tdsmith> dstufft: warehouse is exposing pythonhosted.org URLs; are those stable?

[13:27:49] <tdsmith> for i.e. sdist downloads

[13:28:03] <dstufft> tdsmith: files.pythonhosted.org? yea

[13:28:22] <tdsmith> cool thanks

[13:28:30] <dstufft> tdsmith: there's a redirect from the old style URLS files.pythonhosted.org/source/whatever/ if you don't like the hashed URLs too

[13:28:58] <ronny> dstufft: btw, are the pypi hashed urls always a content hash?

[13:29:00] <dstufft> but the hashed URLs are less likely to be unavailable and don't need any redirects (redirects hits a small python daemon, hashed urls go straight to S3)

[13:29:09] <dstufft> ronny: yes, it's a hash of the file content

[13:29:27] <ronny> good, so its easy to make tohse urls for nix ^^

[13:30:07] <dstufft> Whichi let's us upload the file fully to S3 prior to commiting the transaction without running into eventually consitent problems

[17:48:37] <natefoo> how does a virtualenv'd python get sys.prefix? it would appear i can copy the python binary anywhere inside of the virtualenv and sys.prefix is still set appropriately.

[17:48:59] <natefoo> this is without any environment modification with activate

[17:54:49] <Wooble> natefoo: python knows where it was run from

[17:58:09] <natefoo> Wooble: it doesn't seem that the binary is modified, but if i happen to grab the system python the venv was created from and put it in the venv, sys.prefix for it is /usr

[17:58:37] <natefoo> no sorry, that's incorrect

[17:59:52] <natefoo> so how does the interpreter know the correct sys.prefix regardless of where it's located?

[18:00:09] <dstufft> natefoo: when you compile Python you set the prefix

[18:00:49] <natefoo> dstufft: right, presumably in the case of the system python it was /usr

[18:01:09] <Wooble> natefoo: it's calculated in getpath.c. It's... complicated.

[18:01:25] <dstufft> natefoo: or are you asking how does virtualenv set it's sys.prefix ?

[18:01:56] <natefoo> dstufft: i'm wondering how a python interpreter dropped anywhere inside a virtualenv knows the correct sys.prefix.

[18:02:07] <Wooble> natefoo: https://github.com/python/cpython/blob/master/Modules/getpath.c#L459

[18:03:19] <natefoo> maybe this isn't the question i should be asking, though - what i'm really trying to do is make it possible for a pip installed in a virtualenv install packages to another prefix without using the command line options for it

[18:04:13] <Wooble> natefoo: changing the shebang of the pip to point to the python you want to install for will probably do it... but this seems like a really bad idea. Why do you want that?

[18:05:39] <natefoo> it's for an application that for 10 years has been "installed" by cloning and running from source.

[18:06:07] <natefoo> i want to make some system packages that will contain the application and its dependencies in a virtualenv under /usr

[18:06:13] <natefoo> this venv should be immutable

[18:06:48] <natefoo> i was going to stick a .pth in that site-packages that'd allow additional things to be read from /var somewhere so that people can also install additional things, which is common

[18:07:07] <natefoo> but would like to make it so pip can install there

[18:07:20] <natefoo> i guess the thing in /var could be an entirely separate venv with its own pip

[18:19:27] <natefoo> (yes i know it's ugly and wrong)

[18:19:30] <natefoo> does seem to work though

[20:04:30] <nulltek> hi! i use pip2tgz to download python libs for y local mirror. but it doesn't download the correct version of a lib in any case. e.g it downloads django_auth_ldap-1.2.8-py2-none-any.whl instead of django_auth_ldap-1.2.8-py3-none-any.whl. anyone knows why?

[20:19:31] <nulltek> my pip2tgz is py3, so no idea why it downloads the py2 version of django-auth-ldap

[20:20:02] <dstufft> nulltek: sorry, I don't know anything about pip2tgz

[20:20:49] <nulltek> dstufft thx. i hope someone else knows it. i guess it is often used if local mirrors are built..

[22:09:38] <kennethreitz> someone should build a c lib deps graph for pypi packages

[22:09:56] <kennethreitz> e.g. i'd like to see which packages require xmlsec1

[22:10:11] <kennethreitz> sort them by # downloads