PMXBOT Log file Viewer

Help | Karma | Search:

#pypa logs for Sunday the 18th of May, 2014

(Back to #pypa overview) (Back to channel listing) (Animate logs)
[04:31:31] <nj3ma> attempting to install virtualenvwrapper via pip on ubuntu 12.04 and keep getting an error
[04:36:46] <nj3ma> everytime i attempt to source .bashrc
[04:37:33] <nj3ma> http://dpaste.com/114CFJQ/
[18:02:31] <kober> Hey, is there a way to cache an already compiled version of things like gevent and numpy? We run a service oriented architecture and I have a vagrant setup that sets up all services
[18:02:42] <kober> but since each service uses gevent and numpy it has to recompile every time
[18:03:44] <kober> I'd like it to cache the result after the first time, kind of like --download-cache but with the actual compiled package
[18:03:49] <kober> maybe turn it into a wheel?
[18:04:30] <Alex_Gaynor> kober: yup, setting up your own wheel cache would be the best way to do it
[18:05:25] <kober> Can that be done via pip or do I have to setup something like devpi and then build the wheels myself?
[18:05:31] <Alex_Gaynor> nope, you can do it all with pip
[18:05:40] <Alex_Gaynor> do you want to do this on a single machien, or shared across a bunch of machines?
[18:06:14] <kober> Currently my only goal is to get the vagrant run faster than an hour, so I would only need it on a single machine
[18:06:46] <Alex_Gaynor> https://www.irccloud.com/pastebin/jMIL3Etf
[18:06:50] <kober> The final goal is to use the same ansible scripts that are setting up the vagrant machine to setup our whole infrastructure. But I want to take baby steps
[18:07:08] <Alex_Gaynor> That's my pip.conf, you can `pip wheel <package>` and then when you got `pip install` it, it'll be basically instant
[18:08:04] <kober> Alex_Gaynor: perfect! This sounds like it is what I want :)
[18:09:30] <kober> Alex_Gaynor: does wheel-dir and find-links not expand ~/ ? I notice you used it for the download cache but not for the others
[18:09:44] <Alex_Gaynor> kober: there was a bug at one point where they don't, it might be fxied /cc dstufft
[18:11:32] <dstufft> I think it's fixed in develop but not in anything released
[18:11:32] <tomprince> If your machines are homogenous, it probably makes sense to compile the once and put them somewhere accesible from everywhere.
[18:13:01] <kober> We had problems with wheels previously because it doesn't track the distro (i.e ubuntu 14.04 vs 10.04), thats why I wanted to do it on the machine doing the pip installs
[18:13:17] <kober> that way we could be compiled against the correct libraries
[18:14:24] <kober> I think we are going to end up creating a devpi server for each supported distro we use and just have the devs use the right config when they install, but this pip config is a pretty good solution so I'm going to try that first
[18:22:14] <Ivo> kober: if the wheels are built for the correct libraries, you can just use --find-links to install them
[18:23:26] <Ivo> e.g point to a /path/14.04/ folder / http location with wheels built on 14.04 in it, etc
[18:23:52] <kober> Ivo: Thats actually a great point
[18:23:59] <kober> Ivo: That will be pretty simple to do
[19:07:03] <kober> Alex_Gaynor: I think your pip conf might be out of date, I just tried it and got Invalid URL u'/home/vagrant/.pip/wheels': No schema supplied.
[19:07:11] <kober> Alex_Gaynor: I'm going to try file://
[19:07:15] <kober> but just thought I'd let you know
[19:07:23] <Alex_Gaynor> What version of pip are you using?
[19:07:45] <kober> 1.5.4
[19:08:04] <Alex_Gaynor> It works fine for me on pip 1.5.6 (and has been working fine for several months)
[19:08:54] <dstufft> kober: are you using the real pip 1.5.4 or is the pip 1.5.4 from a distro
[19:09:24] <kober> dstufft: It is pip inside a virtualenv
[19:09:44] <dstufft> real then
[19:10:07] <dstufft> must be a bug somewhere
[19:10:08] <kober> /opt/webapp/wheelhouse/bin/pip --version pip returns 1.5.4 from /opt/webapp/wheelhouse/local/lib/python2.7/site-packages (python 2.7)
[19:10:13] <kober> Maybe I setup the conf wrong
[19:11:01] <kober> http://paste.ofcode.org/xxZNRk3JL4VfWrgGm3etbX
[19:14:50] <kober> dstufft: Alex_Gaynor: using file:// in front of it worked
[19:14:57] <kober> for find-links
[21:59:15] <MVXA> hi, could someone help me to get pip wheel build dependencies from -e entries in the requirements.txt?
[22:00:01] <MVXA> no mater how i try pip proudly blurts on the console that it's ignoring these entries
[22:02:47] <Alex_Gaynor> MVXA: There's a known bug that cuases that, I think it might be fixed in the devel version of pip
[22:03:14] <MVXA> dammit / hui, thanks
[22:22:06] <MVXA> nope, that was too soon. It's fetched but not built: Skipping grapefruit, due to being editable
[22:23:13] <Alex_Gaynor> np