PMXBOT Log file Viewer

Help | Karma | Search:

#pypa logs for Tuesday the 3rd of June, 2014

(Back to #pypa overview) (Back to channel listing) (Animate logs)
[08:22:55] <__machine> so dependency_links is going away (accelerated deprecation)… what alternative can i use to manage private libraries that are hosted in github, bitbucket and assembla and which have inter-dependencies? ideally i want to be able to add liba to `install_requires` in setup.py for a project… and have pip automatically install liba's recursive requirements which are also all in private vcs repos?
[09:53:14] <Ivo> __machine: private index
[09:53:29] <Ivo> or requirements.txt
[11:42:06] <__machine> where can i find the private index docs? can i just make one html file with links in it… or do i need a different page for every package and every version of every package?
[11:54:35] <Ivo> __machine: its also possible just to use a folder of packages with a auto-indexing web server
[11:55:54] <__machine> Ivo: each package to be installed or required as a dependency is just a git repository… can i just point a web server at a directory that contains git clones? or how do i create a simple index file that will download versions from the git repositories?
[11:58:53] <__machine> i see there are a tonne of pypi projects out there built in various frameworks… but i havent seen anyone talk about using a private index to provide links to packages in vcs
[13:37:56] <__machine> pip docs say i can use a simple auto index to deploy dependencies directly from VCS… but how do i create a simple auto index that points to VCS repos? the example is —find-links https://example.com/deploy/ … pip help says —find-links can also point to a local directory… i tried that and pip cant find my dependencies…
[13:39:19] <Ivo> __machine: put a bunch of packages in a directory and pip install --find-links=./my/pkgs/ <pkg> will work
[13:40:23] <Ivo> you can also use --find-links with a http directory
[13:40:59] <Ivo> __machine: e.g https://wheels.caremad.io/
[13:42:25] <__machine> thats what i did… the package (my git clone) is in a local dir… i did pip install -e ./someapp -f . … someapp has install_requires=['otherapp'] … and ./otherapp is a git clone with a setup.py inside at top level…
[13:43:05] <__machine> i also tried —find-links . and —find-links=. and using absolute path instead of .
[13:43:32] <__machine> no distributions at all found for otherapp
[13:44:16] <Ivo> you're wanting to editably install two packages?
[13:44:54] <Ivo> you might try a requirements.txt, solve it easily enough... - "-e .\n-e ./someapp"
[13:45:11] <__machine> i want to editably install someapp and otherapp it'd be nice if it could be editably installed but i dont really mind if not…
[13:46:18] <__machine> sure requirements.txt works… but the point is to have the dependencies listed in setup.py for each private library app we have developed… we have a few now and some depend on others… so when we start a new project i dont want to have to add all those recursive requirements to requirements.txt file…
[13:47:21] <__machine> i just want to put -e . in requirements.txt file … maybe —find-links url if need be… and in my projects setup.py list its deps… and have those deps recurisvely and automatically install their deps… all from private VCS
[13:49:31] <Ivo> well all that should work
[13:49:46] <Ivo> otherwise I imagine we would have had bugs filed for it ages ago
[13:51:35] <__machine> hmm… so how do i do it?
[13:51:43] <Ivo> do what exactly
[13:52:30] <Ivo> __machine: for instance, in a test virtualenv try pip install pytest --find-links=https://wheels.caremad.io/ --no-index
[13:52:59] <Ivo> (needs pip 1.5 to install wheels automatically)
[13:53:17] <__machine> say i have liba, depends on libb depends on libc … all are private git repos not on pypi… i want to pip install liba and have it automatically install libb and libc
[15:51:35] <befh> I'm getting an error while trying to install packages using pip in a virtualenv. http://pastebin.com/FsskN6Cd
[15:52:11] <befh> I'm using manjaro, btw. Does anyone have any ideas?
[15:53:20] <Ivo> befh: you generally don't want to try to install scipy using pip
[15:53:47] <befh> how should I install it, and what do I need to do to repair?
[15:54:06] <befh> should I just trash this virtualenv?
[15:54:34] <Ivo> if pip install fails it wont leave things in broken state
[15:54:40] <Ivo> just in a didnt-install state
[15:54:41] <Ivo> afaik
[15:55:32] <Ivo> befh: using anaconda python is probably the fastest just-get-it-working solution that has environment isolation
[15:56:08] <befh> hmm does that work on linux?
[15:56:11] <Ivo> otherwise if you're using a linux distro you can get scipy from your repos, and make a --system-site-packages virtualenv
[15:56:22] <befh> should I just use pacman then?
[15:56:50] <Ivo> befh: scipy needs numpy build & installed before it will pip install
[15:57:11] <Ivo> they also need fancy fortan libraries and stuff to be fast if you compile them yourself
[15:57:26] <Ivo> thats why its easiest to get a pre-compiled version from someone
[15:57:41] <Ivo> befh: pacman should work
[15:58:08] <befh> then what do I need to do with the --system-site-packages virtualenv
[15:58:10] <befh> ?
[15:58:26] <Ivo> add that flag when you make a virtualenv
[15:58:39] <Ivo> and it will include your system packages which will include numpy & scipy n stuff
[15:59:01] <befh> ah, so it just allows access to everything that's already there.
[15:59:28] <befh> If I install a newer version within the virtualenv, will it override or conflict?
[15:59:44] <Ivo> should override
[16:00:04] <befh> nice
[16:01:09] <befh> my compiling on other packages is slow as sh*t. Thank god for repos.
[18:45:15] <mugwump> Hmm, binary wheels are badly distinguished
[18:45:47] <mugwump> $(uname -srm) might have been useful in the 90's, but something more like:
[18:46:06] <mugwump> $(lsb_release -si)-$(lsb_release -sc)-$(gcc -dumpmachine)
[18:46:12] <mugwump> would be better these days
[18:54:11] <DanielHolth> who designed those seriously
[18:54:31] <DanielHolth> I was thinking of just taking a cryptographic hash of all the linked libraries
[18:55:04] <DanielHolth> put that in the wheel issue tracker
[18:55:26] <DanielHolth> one of the goals for the next version is to include the OS name instead, although I think it would still be close-but-no-cigar
[18:55:43] <mugwump> I think LSB release is probably good enough for most folk
[18:55:59] <mugwump> It would need a fall-back for those nerds on non-LSB Linuxes (and non-Linux)
[18:56:24] <DanielHolth> is lsb real? I thought it was just something that you linked to if you were a magical loki game developer
[18:56:30] <DanielHolth> but otherwise really hard to use
[18:57:09] <mugwump> It's supported by all the major distros
[18:57:12] <DanielHolth> hm
[18:57:23] <DanielHolth> apart from the standard versions of important shared libraries?
[18:57:25] <mugwump> maybe the acronym is overloaded
[18:57:29] <DanielHolth> probably
[18:57:41] <DanielHolth> great tool, I'm always hunting for /etc9/something_release
[18:57:55] <mugwump> yeah, it's designed to fix that
[18:58:32] <DanielHolth> I get RedHatEnterpriseServer-Santiago-x86_64-redhat-linux and Ubuntu-trusty-x86_64-linux-gnu
[18:59:16] <mugwump> wow, they don't compromise on that system name
[18:59:52] <mugwump> Is github.com/pypa/pip/issues the right place?
[19:00:16] <DanielHolth> it would work
[19:00:24] <DanielHolth> bitbucket.org/pypa/wheel
[19:00:39] <mugwump> oh yeah, mercirual
[19:10:41] <DanielHolth> https://wiki.linuxfoundation.org/en/Book/HowToDevel
[20:15:09] <jakob1> Can I make pip not check the syntax of my code before installing? I'm getting "SyntaxError: invalid syntax" on .py files not meant to be executed
[20:15:21] <jakob1> they are templates for a django project to be parsed and edited by code
[20:47:08] <dstufft> jakob1: pip isn't checking the syntax, it's attempting to byte compile all of the .py files
[20:47:18] <dstufft> you can just ignore the output, or give them a different ext
[21:18:22] <jakob1> dstufft: sweet thanks :)
[22:48:59] <sl33k_> I get this error "pkg_resources.DistributionNotFound: pip==1.0.2" when I run pip install gunicorn. Any thought?
[23:30:19] <ldiamond> Alright, I'm getting 'git config remote.origin.url failed with error code 1'. I've had problems with this for ages now...
[23:30:44] <ldiamond> I created a virtualenv, under web-env directory and a pyramid project under web directory.
[23:30:54] <ldiamond> the web directory is a git repo.
[23:31:26] <ldiamond> after running 'python setup.py develop' in web, it adds that path to easy-install.pth
[23:31:43] <ldiamond> From then on, 'pip freeze' crashes because I have no remote url.
[23:40:50] <datakid> is there a reverse function for "pip show" ie, doesn't return a list dependencies but shows packages that require this package