PMXBOT Log file Viewer

Help | Karma | Search:

#pypa logs for Thursday the 12th of February, 2015

(Back to #pypa overview) (Back to channel listing) (Animate logs)
[09:54:42] <nanonyme> ionelmc, I meant relocatable core Python across operating systems. It's acceptable directory must be the same everywhere
[09:54:56] <nanonyme> s/operating/Windows operating/
[09:55:34] <ionelmc> nanonyme: worth checking how the PortablePython devs did it
[09:57:12] <nanonyme> ionelmc, the process seemed rather poorly documented and they didn't seem to have version control. Also their thing requires installer, mine's just a zip you extract to a place and you have ready Python
[09:57:32] <nanonyme> My hunch is 99% of what they did was creating an installer and vendoring packages
[09:58:10] <nanonyme> (also the project is dying and they're stuck to a pretty old version of 2.7)
[10:02:21] <linovia> Hi
[13:30:20] <linovia> Hi ! Is there a tool to crawl the dependencies contraints and raise all the version incompatibilities ? Pip doesn't raise an error when there are excluding constraints on a package version
[13:36:56] <ofcourseistilllo> Not sure there is such a tool, since pip doesn't do any dependency resolution. I ended up writing something to detect 'conflicts' but my tool's definition of a conflict may not match pip's - depends how you interpret the requirements.
[13:41:04] <linovia> I'm a bit surprised pip doesn't check the deps versions
[13:43:49] <xafer> same here, we have our little checker
[13:47:47] <ionelmc> interesting
[13:47:51] <ionelmc> is it opensource?
[13:49:22] <straycat> Ahh but it's not just pip, it's setuptools setup_requires as well
[13:50:42] <linovia> setuptools will detect the conflicts
[13:51:06] <straycat> It doesn't
[13:51:36] <xafer> no, not opensource
[13:51:39] <linovia> actually, pip install -e. worked while python setup.py install didn't
[13:51:52] <straycat> or, perhaps not in all cases, maybe that's because it depends on the definition of conflict
[13:55:19] <straycat> linovia, the code I wrote for this is git.baserock.org/cgi-bin/cgit.cgi/baserock/baserock/import.git/tree/baserockimport/exts/python.find_deps sadly it's an extension in another tool we have, it could easily be made stand alone ofcourse
[13:55:43] <doismellburning> .win 81
[13:55:45] <doismellburning> sorry
[14:02:28] <linovia> straycat: thanks for sharing !
[14:05:07] <straycat> linovia, Have to point out that it's just a patched version of pip
[14:05:29] <straycat> There's an open pull request for the change, but it hasn't been merged, probably needs changing before it can be too
[14:06:32] <straycat> ( github.com/pypa/pip/pull/2371 )
[14:09:45] <straycat> s/'s just/ uses/
[14:09:46] <straycat> sorry
[16:51:40] <raxelo> hello all, do I understand it correctly that now default cache implementation of pip doesn't allow to reuse downloaded between different virtual environments ? I found documentation which tells me to use —download first and then install from it using (—find-links), but, so far do not know how to make it work with TOX as it require single installation command to be used per package
[16:52:31] <dstufft> raxelo: in pip 6.0+ the cache is per user by default
[16:52:54] <dstufft> it caches all HTTP access based on the cache headers and some internal logic
[16:54:23] <raxelo> dstufft: yes, that is correct. but if I installed `lolcat` in venv A, for instance. Then installing the same `lolcat` to the venv B, will not reuse already downloaded file ?
[16:55:28] <dstufft> raxelo: it should reuse the already downloaded file as long as the already downloaded file is acceptable, but for instance if venv B is a Python 3.4 venv and venv A is a python 2.7, you might have a python2 only wheel and a python3 only wheel and thus two different downloads because it's different files
[16:55:43] <dstufft> raxelo: what's the exact version of pip you're using?
[16:55:47] <dstufft> in both venvs
[16:56:21] <raxelo> 1) I use pip 6.0.8 (python 2.7) in both venvs. Both venvs are created using TOX.
[16:56:51] <dstufft> I ask because prior to 6.0.7 there was an issue where switching between different versions of of Python would cause the cache to get invalidated
[16:57:00] <dstufft> but if you're using 6.0.7+ everywhere that shouldn't be a problem anymore
[16:57:53] <raxelo> the thing, that I cannot find the place where all these downloaded packages are saved.
[16:58:15] <dstufft> What OS
[16:58:29] <raxelo> Based on this document pip.pypa.io/en/latest/user_guide.html#fast-local-installs I understood that I need additional command to download in shared folder first
[16:58:42] <raxelo> my os is OS X 10.9.5
[16:58:51] <dstufft> raxelo: that document is if you don't want to hit PyPI at all, for any reason
[16:59:59] <dstufft> on OSX it'll store the cached things in ~/Library/Caches/pip/http by default, but you're unlikey to be able to tell what's in there, it doesn't store them with file names that rare meaningful to humans
[17:00:06] <raxelo> maybe the problem that my server (own) used in —find-links for particular packages doens't have required headers for the proper PIP caching
[17:00:15] <dstufft> ah
[17:00:17] <dstufft> yes that's a thing
[17:00:23] <dstufft> it respects the Cache-Control header
[17:00:43] <dstufft> (With the exception that for fetching the list of packages it overrides the Cache-Control header to be at most 10 minutes)
[17:00:59] <dstufft> but for fetching the package files themselves it just flat out respects the cache-control header
[17:01:10] <dstufft> or the expires header
[17:01:35] <dstufft> it'll also make conditional HTTP requests after the cached item has expired if there is an Etag header
[17:03:45] <raxelo> oook, thank you. why it can be that `~/Library/Caches/pip/http` contains only some small files while packages downloaded are more than 10mb. I expect it contains cached files, maybe the name is different but at least size of cache folder should be relevant
[17:04:03] <Guddu__> I am trying to install pip on a server without internet. I downloaded and FTPed get-pip.py and pip-6.0.8-py2.py3-none-any.whl . . Both are in the same directory. I ran python get-pip.py and i get this error. dpaste.com/3YY1F0X
[17:04:14] <Guddu__> Does it still require internet connectivity?
[17:04:37] <dstufft> raxelo: are you only installing from your own server or from PyPI itself?
[17:05:13] <dstufft> Guddu__: python get-pip.py --no-index --find-links /path/to/directory
[17:05:25] <Guddu__> Thanks dstufft
[17:05:48] <raxelo> dstufft: from both, command line is like "pip install -f http://ownrepo/python, so our custom packages are installed from `ownrepo` while others are fetched from PyPI
[17:06:05] <dstufft> raxelo: the ones from PyPI should certainly be cached then
[17:06:33] <Guddu__> Worked just awesome :)
[17:06:49] <raxelo> dstufft: thank you a lot for this explanations. will dig more
[17:09:46] <raxelo> I directed cache to own folder and its size 16k
[17:11:17] <Guddu__> dstufft, If i want to install a python package called lxml that I have downloaded locally in the file lxml-3.4.2.tar then can i do that using pip and specifying the same options --no-index --find-links ?
[17:11:34] <dstufft> Guddu__: ya
[17:18:26] <Guddu__> I am installing now and the process seems to be waiting for something. I am not sure. cc1 process i seen as top CPU consuming process. dpaste.com/2FRQTR9
[17:19:02] <Guddu__> Oh it finished. Just took way too long. But finished finally :-)
[17:19:13] <Guddu__> Took 7 minutes
[17:23:36] <Guddu__> Now i am downloading reportlab using a locally downloaded tarball. I get an error. Trace is at dpaste.com/2P8F9QF . . it basically complains about setuptools I am not sure why.
[17:23:36] <Guddu__> Could not find any downloads that satisfy the requirement setuptools>=2.2 (from reportlab==3.1.44)
[17:39:48] <dstufft> Guddu__: it requires a version of setuptools >=2.2
[17:40:02] <dstufft> you have the old distribute fork, version 0.6.10
[17:40:07] <dstufft> 0.6.10 is not >= 2.2
[17:41:12] <Guddu__> dstufft, I have been told that running pip as root on RHEL6.5 can break things :-(
[17:41:43] <dstufft> Guddu__: copr.fedoraproject.org/coprs/pypa/pypa
[17:42:02] <dstufft> that should let you get the latest pip, virtualenv, setuptools, and wheel installed via rpm
[17:42:28] <dstufft> oh
[17:42:32] <Guddu__> Thanks
[17:59:31] <Guddu__> dstufft, I get this error each time i execute pip to install something. Is this something to worry about?
[17:59:32] <Guddu__> DeprecationWarning: Parameters to load are deprecated. Call .resolve and .require separately.
[18:01:01] <dstufft> Guddu__: Nah, it's just a setuptools deprecation
[18:01:10] <Guddu__> Thanks dstufft