Log file Viewer

[10:23:05] <wesleymason> My PyPI weirdness continues, now bootstrap.py can't find buildout: https://gist.github.com/1stvamp/5669352

[10:25:17] <mgedmin> wesleymason, hopefully it was this: http://mail.python.org/pipermail/distutils-sig/2013-May/020927.html

[10:25:33] <mgedmin> (and in the other thread: http://mail.python.org/pipermail/distutils-sig/2013-May/020926.html)

[10:26:22] <wesleymason> mgedmin: unfortunately getting this right now, even rebuilt the entire vm to make sure any egg caches were cleared

[10:37:15] <mgedmin> you may want to send an email to the list

[10:48:40] <wesleymason> Aye, going to now

[11:22:19] <wesleymason> Subscribe form for distutils-sig is erroring

[12:07:35] <dstufft|chop> Anyone in here one of the folks having problems with buildout + PyPI atm?

[12:08:55] <mgedmin> wesleymason is here

[12:09:02] <mgedmin> I had problems earlier, but don't see any at the moment

[12:09:14] <mgedmin> well, travis keeps not finding zope.interface, but that might be a travis network issue

[12:09:19] <mgedmin> and retries work

[12:12:13] <dstufft|chop> If anyone can get me a verbose output of it not working that'd be awesome. easy_install seems to work for me (one of the errors on the mailing list). I'm on a laptop in the OR waiting room so I'm missing a lot of my tools ATM

[12:12:21] <dstufft|chop> https://gist.github.com/dstufft/5669826

[12:12:29] <dstufft|chop> Is what I see trying to install zc.buildout

[12:16:37] <mgedmin> hm, I can still reproduce this:

[12:16:43] <mgedmin> curl -I -H 'Accept-Encoding: identity' https://pypi.python.org/simple/zodbbrowser/

[12:16:48] <mgedmin> gives me Content-encoding: gzip

[12:17:08] <mgedmin> either I misspelt the the request header, or the CDN is still misconfigured

[12:17:38] <mgedmin> shame my laptop crashed and I don't have xterm scrollback with actual buildout HTTP request dumps ...

[12:18:03] <mgedmin> oh, hey, I can reproduce the actual buildout failure again

[12:19:51] <dstufft|chop> I'm really sorry about this btw :( During testing I wasn't hitting the CDN with anything capable of gziping I guess so it never happened

[12:21:09] <mgedmin> here's the full tcp dump: https://gist.github.com/mgedmin/5669877

[12:21:13] <wesleymason> dstufft|chop: hey if you're in the OR waiting room you have more to be concerned about than failing eggs :)

[12:23:50] <mgedmin> curl -I -H 'Accept-Encoding: identity' https://pypi.python.org/simple/zodbbrowser/ gives me gzip

[12:24:10] <mgedmin> curl -I -H 'Accept-Encoding: identity' https://front.python.org/simple/zodbbrowser/ gives me a 503 Service Unavailable -- did I get the hostname wrong?

[12:24:34] <mgedmin> oh, duh

[12:24:36] <mgedmin> curl -I -H 'Host: pypi.python.org' -H 'Accept-Encoding: identity' http://front.python.org/simple/zodbbrowser/

[12:24:39] <mgedmin> works

[12:24:51] <mgedmin> (and no gzip)

[12:25:04] <mgedmin> curl -I -H 'Host: pypi.python.org' http://front.python.org/simple/zodbbrowser/ also works (and no gzip)

[12:26:12] <dstufft|chop> I wonder if there's some sort of overlap in the Vary: Accept-Encoding hrm

[12:26:37] <dstufft|chop> can't think of a good word for it, something that's making it think identity ~= something that has gzip

[12:29:21] <dstufft|chop> oh interesting

[12:29:39] <dstufft|chop> curl -I -H 'Accept-Encoding: identity' https://pypi.python.org/simple/pep8/

[12:29:46] <dstufft|chop> returns gzip, but doesn't have the Vary header

[12:29:59] <mgedmin> sorry, I tried this outside of a VM and had http_proxy set to my local squid

[12:30:01] <dstufft|chop> wonder if I messed up the purge all

[12:30:15] <dstufft|chop> I was doing it from my phone so maybe I hit the wrong purge option

[12:30:19] <mgedmin> http_proxy= curl -I -H 'Host: pypi.python.org' http://front.python.org/simple/zodbbrowser/|grep Vary:

[12:30:25] <mgedmin> gives me Vary: Accept-Encoding

[12:30:36] <dstufft|chop> and Content-encoding: gzip ?

[12:30:43] <mgedmin> no, content-encoding

[12:30:48] <mgedmin> front.python.org never gave me gzip

[12:30:56] <mgedmin> Cache-Control: max-age=3600

[12:31:01] <dstufft|chop> oh oops missed that was front.python.org

[12:31:11] <mgedmin> if you added Vary more than one hour ago, the CDN ought to have caught up?

[12:31:45] <dstufft|chop> ah yea that's true

[12:32:08] <dstufft|chop> wonder if gzip_vary on; in nginx isn't enough to get it to add the Vary headers in every situation

[12:32:39] <dstufft|chop> PyPI does it's own gziping atm

[12:32:45] <mgedmin> heyyyy

[12:32:45] <mgedmin> http_proxy= curl -I -H 'Host: pypi.python.org' -H 'Accept-Encoding: gzip' http://front.python.org/simple/zodbbrowser/

[12:32:52] <mgedmin> gives Content-encoding: gzip, but no Vary!

[12:32:59] <dstufft|chop> ugh

[12:33:06] <dstufft|chop> I bet that's it then

[12:33:17] <dstufft|chop> Now I need to see if I hae my SSH key here

[12:38:49] <dstufft|chop> of course not

[12:41:12] <wesleymason> always the way

[12:48:03] <dstufft|chop> oh nevermind

[12:48:07] <dstufft|chop> I'm just slow in the head

[12:48:21] <dstufft|chop> Forgot my wifes laptop has a different username, of course i'm getting pubkey denied

[12:48:29] <dstufft|chop> I just thought it was an old ssh key

[12:48:48] <MrTopf> hi there

[12:55:26] <dstufft|chop> curl -I -H 'Host: pypi.python.org' -H 'Accept-Encoding: gzip' http://front.python.org/simple/zodbbrowser/ HTTP/1.1 200 OK Server: nginx/1.1.19 Date: Wed, 29 May 2013 12:54:59 GMT Content-Type: text/html; charset=utf-8 Content-Length: 694 Surrogate-Key: simple pkg~zodbbrowser Strict-Transport-Security: max-age=31536000 Cache-Control: max-age=3600 Cache-Control: public Vary: Accept-Encoding Connection: Keep-Alive Content-Encodi

[12:55:30] <dstufft|chop> that looks better

[12:55:34] <dstufft|chop> let me purge the cache again

[12:56:58] <mgedmin> worksforme

[12:57:11] <mgedmin> (in the meantime someone released distribute 0.6.45)

[12:58:10] <dstufft|chop> ok deployed

[12:58:21] <dstufft|chop> and purged

[12:58:32] <dstufft|chop> we have a double Accept-Encoding header in the identity case

[12:58:37] <dstufft|chop> but I think that won't break anything

[12:58:40] <dstufft|chop> I can fix that latter

[12:59:57] <mgedmin> double Vary, you meant?

[13:00:16] <mgedmin> heh, I remember when sourceforge used to emit a double Content-Type (or was it Content-Length?)?

[13:00:25] <mgedmin> and that broke buildout

[13:00:28] <MrTopf> let me check my problem again

[13:00:45] <aclark> MrTopf!

[13:00:53] <MrTopf> yay, zc.recipe.egg is being found again

[13:01:09] <MrTopf> hey aclark, mgedmin

[13:01:15] <MrTopf> and thanks for fixing, dstufft|chop!

[13:01:38] <MrTopf> lets hope that buildouts are again repeatable now :-)

[13:02:03] <dstufft|chop> mgedmin: Vary: Accept-Encoding, Accept-Encoding

[13:02:21] <dstufft|chop> MrTopf: No problem, sorry it got broke in the first place.

[13:03:52] <MrTopf> well, stuff sometimes breaks when you try to improve it. no reason not to improve it though :-)

[13:04:07] <MrTopf> (of course maybe more relevant when it's a services like pypi)

[13:04:53] <dstufft|chop> Eventually I want to get some functional tests against PyPI so we have something to test changes with

[13:05:02] <dstufft|chop> right now it's basically "make change, try it out"

[13:05:28] <dstufft|chop> We have testpypi but hardly anyone uses that, so it tends to be whoever made the change pokes at it on testpypi, sees it works, deploys to pypi

[13:07:19] <dstufft|chop> Heh, that's hardly needed but much appreciated :)

[13:07:39] <dstufft|chop> Hopefully now all the issues with the CDN is ironed out and folks can just enjoy the faster downloads :)

[13:11:31] <MrTopf> btw, making the search field on pypi autofocus when entering the site, would be cool :-)

[13:12:30] <dstufft|chop> yea I have a lot more I want to do to PyPI. Now that I figured out how to javascript with zope.pagetemplates that shouldn't be hard to do

[13:12:54] <dstufft|chop> might just do that now

[13:13:06] <MrTopf> that thing would only be an additional "autofocus" attribute on the input field

[13:13:36] <mgedmin> no temptation to rewrite the templates to mako? or at least chameleon.zpt? or just stop using the insane <?xml?> mode of zope.pagetemplate?

[13:13:48] <MrTopf> or jinja or .... :-)

[13:14:02] <dstufft|chop> I have temptation to rewrite the whole rotten mess

[13:14:08] <dstufft|chop> but one thing at a time

[13:14:32] <MrTopf> I also would have lots of things I could rewrite...

[13:14:35] <dstufft|chop> CDN was high on my list because a lot of people were getting _horrible_ download performance

[13:14:51] <mgedmin> yes

[13:15:02] <dstufft|chop> e entually the CDN will also be able to serve stale content in the event the backend goes down

[13:15:06] <mgedmin> it was extremely painful, until I set up a local caching proxy (squid) on my laptop

[13:15:08] <dstufft|chop> I don't have that configured yet though

[13:15:26] <mgedmin> the CDN is extremely appreciated!

[13:15:55] <MrTopf> indeed

[13:16:04] <dstufft|chop> mgedmin: Are you located in someplace other than the US? It seemed to hit non US folks especially hard (download slodowns)

[13:16:10] <mgedmin> EU

[13:16:10] <dstufft|chop> slowdowns

[13:16:25] <dstufft|chop> yea EU seemed to have a bad route to the OSOUL or something

[13:17:45] <maurits> dstufft|chop: all seems fine now. Thanks!

[13:18:14] <J1m> Much thanks dstufft|chop !

[13:19:31] <dstufft|chop> maurits: J1m No problem :) Sorry it was an issue at all. Apparently gzip didn't get exercised very well in testing

[13:27:35] <dstufft|chop> MrTopf: There you go, autofocus="autofocus" is now on PyPI

[13:28:32] <MrTopf> you rock! :-)

[13:29:22] <dstufft|chop> :)

[13:29:30] <dstufft|chop> Editing things with no syntax highlighting is haard

[13:33:14] <mgedmin> sudo apt-get install vim :-)

[13:33:43] <J1m> Now you're trying to make it really hard.

[13:35:37] <dstufft|chop> Somehow I don't think sudo apt-get is gonna give me what I want on a macbook :), Using vim atm though but I don't have a .vimrc setup so it's all black and white (and for some godawful reason macs default to a white background)

[13:37:16] <mgedmin> (to get a sane-ish vim without my entire .vimrc)

[13:38:00] <mgedmin> and occasionally github's through-the-web editing UI is nice

[13:38:17] <mgedmin> reminds me of Zope 2 a bit :)

[13:38:49] <MrTopf> well..