PMXBOT Log file Viewer

Help | Karma | Search:

#pypa-dev logs for Monday the 16th of April, 2018

(Back to #pypa-dev overview) (Back to channel listing) (Animate logs)
[15:03:04] <EWDurbin> https://twitter.com/EWDurbin/status/985896204184838144
[15:04:15] <lghampton> EWDurbin: Yay! :D
[15:04:23] <lghampton> Happy prod day, everyone!
[15:19:41] <sumanah> We know about the redirect issue and are fixing it -- thanks for the reports, all
[15:20:41] <sumanah> !logs
[15:20:41] <pmxbot> http://kafka.dcpython.org/channel/pypa-dev
[15:22:29] <sumanah> redshadowhero: no problem, we're the ones who made the typo on the status page :)
[15:22:45] <redshadowhero> sumanah: well, thanks for the heads up.
[15:22:49] <sumanah> :)
[15:23:12] <redshadowhero> But, am I crazy, or is anyone else having issues with pip doing too many redirects?
[15:23:13] <lghampton> sumanah: Good morning!
[15:23:26] <sumanah> redshadowhero: yep, we are working on it, thanks!
[15:23:33] <sumanah> hi lghampton
[15:23:38] <redshadowhero> oh thank goodness.
[15:23:56] <redshadowhero> There's always that moment when I'm super paranoid that something is really screwed up in my environment/network/setup/whatever.
[15:24:09] <sumanah> http://status.python.org/incidents/1y1f44q6srh2 -- we updated the statuspage so more people know we're working on it :)
[15:24:15] <sumanah> redshadowhero: I'm totally right there with you :)
[15:25:06] <sumanah> lghampton: can you watch the warehouse, pip, and virtualenv repositories and reply to new issues about the redirect and point people to http://status.python.org/incidents/1y1f44q6srh2 you can subscribe to this incident to get an update when it's fixed ?
[15:25:15] <sumanah> lghampton: like https://git.io/vpfgO
[15:25:31] <ardzoht> anyone with this exception message? 'pip._vendor.requests.exceptions.TooManyRedirects: Exceeded 30 redirects.'
[15:25:38] <sumanah> ardzoht: yup! http://status.python.org/incidents/1y1f44q6srh2 you can subscribe to this incident to get an update when it's fixed
[15:25:44] <sumanah> thanks for the report ardzoht
[15:25:59] <lghampton> sumanah: Yes, let me take a look at the issues
[15:27:08] <ardzoht> thanks guys! will subscribe to the updates
[15:27:33] <cdunklau> sumanah: thank god for the issues page, eh? :D
[15:27:37] <sumanah> :)
[15:27:54] <sumanah> I'm grateful we have so many users who actually report issues instead of thinking it's someone else's problem. :)
[15:28:26] <pmac> I was going to comment on https://github.com/pypa/warehouse/issues/3702 but it's now locked (which makes sense). But I did fix the issue by upgrading pip to 10.0.0
[15:28:31] <pmac> in case that's not already known
[15:28:39] <pmac> was using 9.0.3 and had the issue
[15:28:44] <cdunklau> sumanah: oh i meant the status.python.org incident page
[15:28:50] <cdunklau> but yeah bug reports are good
[15:28:59] <sumanah> HUH. INTERESTING. dstufft EWDurbin ^ for at least one user, upgrading to pip 10.0.0 fixes the redirect problem
[15:29:09] <EWDurbin> it is intermittent
[15:29:18] <sumanah> oh ok
[15:29:20] <EWDurbin> so that may be conicidene
[15:29:22] <sumanah> got it
[15:29:23] <EWDurbin> (sp)
[15:29:23] <pmac> haven't tried that in my failing CI docker build, but it did fix it for me locally
[15:29:44] <sumanah> pmac: IMO waiting ~10 min would probably be a reasonable step, I know Ernest is working on fixing the prob right now
[15:29:45] <pmac> thanks all!
[15:29:52] <sumanah> thanks pmac !
[15:30:18] <pmac> great. I'm confident it'll be fine. just wanted to add that tidbit incase it's useful. best of luck.
[15:30:23] <cdunklau> sumanah: i'll use your phrasing to point people in #python at that page
[15:30:30] <sumanah> awesome thanks cdunklau
[15:31:45] <sumanah> lghampton: https://github.com/issues?q=user%3Apypa+is%3Aopen is a way to look at the queue of new issues in all pypa projects
[15:32:18] <sumanah> lghampton: it's in newest-first order. If you keep refreshing that you'll see any new stuff that comes in (I think only some of the repos' issues show up via bot in this channel)
[15:33:13] <cdunklau> sumanah: got a different exception report from #python: 503 Server Error: Backend is unhealthy
[15:33:30] <cdunklau> sumanah: should they make new issues for different errors?
[15:34:39] <cooperlees> GG all on getting pypi.org live :D
[15:35:09] <lghampton> sumanah: I see, thank you
[15:36:30] <redshadowhero> I just managed to `pip install --upgrade pip` and then my install worked. I have another box that I'll test an arbitrary package in with an older version of pip just for another sanity check.
[15:36:52] <sumanah> redshadowhero: what version of pip are you on now? 10.0.0 just came out
[15:38:43] <redshadowhero> Well, on the first box, it's now 10.0.0. On my debian box, it's 1.5.6
[15:38:46] <redshadowhero> ...wow, that's old.
[15:39:46] <redshadowhero> I tried to upgrade pip on the debian box, but it looks like 404s now.
[15:40:04] <ronny> oO
[15:40:15] <cooperlees> pip 1.5.6 ?
[15:40:22] <cooperlees> Yeah I wouldn't expect that to work anymore
[15:40:30] <cooperlees> < 8, prob gonna have a bad time
[15:40:43] <mgedmin> https://packages.debian.org/search?keywords=python-pip
[15:40:53] <mgedmin> jessie had 1.5.6, stretch (the current stable) has 9.0
[15:41:04] <redshadowhero> Well, it installed something last night, and I was able to get speedtest-cli installed. It's probably just what the debian repos had for jessie.
[15:41:06] <ronny> whats just now happening with pypi- virutalenv valls are commiting seppoku on me
[15:41:43] <sumanah> Hi ronny - we're upgrading PyPI
[15:41:43] <sumanah> Hi! We are working on it. http://status.python.org/incidents/1y1f44q6srh2 you can subscribe to this incident to get an update when it's fixed
[15:43:11] <cooperlees> There is always `curl https://bootstrap.pypa.io/get-pip.py -o get-pip.py && python3 get-pip.py`
[15:44:29] <ronny> sumanah: thanks for that link, i didnt correctly identify it on the status page and missed
[15:44:49] <sumanah> ronny: totally understand :)
[15:44:52] <sumanah> thanks for the report
[15:46:23] <ronny> sumanah: im still seeing tonns of 404's on the files front tho (is there a expectation when things are de-escalating
[15:46:35] <ronny> or should i switch to perl just for today ^^
[15:47:01] <sumanah> ronny: how about waiting about 15 min :)
[15:47:12] <cooperlees> FYI - I saw no errors from my bandersnatch instance from the cut over - Last ran @ ~07:35am pacific
[15:47:27] <ronny> thats like 30 internet eternities omg ;P
[15:47:28] <sumanah> ronny: if you look at the update on status.python.org right now you see we've fixed one problem and are working on another
[15:48:22] <ardzoht> sumanah: thanks for the updates, we're still getting 404's but is something we should expect for the packages refreshing
[15:48:54] <ronny> sumanah: oh well - we had it coming - too much on pypi is too volunteery (but its a critical piece of infra for many of us)
[15:49:02] <sumanah> ardzoht: we're working on it now so we'll see maybe in the next 10 min?
[15:49:20] <sumanah> ronny: donate.pypi.org is probably live :) thanks for the kind words about the volunteer work
[15:49:47] <ronny> sumanah: i got enough of that fun for pytest myself ^^
[15:51:38] <nicoulaj> looks godd to me now
[15:52:52] <davisagli> worked for me now too
[15:53:18] <sumanah> if any of y'all wanna help, search Twitter for pypi and reply to them too
[15:57:23] <sumanah> Today we launch the new PyPI and it's a little bumpy -- this is the first major upgrade to PyPI in more than a decade. You may be interested in this article I wrote about the new PyPI https://lwn.net/SubscriberLink/751458/81b2759e7025d6b9/
[16:00:54] <thea> interesting, 503 when installing packages on Travis
[16:00:55] <thea> https://travis-ci.org/pypa/python-packaging-user-guide/builds/367230976?utm_source=github_status&utm_medium=notification
[16:01:04] <sumanah> thea: you saw status.python.org?
[16:01:19] <thea> yeah
[16:01:46] <thea> checked it when I saw the redirect loop
[16:07:29] <ronny> tbh, im glad im not part of that vlunteer team doing the deploy, i cant even imagine the stress
[16:09:35] <sumanah> ronny: it's mostly volunteers most of the time -- in this case we got a limited award from Mozilla which is the reason this is possible https://pyfound.blogspot.com/2017/11/the-psf-awarded-moss-grant-pypi.html
[16:10:13] <ronny> sumanah: im roughlyaware of the history - im a regular here ^^
[16:10:20] <sumanah> oh ok
[16:10:21] <sumanah> sorry
[16:10:52] <ronny> do i recall correct that you where brought in as part of the grant?
[16:11:11] <ronny> s/as part of/in relation to/
[16:11:29] <sumanah> I was one of the people who applied for the MOSS award
[16:11:40] <sumanah> I co-wrote the proposal
[16:11:47] <ronny> i see - great ^^
[16:12:41] <ronny> hmm, the reactions of people i post the update links to are neat
[16:13:09] <ronny> like complaint -> status link * rollout not -> rad i said nothing
[16:18:00] <newnenw> my installs are on fire ;_;
[16:19:16] <thea> newnenw: are you getting download errors or something else? See https://status.python.org
[16:20:23] <newnenw> The last error in the stack is `pip._vendor.requests.packages.urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='files.pythonhosted.org', port=443): Max retries exceeded with url: /packages/20/d7/04a0b689d3035143e2ff288f4b9ee4bf6ed80585cc121c90bfd85a1a8c2e/setuptools-39.0.1-py2.py3-none-any.whl (Caused by ResponseError('too many 503 error responses',))`
[16:20:37] <newnenw> It's 503 rather than 404
[16:20:50] <sumanah> newnenw: I think that's still because of the cutover -- we are working on it. thanks for the report
[16:20:57] <thea> ^
[16:21:18] <newnenw> No worries, I'll cheer for you guys quietly from the sidelines \o/
[16:21:22] <sumanah> https://status.python.org/incidents/1y1f44q6srh2 this is the incident you can subscribe to, to get notifications when it's fixed
[16:21:24] <sumanah> thank you newnenw
[16:21:25] <sumanah> :)
[16:21:41] <newnenw> Thanks for your hard work, looking forward to the new infrastructure
[16:21:51] <sumanah> newnenw: if you want, you can search your favorite social media site for "pypi" and help us by replying to a few folks with this info :)
[16:21:55] <sumanah> you're very kind
[16:22:30] <zzzzx> seeing repeated HTTP 503 for https://files.pythonhosted.org/packages/22/66/9dcf61c1756a0de1ac86547a0fdb8c8641e345049cbf6f18c2ad6dab69d0/botocore-1.10.4-py2.py3-none-any.whl
[16:22:48] <JosefAssad> this is warehouse being put in production, if I understand correctly?
[16:22:48] <sumanah> thanks for the report zzzzx -- https://status.python.org/incidents/1y1f44q6srh2 this is the incident you can subscribe to, to get notifications when it's fixed
[16:22:55] <zzzzx> :thumbsup:
[16:23:11] <sumanah> Yes JosefAssad
[16:23:20] <JosefAssad> fantastic
[16:23:35] <JosefAssad> We're actually going to look at deploying our own warehouse instances (perhaps)
[16:23:35] <apollo13> haha, just clicked the subscribe button -- subscribe via text message; wth would I wanna do that :D
[16:23:43] <apollo13> JosefAssad: why warehouse?
[16:23:51] <apollo13> bandersnatch etc should suffice?
[16:23:52] <JosefAssad> in-house package repo
[16:24:01] <apollo13> warehouse seems overkill
[16:24:04] <Yhg1s> JosefAssad: you probably dont' want all the Warehouse bells, whistles and weight.
[16:24:21] <sumanah> JosefAssad: https://pypi.org/help/#mirroring maybe?
[16:24:24] <JosefAssad> roger. Will look into bandersnatch
[16:24:36] <sumanah> or https://pypi.org/help/#private-indices
[16:24:41] <JosefAssad> sumanah: not quite. Lot of not-open packages we have
[16:24:52] <apollo13> or devpi
[16:25:22] <JosefAssad> yeah devpi looks good too
[16:25:43] <sumanah> JosefAssad: they're at #devpi in case you want to chat with them btw
[16:26:05] <JosefAssad> got it :) It's still pretty far away in our roadmap, but the tips are appreciated
[16:26:10] <lghampton> JosefAssad: I've heard good things about devpi
[16:28:17] <ardzoht> sumanah: it works for us now, thanks guys
[16:41:09] <moldy> hi
[16:41:31] <sumanah> hi moldy
[16:45:18] <moldy> since today, pipenv is complaining about hash mismatches. i guess this is related to the pypi change? any hints on how to best resolve this?
[16:45:35] <sumanah> Hi moldy - what version of pip do you have installed?
[16:46:47] <moldy> sumanah: 9.0.3
[16:47:19] <sumanah> moldy: I don't know much about pipenv and will defer to others :)
[16:47:44] <moldy> sumanah: thanks anyway :)
[16:48:04] <sumanah> moldy: particular packages working versus not working?
[16:48:14] <zackkitzmiller> I also had pipenv issues this am, possibly related to the cutover.
[16:49:17] <cooperlees> what are the hashes of?
[16:49:21] <moldy> sumanah: pluggy==0.6.0 is the one that's not working
[16:49:33] <moldy> though i don't know if it is the only one or just the first one that errors
[16:49:58] <lghampton> moldy: what error are you getting?
[16:50:08] <moldy> lghampton: https://dpaste.de/K8Dm
[16:50:42] <newnenw> Thanks for your hard work in fixing the funky 503 errors. I can confirm I'm able to `setup.py install` again :D
[16:54:12] <lghampton> sumanah: Are we going to have a call at 1pm?
[16:54:13] <moldy> re-running `pipenv lock` works around the hash mismatch issue for me
[16:54:27] <sumanah> Hi lghampton - no, delaying it. Will PM
[16:55:25] <di_codes> moldy: looks like that project added more distributions recently: &lt;https://pypi.org/project/pluggy/#files&gt;
[16:56:05] <di_codes> (sorry, my client is mangling my links)
[16:57:00] <moldy> here's the faulty Pipfile.lock just in case it helps anyone: https://dpaste.de/RbxQ
[16:57:21] <moldy> re-running pipenv lock is good enough for me, no idea if others are affected
[16:59:35] <techalchemy> will have a bugfix release of pipenv out today, not sure what all is broken from the downtime
[16:59:37] <techalchemy> hopefully not too much
[17:13:58] <sumanah> lghampton: hey there -- got a moment to cross-post some announcements?
[17:14:04] <lghampton> sumanah: sure!
[17:14:31] <sumanah> lghampton: please take the text of https://blog.python.org/2018/04/new-pypi-launched-legacy-pypi-shutting.html and send both the text of the post, and a link to the post, to the python-announce email list https://mail.python.org/mailman/listinfo/python-announce-list
[17:14:58] <lghampton> will do
[17:15:02] <lghampton> sumanah: ^
[17:15:05] <sumanah> lghampton: AND, please also take the text of https://blog.python.org/2018/04/new-pypi-launched-legacy-pypi-shutting.html and send both the text of the post, and a link to the post, to the pypa-dev list and the distutils-sig list
[17:15:17] <lghampton> sumanah: ok
[17:17:57] <lghampton> sumanah: for this annoucement: https://blog.python.org/2018/04/new-pypi-launched-legacy-pypi-shutting.html
[17:18:08] <lghampton> should I leave the links inline, or make them footnotes?
[17:19:36] <sumanah> lghampton: leave them inline, I think.
[17:19:50] <lghampton> sumanah: ok
[17:22:55] <raydeo> should https://status.python.org/ update pypi.python.org to legacy.python.org now or is it going to be alive for only a couple weeks and not worth updating everywhere?
[17:24:19] <EWDurbin> raydeo: pypi.python.org will live on as a hostname for quite some time and may be independently broken.
[17:24:27] <EWDurbin> but you bring up a good point :)
[17:24:35] <EWDurbin> we should add a better tooltip/description for it
[17:24:53] <raydeo> sure, I'm also just making sure the operational status is for the right server
[17:28:18] <techalchemy> EWDurbin: hwo urgently do I need to make sure pipenv points everyone to the new hostname?
[17:28:23] <techalchemy> how*
[17:28:49] <EWDurbin> techalchemy... like medium priority? we won't be a be able to kill that hostname for some time
[17:28:52] <EWDurbin> likely on the order of years
[17:28:56] <EWDurbin> but hopefully sooner
[17:29:12] <techalchemy> ok, hopefully we can get pip10 integrated in a shorter timeline than 'years' lol
[17:29:50] <techalchemy> EWDurbin: regardin the json api on the new warehouse, does it still have the same caveats around dependency listings as the old one? what about for specific version endpoints
[17:30:02] <EWDurbin> what caveats are those?
[17:30:21] <techalchemy> I think you mentioned the old json api only listed the dependencies of the most recently uploaded version
[17:30:50] <EWDurbin> well it only lists them if they're provided
[17:30:56] <EWDurbin> as far as versions i can't remember
[17:30:59] <techalchemy> ok
[17:44:53] <sumanah> lghampton: have you already sent the post to the python announce list?
[17:45:30] <lghampton> sumanah: yes, a while ago
[17:46:14] <lghampton> sumanah: I didn't get a bounceback
[17:46:23] <sumanah> glghampton: ok. now please Submit https://blog.python.org/2018/04/new-pypi-launched-legacy-pypi-shutting.html news to The Changelog https://changelog.com/news/submit
[17:46:30] <lghampton> sumanah: sure thing
[17:48:06] <sumanah> thanks for the mailing list posts, the PyPUG PR, and the GitHub replies lghampton
[17:48:16] <sumanah> once you do the Changelog submission I think that's it for you for today :)
[17:48:26] <lghampton> sumanah: you're welcome :)
[17:48:37] <lghampton> sumanah: ok, sounds good
[17:52:13] <lghampton> sumanah: I posted the blog post at the Changelog
[17:52:22] <sumanah> Thanks lghampton
[17:52:34] <lghampton> sumanah: I will see you tomorrow for the meeting :)
[17:52:35] <sumanah> best wishes
[17:52:41] <lghampton> sumanah: thank you!
[17:52:43] <sumanah> lghampton: yeah, will let you know the new time once I sort it out
[17:53:21] <lghampton> sumanah: ok
[18:09:36] <davisagli> I’m not getting any search results on pypi.org. known issue?
[18:11:14] <thea> davisagli: it's not listed on status.python.org, do you mind filing an issue over at https://github.com/pypa/warehouse/issues ?
[18:13:43] <davisagli> thea: sure thing
[18:13:46] <sumanah> I second thea's request
[18:13:59] <sumanah> thea: actually do you have a moment to talk about search?
[18:14:06] <thea> thank you, davisagli. :)
[18:14:10] <thea> sure, sumanah.
[18:14:44] <sumanah> thea: do you think that we ought to do some SEO or something to make packaging.python.org show up higher in search results?
[18:15:20] <thea> possibly. The biggest thing we can do it ensure that other highly ranked pages link to it
[18:15:38] <sumanah> nod
[18:15:50] <sumanah> thea: so, same for https://mail.python.org/pipermail/python-announce-list/ and https://mail.python.org/mm3/archives/list/pypi-announce@python.org/ ?
[18:15:50] <thea> it is the top result for "python packaging" right now
[18:16:17] <thea> yep
[18:17:19] <thea> sumanah: actually there's several things we can do to pypug to improve how search engines see it. Can you file a general SEO bug on it? I'll try to take a look on Friday.
[18:17:27] <sumanah> thea: AWESOME. will do now
[18:17:36] <thea> Now that readme-renderer stuff is calmer I can switch back to pypug.
[18:19:15] <sumanah> Great!
[18:19:28] <sumanah> thea: filed as https://github.com/pypa/python-packaging-user-guide/issues/473
[18:19:37] <thea> great, thanks. :)
[18:20:07] <jackton1> pip-compile seems to be broken with pip10
[18:20:41] <sumanah> pradyunsg: ^
[18:21:14] <pradyunsg> I see my name.
[18:21:51] <pradyunsg> jackton1: file an issue over at pip-tools and mention me?
[18:22:25] <pradyunsg> Have you upgraded to the latest pip-tools?
[18:23:03] <sumanah> dstufft: hey, if we have a Warehouse phone call tomorrow at 12:30pm or 1pm ET, could you join that?
[18:27:18] <dstufft> sumanah: uhhh, I have a drs appointment thing at 11:30 tomorrow, probably can't make those sorry
[18:27:24] <sumanah> ok dstufft
[20:08:02] <techalchemy> hmmm pip no longer supports installing VCS dependencies without passing -e?
[21:30:06] <techalchemy> pf_moore: I assume you're busy but any idea how to get appveyor to move something if it gets stuck in 'queued' mode w/ nothing else pending?
[21:30:23] <techalchemy> (not urgent)
[21:30:52] <pf_moore> techalchemy: No, not really, I generally just wait. I think there's some sort of quota involved...
[21:31:08] <techalchemy> ok, that was my guess too
[21:31:15] <techalchemy> thanks
[21:48:44] <techalchemy> pf_moore: btw I think someone mentioned you might be interested in this: https://github.com/techalchemy/pythonfinder
[21:50:00] <pf_moore> techalchemy: wow, yeah, I've been meaning to do something like that for ages. I'll definitely take a look at it :-)
[21:50:20] <techalchemy> we needed it for pipenv (we aren't actually using it yet but that's why I wrote it)
[21:50:24] <techalchemy> I suspect lots of people need it
[21:51:45] <pf_moore> techalchemy: Yeah, I could see it being used in tox, virtualenv, nox, ... Having a uniform way of referring to Python versions would be awesome.
[21:52:47] <techalchemy> pf_moore: for sure, our code was just getting really messy/disjointed with regard to finding python in general, cleaning up the API just made a lot of sense because this is how we use it currently
[21:53:19] <techalchemy> I just assume that if you say '3' you mean 'the highest released version of python 3 installed on the system' so it would return 3.6.5 but not 3.7.0b3
[23:27:16] <techalchemy> hm still not building on appveyor
[23:27:51] <techalchemy> pf_moore: can you cancel our pending appveyor builds or something? idk what's going on with them but they're just sitting around
[23:28:09] <techalchemy> I dont think I can cancel anything
[23:45:01] <dstufft> it's probably just slow as shit
[23:45:07] <dstufft> appveyor doesn't build in parallel
[23:45:17] <dstufft> a PR I made awhile ago is jsut finally getting it's last build done
[23:45:24] <dstufft> no wait
[23:45:24] <dstufft> sorry
[23:45:25] <dstufft> wrong way
[23:45:31] <dstufft> is just finally starting it's first build
[23:45:40] <dstufft> https://github.com/pypa/pip/pull/5258