pmxbot IRC Log Viewer

[00:02:16] <qwcode> btw, the user guide updates just now were from pushing the "test service" button in github

[00:03:03] <dstufft> qwcode: lol

[01:10:59] <Alex_Gaynor> dstufft: can you ping me when the release is out?

[01:14:50] <dstufft> Alex_Gaynor: yea

[01:14:53] <dstufft> sorry it's taking so long

[01:14:59] <dstufft> I wanted to do a few things before release

[01:15:04] <Alex_Gaynor> dstufft: no worries man, thank you so much for doing this

[01:17:14] <dstufft> Alex_Gaynor: when is PyPy's next release, and if I make an ensurepip patch tonight can it be in it?

[01:17:37] <dstufft> or do you think we should wait for the distros to sort out how they are going to handle ensurepip in CPython

[01:18:23] <Alex_Gaynor> dstufft: our next release is probably next release, if you promise it won't break the world, you can get it in

[01:18:42] <Alex_Gaynor> next *week*

[01:18:43] <Alex_Gaynor> lol

[01:19:26] <dstufft> Alex_Gaynor: it won't break anything, it's self contained, but it might make distros mad at you right now as they have yet another thing to rm -rf until they figure out how to handle it

[01:19:44] <Alex_Gaynor> dstufft: That is definitely their problem

[01:19:57] <jimbaker> dstufft, in jython trunk soon - i'm hoping for next week to merge in my branch that fully supports ssl/select

[01:20:15] <dstufft> Alex_Gaynor: ok, then i'll try to make up a patch tonight

[01:20:16] <jimbaker> that basically gates beta 3 of jython

[01:20:22] <Alex_Gaynor> dstufft: <3 did I give you commit already?

[01:20:37] <dstufft> Alex_Gaynor: yea I think so, but I probably won't use it to commit this

[01:20:48] <jimbaker> which we can then give you a jar for

[01:20:51] <Alex_Gaynor> dstufft: you can do it in a branch, most of us just work in branches in the main repo

[01:20:57] <dstufft> Alex_Gaynor: ok

[01:21:27] <dstufft> jimbaker: our CI can handle releases or the dev branch

[01:21:56] <jimbaker> dstufft, we just very basic build support - java 7 + ant

[01:22:00] <dstufft> we install Pythons using https://github.com/yyuu/pyenv

[01:22:01] <jimbaker> just need

[01:22:07] <dstufft> it handles the building for us

[01:22:14] <dstufft> we just tell it we want X

[01:22:28] <dstufft> https://github.com/yyuu/pyenv/tree/master/plugins/python-build/share/python-build things it supports

[01:22:56] <dstufft> I wonder if I know anyone who works on IronPython

[01:23:04] <dstufft> it'd be cool to get pip support everywhere

[01:23:23] <jimbaker> dstufft, ok looking at https://github.com/yyuu/pyenv/blob/master/plugins/python-build/share/python-build/jython-2.7-beta1, that's just doing maven central

[01:23:34] <jimbaker> to get the necessary jr

[01:23:36] <jimbaker> jar

[01:24:22] <dstufft> https://github.com/yyuu/pyenv/blob/master/plugins/python-build/share/python-build/jython-dev clone the repo and runs jython_builder, which uh looks like it uses ant

[01:24:30] <dstufft> yay for abstractions

[01:24:54] <dstufft> how long does building jython using ant take?

[01:25:03] <jimbaker> dstufft, maybe 2 min?

[01:25:12] <dstufft> ok, perfectly reasonable to do inline then

[01:25:13] <jimbaker> for a complete buildout

[01:25:45] <dstufft> jimbaker: So Jython itself still needs the ssl/select changes, is there any other changes in Jython that are required that you know of?

[01:26:10] <jimbaker> dstufft, not for pip

[01:26:26] <dstufft> ok

[01:26:59] <dstufft> jimbaker: do you have a branch of pip with the changes required to pip? I'd be interested to see what they are

[01:27:32] <jimbaker> dstufft, here's the change required - https://github.com/jimbaker/pip/commit/53b5e2525edf9f27e40bbc11fd7a1377e83f94cc

[01:27:54] <jimbaker> so i run this against https://bitbucket.org/jimbaker/jython-socket-reboot

[01:27:55] <dstufft> oh interesting, it's only html5lib then?

[01:28:01] <jimbaker> dstufft, correct

[01:28:20] <jimbaker> so i was actually trying tox against html5lib, but now i know how to run directly

[01:28:42] <jimbaker> i rather solve these things one step at at a time. tends to be less hair pulling ;)

[01:29:42] <dstufft> :]

[01:29:42] <dstufft> https://github.com/html5lib/html5lib-python/issues/2

[01:29:43] <jimbaker> so hopefully we can get upstreamed into html5lib reasonably quickly, then packaged into pip

[01:30:12] <jimbaker> dstufft, sounds good, i will comment on this

[01:31:59] <dstufft> awesome

[01:32:37] <dstufft> Alex_Gaynor: probably I should have backported the pytest-xdist change to 1.5.X before doing all this

[01:32:43] <Alex_Gaynor> dstufft: welp

[01:32:49] <dstufft> too late now!

[01:32:54] <Alex_Gaynor> dstufft: ever figure out why the using a wheel thing caused problems?

[01:33:56] <dstufft> Alex_Gaynor: partially yes, some of it was we were testing for a setuptools .pth file to be updated, but it's a file that gets lazily created the first time you install something, and switching from setup.py develop to wheels meant that the file was no longer implicitly created as part of installing pip

[01:34:15] <dstufft> so our assertions against that file being updated were wrong

[01:34:28] <dstufft> because it was now created isntead of updated

[01:35:04] <dstufft> (In general i'm not sure it makes sense to differentiate between created and updated and we should instead be asserting that the file is in the state we expect it to be in, but that's a bigger change)

[03:29:27] <jimbaker> dstufft, i made a pull request with my change to html5lib - https://github.com/html5lib/html5lib-python/pull/150

[03:30:49] <dstufft> jimbaker: awesome!

[03:33:34] <jimbaker> dstufft, looks like i will have to use a little six here - six.unichr specifically. easy enough fix

[06:37:58] <dstufft> Alex_Gaynor: ping

[06:58:12] <dstufft> Alex_Gaynor: well just FYI, pip 1.5.5 and virtualenv 1.11.5 are released

[12:08:49] <dstufft> pf_moore: you don't happen to be around do you

[15:02:12] <Alex_Gaynor> dstufft: thanks

[15:57:09] <pmxbot> jaraco pushed 1 commit to setuptools (https://bitbucket.org/pypa/setuptools/) :

[15:57:09] <pmxbot> Monkey-patch the write_pkg_info method on Python 3.1 DistributionMetadata. Fixes #197

[16:59:27] <pmxbot> jaraco pushed 1 commit to setuptools (https://bitbucket.org/pypa/setuptools/) :

[16:59:27] <pmxbot> Backed out changeset: b0a2fcc5275a Ref #193

[17:07:12] <dstufft> Hmm

[17:07:17] <dstufft> I might exclude pypy from OSX

[17:07:36] <dstufft> maybe 3.2 too

[17:27:04] <pmxbot> jaraco pushed 2 commits to setuptools (https://bitbucket.org/pypa/setuptools/) :

[17:27:04] <pmxbot> Add test capturing failure when find_packages no longer follows symlinks. Ref #195

[17:27:04] <pmxbot> Restore traversal of symbolic links in find_packages. Fixes #195.

[17:31:19] <pmxbot> jaraco pushed 4 commits to setuptools (https://bitbucket.org/pypa/setuptools/) :

[17:31:19] <pmxbot> Update changelog

[17:31:19] <pmxbot> Bumped to 3.5 in preparation for next release.

[17:31:19] <pmxbot> Added tag 3.5 for changeset 98f29d521c3a

[17:31:19] <pmxbot> Bumped to 3.6 in preparation for next release.

[21:21:41] <jaraco> dstufft, I see it'll take up to 15 minutes for my account to appear. That's fine, but what hostname should I use to connect to the host?

[21:21:56] <jaraco> I'm assuming the public facing name points to fastly and not the origin server.

[21:22:00] <dstufft> web.pypa.io

[21:22:11] <dstufft> is the webserver

[21:22:15] <dstufft> salt.pypa.io is the salt master

[21:22:32] <dstufft> salt controls the fetching of git/hg ATM

[21:22:47] <dstufft> I'm guessing salt's hg.latest state just doesn't support bookmarks

[21:23:42] <dstufft> $ sudo -u nginx hg bookmarks

[21:23:42] <dstufft> hg: unknown command 'bookmarks'

[21:23:48] <dstufft> Do I have to enable something?

[21:24:14] <jaraco> Probably need to update the mercurial version.

[21:24:27] <jaraco> I think bookmarks were added in 1.8 or so.

[21:24:42] <dstufft> ah

[21:24:44] <dstufft> this is 1.4

[21:24:47] <dstufft> hmm

[21:24:56] <dstufft> I think it just installed hg from EPEL

[21:24:59] <dstufft> btw https://github.com/pypa/pypa-salt/blob/master/states/web/bootstrap/init.sls#L22-L28

[21:25:04] <dstufft> that's where it handles the cloning

[21:25:14] <jaraco> or it might just need to be enabled as a plugin

[21:26:19] <dstufft> jaraco: so my knowledge of hg concepts is pretty limited, how hard/bad would it be to switch from bookmarks to branches? I can probably get salt using bookmarks instead but if it's not hard/bad to just use branches that'd probably be easier (also it seems like bitbucket freaks out over bookmarks in ways)

[21:28:20] <jaraco> Using branches is the wrong model. It would require creating lots of extra commits in that branch, merging for every release, and it would be error-prone. It would also not be possible to easily reset the bookmark to an older version if necessary.

[21:29:17] <dstufft> ok

[21:32:15] <dstufft> jaraco: I'm gonna get an upgraded Mercurial on the boxes first I guess

[21:33:00] <jaraco> Cool. You can actually pip install mercurial to the system Python, but it sounds like your EPEL/salt model is much better for repeatability.

[21:33:42] <dstufft> salt can install from pip too

[21:33:51] <dstufft> I just prefer OS packages

[21:33:54] <dstufft> if possible

[21:34:13] <dstufft> seeing if there's an easy way to get a newer hg via rpms

[21:34:28] <dstufft> oh EWDurbin might know :D

[21:34:30] <jaraco> 1.4 is from 2010

[21:34:32] <dstufft> he's my CentOS buddy

[21:36:14] <jaraco> Weird - the mercurial download page suggests using Fedora Projects EPEL. I find it strange that they would recommend a technique that results in such a stale version.

[21:36:25] <jaraco> Is it an old version of CentOS?

[21:36:26] <dstufft> Fedora and CentOS are different

[21:36:52] <dstufft> it's CentOS 6.5, but Fedora is the less old but more unstable stuff

[21:37:03] <EWDurbin> i've never gone searching for newer mercurials.

[21:37:29] <jaraco> They suggest "yum install '*mercurial*'"

[21:37:38] <jaraco> Was it installed with the asterixes?

[21:37:49] <jaraco> http://mercurial.selenic.com/wiki/Download

[21:37:53] <jaraco> They also mention CentOS 5

[21:38:30] <EWDurbin> so since mercurial is provided by the distro, EPEL won't even bother trying to offer newer versions for CentOS 5 or 6

[21:39:07] <EWDurbin> repoforge does appear to offer newer mercurials for el6: http://pkgs.repoforge.org/mercurial/

[21:39:30] <dstufft> EWDurbin: how do I enable repoforge

[21:39:42] <EWDurbin> but be warned jaraco/dstufft mixing repoforge and EPEL can really end in a head scratching

[21:39:52] <dstufft> hmm

[21:39:58] <dstufft> maybe I'l just download the .rpm directly

[21:40:01] <EWDurbin> dstufft: http://pkgs.repoforge.org/mercurial/

[21:40:02] <dstufft> or just use pip

[21:40:04] <EWDurbin> whoops

[21:40:07] <EWDurbin> wrong paste

[21:40:12] <EWDurbin> http://repoforge.org/use/

[21:40:43] <dstufft> EWDurbin: Do you think it'd be better to A) Use repoforge B) Just hardcode the rpm and use yum localinstall and C) use pip

[21:41:20] <dstufft> i'm leaning towards pip :V

[21:41:52] <EWDurbin> i think i'd head that direction as well, unless the repoforge package doesn't require any other repoforge packages

[21:43:33] <EWDurbin> FWIW dstufft that package looks pretty clean

[21:48:53] <dstufft> EWDurbin: https://github.com/pypa/pypa-salt/pull/2 does that look right?

[21:49:42] <EWDurbin> yes dstufft

[21:49:49] <jaraco> I don't see anything there to install mercurial using pip.

[21:50:01] <jaraco> oh

[21:50:04] <jaraco> Yes I do.

[21:50:57] <dstufft> hm

[21:51:07] <dstufft> pkg.purged isn't valid in a requires

[21:51:22] <EWDurbin> oh

[21:51:39] <EWDurbin> your names don't match

[21:51:57] <EWDurbin> it should be - pkg.purged: mercurial-rpm

[21:52:06] <EWDurbin> since that's the state defined above that you need

[21:52:10] <dstufft> Invalid requisite type 'pkg.purged' in state 'mercurial', in SLS 'pkg.hg'. Requisite types must not contain dots, did you mean 'pkg'?

[21:52:20] <dstufft> maybe it should jsut be pkg: mercurial-rpm ?

[21:52:24] <EWDurbin> doh, yeah that too

[21:52:27] <EWDurbin> double wahmmy

[21:58:12] <dstufft> hmm

[21:58:18] <dstufft> EWDurbin: is there anything like build-essential for CentOS

[21:58:23] <jaraco> dstufft, not to distract, but it seems the creds didn't take. I'm prompted for a password connecting as jaraco to web.pypa.io

[21:59:01] <jaraco> dstufft, this answer gives a suggestion - http://stackoverflow.com/a/22528157/70170

[21:59:04] <EWDurbin> dstufft: `yum groupinstall "Development Tools"` is nearest equivalent

[21:59:23] <dstufft> jaraco: http://bpaste.net/show/tDwJWUXjRJBsfxXCgiMN/ is the key I see

[21:59:29] <dstufft> EWDurbin: any idea how to do that in salt?

[22:00:15] <dstufft> yumpkg.group_install maybe

[22:00:46] <EWDurbin> not sure if that exists or not

[22:01:11] <EWDurbin> ahhh, there i see a module

[22:01:14] <EWDurbin> but no state exposed

[22:01:43] <jaraco> dstufft, should maybe we consider simply invoking a wget in a cron job?

[22:04:14] <dstufft> ah got it, just installed gcc

[22:04:17] <dstufft> now hg is isntalled

[22:04:19] <dstufft> and is verison 3.0

[22:04:25] <jaraco> !norris dstufft

[22:04:25] <pmxbot> Death once had a near-dstufft experience

[22:05:00] <dstufft> jaraco: what's the command to checkout a bookmark?

[22:05:28] <dstufft> actually mayb eit already works

[22:05:40] <dstufft> $ sudo -u nginx hg bookmarks

[22:05:40] <dstufft> 1.x-maintenance 2447:26694805c613

[22:05:40] <dstufft> 2.x-maintenance 2535:25bbade96bd1

[22:05:40] <dstufft> * bootstrap 2711:98f29d521c3a

[22:05:40] <dstufft> bootstrap-2.x 2521:39f7ef5ef221

[22:05:41] <dstufft> bootstrap-py24 2445:274cb3beba4f

[22:05:43] <dstufft> master 2712:f75f6d4dd72c

[22:06:02] <dstufft> sudo -u nginx hg id

[22:06:02] <dstufft> 98f29d521c3a 3.5 bootstrap

[22:06:08] <dstufft> does that look right jaraco ?

[22:07:06] <jaraco> dstufft: that looks right

[22:07:31] <dstufft> I just purged fastly

[22:07:36] <dstufft> bootstrap.pypa.io should be updated

[22:07:39] <dstufft> care to check?

[22:08:02] <jaraco> yep. Looks great!

[22:08:11] <jaraco> !m dstufft

[22:08:11] <pmxbot> you're doing good work, dstufft!

[22:08:14] <dstufft> awesome

[22:08:15] <dstufft> sorry about that

[22:08:28] <dstufft> I had didn' realize that bookmarks and branches were differnent things

[22:08:33] <jaraco> I was trying to figure out the commands to (a) checkout and (b) update, but it sounds like you figured it out.

[22:08:45] <dstufft> actually salt's hing did it

[22:08:54] <dstufft> hg.latest apparently does understand bookmarks

[22:08:54] <jaraco> oh. Great.

[22:08:58] <dstufft> as long as your hg is new enough

[22:09:46] <dstufft> jaraco: fwiw if you ever want to poke at it, the setuptools repo is cloned at /srv/bootstrap/setuptools by the nginx user

[22:09:53] <dstufft> you should have passwordless sudo

[22:10:28] <jaraco> I was finally able to log in... not sure what the delay was, but it's working now.

[22:10:38] <jaraco> And yes, with sudo. So thanks for that.

[22:10:48] <dstufft> the salt master, salt.pypa.io pulls the pypa-salt repo every 5 minutes

[22:10:58] <dstufft> and each machine runs salt every 15

[22:11:17] <dstufft> you can run salt by doin salt-call state.highstate

[22:11:22] <dstufft> if you don't want to wait 15 minutes

[22:11:35] <EWDurbin> don't forget sudo ^

[22:11:37] <dstufft> (on whatever machine you want it to be run on)

[22:11:54] <dstufft> and you can pull down a new copy of pypa-salt by logging into salt.pypa.io and going to /srv/pypa-salt and doing git pull

[22:11:56] <dstufft> also w/ sudo

[22:12:36] <dstufft> -> goes to get groceries

[22:13:53] <jaraco> Going for dinner myself. Thanks again.

Log file Viewer

Help | Karma | Search:

#pypa-dev logs for Saturday the 3rd of May, 2014