PMXBOT Log file Viewer

Help | Karma | Search:

#pypa-dev logs for Thursday the 28th of January, 2016

(Back to #pypa-dev overview) (Back to channel listing) (Animate logs)
[00:14:25] <StevenK> lifeless: Only packaging PR #50 at the moment
[00:14:31] <StevenK> dstufft: ^ *hint* :-P
[11:00:31] <Ivo> !logs
[11:00:31] <pmxbot> http://chat-logs.dcpython.org/channel/pypa-dev
[12:13:09] <Ivo> dstufft: could I release a virtualenv 14.0.2?
[12:18:13] <dstufft> Ivo: Just added you to PyPI, make sure you sign it with your GPG key
[12:18:37] <Ivo> will do
[12:18:50] <dstufft> also update any of the bundled stuff inside it
[12:19:03] <Ivo> I was just thinking, pypi/packaging doesn't have any concept of a key trust system right
[12:19:14] <dstufft> Not currently
[12:19:25] <Ivo> e.g having a "PyPA" key that trusted X,Y,Z developer keys, etc etc
[12:23:08] <Ivo> Seems setuptools 19.6 is only one with updates
[12:23:59] <dstufft> sounds about right
[12:44:02] <Ivo> dstufft: use empty message for tag, or "14.0.2"?
[12:44:53] <dstufft> I do "Released vWhatever" on the first line, then duplicate the changelog in the body
[12:46:44] <Ivo> consider noting that in https://pip.pypa.io/en/stable/development/#release-process ?
[12:46:50] <dstufft> sure
[13:16:43] <Ivo> fuuuuu
[13:19:26] <Ivo> setuptools 19.6 broken for pypy3
[13:36:21] <Ivo> I'm sorry, I should've stopped and checked build went through on a pushed dev branch after updating setuptools 19.6
[15:06:13] <pmxbot> jaraco pushed 1 commit to setuptools (https://bitbucket.org/pypa/setuptools/) :
[15:06:13] <pmxbot> Update changelog
[15:06:45] <jaraco> Ivo: would you like to try cutting a release?
[15:07:08] <jaraco> You need ‘jaraco.packaging’ installed. Also, you have to be working from an hg checkout.
[15:08:31] <jaraco> brb
[17:07:09] <Ivo> jaraco: there?
[17:07:40] <jaraco> I’m here.
[17:13:11] <Ivo> ok
[17:13:56] <Ivo> so I need a hg checkout I'm guessing
[17:15:35] <jaraco> Ivo - that’s right… because that’s what jaraco.packaging assumes.
[17:16:32] <jaraco> I’d love to move to a setuptools_scm-based implementation, but I’m worried about compatibility, especially in bootstrapping… and I don’t want to open that can of worms while setuptools is unstable (which it is right now).
[17:17:08] <dstufft> jaraco: I kind of want a setuptools-scm like thing for pip, but only in development, it should emit a sdist without any setup_requires :]
[17:21:44] <jaraco> Right now, setup_requires is the best implementation available. I’m hoping my work or rwt will result in some techniques that will make things like setup_requires so painless that it can be used with impunity.
[17:23:17] <jaraco> But thinking about your goals, dstufft, isn’t what you describe - emitting an sdist without setup_requires - already met by wheel dists?
[17:23:39] <dstufft> jaraco: wheels aren't sdists they are bdists :]
[17:24:10] <dstufft> I think that a sdist should have a baked in version
[17:24:33] <dstufft> once you've generated the sdist, the version should no longer be dynamic, a sdist has a singular version, known at generation time.
[17:24:38] <jaraco> I did explore this possibility when I was first working on hgtools.
[17:25:04] <jaraco> And pje gave some advice that it essentially couldn’t be done with the metadata as it’s currently represented.
[17:25:13] <jaraco> So the tooling would need to be adapted to support it.
[17:25:19] <jaraco> But I’d be very much in favor of that.
[17:25:23] <Ivo> dstufft: setup_requires = ['setuptools_scm'] if '* develop' in subprocess.check_output('git branch -l'.split()) else []
[17:25:27] <Ivo> ez
[17:25:31] <Ivo> :D
[17:25:42] <Ivo> jaraco: ok, got a checkout and a twine and a jaraco.packaging
[17:26:07] <dstufft> jaraco: I think PJE is wrong on that :] it shouldn't be super hard to do, I just havne't motivated myself ot do it
[17:27:00] <Ivo> well if we managed to finish pep 426 we might be able to start putting static metadata in sdists, I thought was the eventual plan
[17:27:52] <dstufft> it is
[17:30:32] <Ivo> jaraco: you should make a dev-requirements.txt for setuptools, with jaraco.packaging & sphinx & twine in it 'n stuff
[17:31:17] <jaraco> Except you don’t need those things except to release. Maybe release-requirements.txt.
[17:34:05] <Ivo> jaraco.packaging.release doesn't seem to make a wheel by default atm if I'm reading correctly
[17:35:01] <jaraco> It should via setup.cfg aliases.
[17:35:21] <jaraco> or via the release.py customizations.
[17:36:14] <Ivo> oic
[17:36:18] <jaraco> All I do when I release is run ‘python -m jaraco.packaging.release’ …
[17:37:46] <jaraco> I just accepted your PR in github. It occurs to me the release process might choke when it gets to pushing the code to github.
[17:38:03] <jaraco> If you don’t have hg-git installed and a ‘github’ path configured.
[17:38:25] <jaraco> It’s a mess, straddling github and bitbucket.
[17:38:35] <Ivo> I'll take your word for it
[17:38:46] <Ivo> I don't have a hg-git command present
[17:39:46] <Ivo> eh, it was like a one line change anyway, I guess you could force back out the github PR and apply it yourself in hg if you wanted?
[17:41:10] <Ivo> oooh, this is one thing I like about mercurial... to add a plugin, just pip install something
[17:41:22] <Ivo> man, they should have advertised that a whole heap
[17:42:14] <Ivo> so what do I want to `hg clone https://github.com/jaraco/setuptools github` or something?
[17:42:28] <Ivo> or not worry
[17:44:47] <jaraco> The way I have it is an hg clone of the bitbucket repo as ‘default’ and then an hg-git pull of the github repo.
[17:45:02] <jaraco> $ cat .hg/hgrc
[17:45:02] <jaraco> [paths]
[17:45:03] <jaraco> default = bb://pypa/setuptools
[17:45:04] <jaraco> github = gh://jaraco/setuptools
[17:45:24] <jaraco> Where $ grep gh ~/.hgrc
[17:45:25] <jaraco> gh = git+ssh://git@github.com:
[17:46:25] <jaraco> At this point, the “repeatable” process is feeling a little bit to me overcomplicated.
[17:46:36] <jaraco> It’ll get better when I can rely on just the github repo.
[17:52:02] <Ivo> ok I got a pull happening
[17:52:45] <Ivo> unfortunately hg does not work nicely with hg extensions that were installed ina virtualenv instead of teh global env
[17:54:03] <Ivo> I htink it wants to merge now
[17:54:42] <Ivo> the default branch has multiple heads!
[17:54:52] <Ivo> default has evolved!
[17:55:03] <jaraco> Yes, it does. I think they’re bookmarked.
[17:55:07] <jaraco> They’re git branches.
[17:55:36] <jaraco> Ivo: can I safely push your PR to bitbucket?
[17:56:02] <Ivo> I was trying to do the same thing, I guess, but you probably already know how
[17:56:06] <Ivo> sure
[17:56:08] <jaraco> The two heads in default should be ‘pr-164’ and ‘master'.
[17:56:17] <pmxbot> jaraco pushed 2 commits to setuptools (https://bitbucket.org/pypa/setuptools/) :
[17:56:17] <pmxbot> Test on pypy3
[17:56:17] <pmxbot> Merge pull request #31 from Ivoz/patch-1
[17:58:36] <Ivo> so can I do one more commit to add an allow-failures for .travis.yml
[17:58:59] <jaraco> What does allow failures do?
[17:59:09] <jaraco> Travis doesn’t build artifacts.
[17:59:14] <Ivo> the overall build will still go green
[17:59:18] <jaraco> You can lie when you make the release.
[17:59:28] <Ivo> even if the pypy3 jobs fail
[17:59:29] <jaraco> Just say that tests are passing. It doesn’t check.
[17:59:34] <jaraco> Yes.
[18:00:14] <Ivo> totes need make it check and go "I just checked. Are you lying to me? y/n" if you are
[18:00:33] <jaraco> heh
[18:01:07] <Ivo> how many freakin IPs does bitbucket.org have
[18:03:10] <Ivo> ok I'm trying to push a single commit for .travis.yml which I thought was on default branch, and it's saying
[18:03:16] <Ivo> Just say that tests are passing. It doesn’t check. ote head de7ee4680b5b on branch '0.7-maintenance'!
[18:03:27] <Ivo> abort: push creates new remote head de7ee4680b5b on branch '0.7-maintenance'!
[18:06:01] <jaraco> I wonder if your master bookmark wasn’t correct. 0.7-maintenance is old.
[18:09:04] <Ivo> quite possibly
[18:10:08] <Ivo> oh god how did I add changes for cli.exe and gui.exe
[18:10:10] <Ivo> that doesn't seem right
[18:10:44] <jaraco> Did you do any merges?
[18:10:49] <Ivo> yeah
[18:10:58] <Ivo> since it was giving me above error
[18:11:05] <Ivo> I thought maybe merging two heads would work
[18:11:24] <Ivo> now I'm just recloning because **** accidentally changing .exe's
[18:11:54] <jaraco> Often, you can ‘hg strip -r outgoing(default)’ and that will remove any commits not upstream.
[18:12:05] <jaraco> In my repo, 780d2be19741 is the head where you want to commit.
[18:12:48] <Ivo> not 1172978?
[18:13:11] <Ivo> it has two branch heads
[18:14:38] <jaraco> you’re right.
[18:14:39] <Ivo> theres another from steve kowalik on 7th jan
[18:14:52] <Ivo> should that be put in another branch or smth
[18:15:31] <Ivo> http://stackoverflow.com/questions/6927733/mercurial-how-to-deal-with-one-branch-that-has-two-heads
[18:15:55] <jaraco> Yes. or closed or something. I keep thinking something is going to happen with that code, but it’s kinda dragging on.
[18:17:01] <jaraco> Just ignore it for now.
[18:17:06] <Ivo> is it bookmarked or something similar
[18:17:29] <jaraco> It’s bookmarked pr-164
[18:17:34] <Ivo> cool
[18:20:25] <pmxbot> Ivoz pushed 1 commit to setuptools (https://bitbucket.org/pypa/setuptools/) :
[18:20:26] <pmxbot> Allow failures with pypy3 for now
[18:21:27] <Ivo> so we want 19.6.1
[18:21:37] <jaraco> Sounds right.
[18:22:28] <Ivo> ran -m j....release
[18:22:45] <Ivo> giving Not found: certifi / wincertstore output
[18:23:00] <jaraco> I’ve been seeing that too.
[18:23:04] <jaraco> Probably safe to disregard.
[18:23:09] <Ivo> warning: no files found matching '*' under directory 'setuptools/_vendor'
[18:23:21] <jaraco> Also ignorable.
[18:23:29] <Ivo> hanging for now
[18:23:44] <jaraco> It takes a while.
[18:23:47] <jaraco> 30-45 sec.
[18:23:54] <jaraco> longer on slow connections.
[18:24:03] <Ivo> oh its doing upload
[18:24:14] <Ivo> have you considered migrating to using twine
[18:24:57] <Ivo> it'd be easy to integrate adding a signature for the packages then
[18:25:04] <jaraco> Yes. But its advertised advantages don’t help me, and it adds another dependency and handoff.
[18:25:38] <jaraco> How does one know which filename to pass to twine?
[18:26:06] <Ivo> if you started off with an empty dist/ folder and then built some packages, you can just do twine -u dist/*
[18:26:08] <pmxbot> Ivoz pushed 3 commits to setuptools (https://bitbucket.org/pypa/setuptools/) :
[18:26:08] <pmxbot> Bumped to 19.6.1 in preparation for next release.
[18:26:08] <pmxbot> Added tag 19.6.1 for changeset 35d9179d0439
[18:26:09] <pmxbot> Bumped to 19.6.2 in preparation for next release.
[18:26:23] <jaraco> !schneier Ivo
[18:26:24] <pmxbot> Ivo; brain the size of a planet.... Reduced to writing about encryption for mortals; gets very depressed.
[18:26:43] <Ivo> lol
[18:27:01] <Ivo> wait
[18:27:08] <Ivo> how does it know what username I want to upload under
[18:27:36] <jaraco> .pypirc
[18:27:39] <Ivo> was the password for pypi?
[18:28:32] <Ivo> I failed to add milestones and versions
[18:28:37] <Ivo> or was that for bitbucket
[18:28:56] <jaraco> Not sure; I don’t get prompted for a password, but that’s because I store my password in .pypirc and have github and bitbucket passwords already stored elsewhere.
[18:29:06] <jaraco> Yes, milestones and versions is for bitbucket. Totally ignorable.
[18:29:29] <jaraco> Thanks for getting through it and for the feedback.
[18:29:37] <jaraco> After moving to github, things will get easier.
[18:29:54] <jaraco> And I’ll factor in these other considerations to try to simplify the process.
[18:31:09] <Ivo> I went into python
[18:31:20] <Ivo> and tried to run add_milestones_and_version('19.6.1')
[18:31:32] <Ivo> with bitbucket password, instead of pypi
[18:31:44] <Ivo> still failed
[18:32:22] <Ivo> it's using wrong username
[18:33:07] <Ivo> sometimes I am luckily and find a service soon after creation
[18:33:10] <Ivo> and my username is Ivo
[18:33:18] <Ivo> sometimes I am not, and my username is Ivoz
[18:33:28] <Ivo> :(
[18:35:39] <Ivo> jaraco: you should just make it prompt for a username, with a default if you press Enter
[18:36:25] <jaraco> After moving to github, that whole routine is rubbish anyway.
[18:37:45] <Ivo> lol
[18:38:25] <Ivo> I made 'em manually
[18:39:00] <Ivo> jaraco: can you push hg default to ur github master ?
[18:39:01] <jaraco> :+1:
[18:39:31] <jaraco> Ivo: on its way.
[18:39:52] <Ivo> ooh see look https://travis-ci.org/jaraco/setuptools/builds/105484972
[18:39:55] <Ivo> new section at bottom
[18:40:24] <jaraco> Cool
[18:45:31] <Ivo> oh but pypy3 went green anyway
[18:47:00] <jaraco> oh. well that’s good!
[18:47:15] <jaraco> Perhaps the failures are only on OS X or only in my environment.
[18:47:39] <jaraco> I have tests that fail on Python 2.7 with regularlity on my machine as well.
[18:47:45] <jaraco> And I haven’t traced the issue yet.
[19:01:36] <Ivo> I wonder if freenode would give a pypa mask group
[19:05:21] <Ivo> wooo
[19:05:25] <Ivo> pypy3 fixt
[19:05:47] <Ivo> good timing being online today jaraco
[19:05:50] <Ivo> !m jaraco
[19:05:50] <pmxbot> you're doing good work, jaraco!
[19:05:57] <jaraco> !dance
[19:05:57] <pmxbot> O-\-<
[19:05:57] <pmxbot> O-|-<
[19:05:57] <pmxbot> O-/-<
[19:06:53] <jaraco> I’m always online - just not always on IRC. You can often reach me on Twitter or Slack (python-developers and python-community).
[19:17:10] <Ivo> cool
[19:58:02] <jaraco> ronny: Any objections to me just pushing forward with the github migration for setuptools?
[20:35:05] <jaraco> I attempted the issue migration and it failed half-way through.
[20:36:14] <jaraco> So I’ve deleted the repo and am retrying.
[20:37:22] <dstufft> jaraco: planning to keep it at github.com/jaraco/ or going to put at agithub.com/pypa ?
[20:37:35] <jaraco> pypa, for sure.
[20:38:12] <dstufft> awesome
[20:38:20] <dstufft> 🇺🇸
[20:41:29] <ronny> jaraco: pongish
[20:42:07] <ronny> jaraco: the tool is unfinished, and due to fmily visit i didnt have time to finish the username mapping while burning the leftover vacaton before starting a new job
[20:42:09] <jaraco> Heya ronny. I’m fighting https://github.com/jeffwidman/bitbucket-issue-migration/issues/65 right now.
[20:42:28] <ronny> jaraco: you might want to take a look at my fork
[20:42:30] <Ivo> dstufft: dayum, holy blog-post comment on #3416
[20:42:54] <jaraco> ronny: okay. I’ll do that. I wasn’t sure what the status was.
[20:42:55] <ronny> jaraco: because afair that one is seriously broken, and mine is bascially a complete rewrite
[20:43:26] <jaraco> That repo has undergone some major revisions, and is more stable now with an active maintainer.
[20:43:27] <ronny> jaraco: i finished the tooling around username mapping, but i havent finished the comment editing to actuallly replace username references
[20:43:44] <Ivo> jaraco: line #420 is blazin' it
[20:43:45] <jaraco> But I’ll review your commits and incorporate any relevant fixes into the upstream before finalizing the migration.
[20:44:23] <ronny> jaraco: i did a complete rewrite/restructure (since it wasa good chance to re-calibrate my instincts
[20:44:53] <ronny> there is incremental download, offline transformation and a completely separate bulk upload step
[20:45:31] <Ivo> jaraco: maybe if you put a time.sleep(0.4) after line 142 it could work :D
[20:45:48] <ronny> oh, and my code has support for the rate limters of github
[20:46:09] <ronny> and by support i mean adaptive sleep based on the response headers
[20:47:08] <jaraco> ronny: that’s cool. The latest upstream version uses an import API created for this purpose. But the offline transformation sounds helpful.
[20:47:11] <ronny> jaraco: the code you linked is pretty much bad
[20:47:43] <ronny> jaraco: i dodownload the bb issues, support incremental updates of the comments downloaded, and offline transform to bulk upload requests
[20:48:26] <ronny> the part thats missing in my code is using the username map that maps github users to bitbucket users to add the extra metadaa to the comments (loke original poster/reference to unknown bitbucket users=
[20:49:36] <ronny> jaraco: also whats missing is a username map for setuptools
[20:49:59] <ronny> jaraco: https://github.com/RonnyPfannschmidt/bitbucket_issue_migration
[20:53:00] <jaraco> Sounds good. I linked this IRC discussion to the ticket for the migration. One of us or someone else can follow up based on the update.
[20:53:03] <jaraco> !thanks ronny
[20:53:03] <pmxbot> you're doing good work, ronny!
[21:03:39] <ronny> jaraco: i#ll take a look at integrating the usermap now
[21:03:56] <ronny> (its missing in the offline transformation step)
[21:05:13] <jaraco> Thanks ronny. If you decide it’s too much work, it’s not a hard requirement - just looking to get the best fidelity we can during the migration with a modest amount of work.
[21:06:10] <ronny> jaraco: it can at least be rasonably well done
[21:43:37] <tomprince> dstufft: https://github.com/warner/python-versioneer is a `setuptools-scm`-alike that generates sdists with backed in version.