Log file Viewer

[00:01:23] <codepython777> dstufft: how is the pypi db mirrored?

[00:01:32] <dstufft> it's not mirrored

[00:01:39] <dstufft> it's literally connecting to the same database

[00:14:05] <codepython777> dstufft: is it a single ip or multiple ips? Is there a problem if many people try to execute queries on it? I was using xmlrpc to query the database, and that errors out if i am too fast to query.

[00:14:26] <codepython777> dstufft: how is the search performed right now? what is indexed?

[00:16:34] <dstufft> you can't connect to the same database, it's an internal only DB

[00:16:47] <dstufft> search uses Elasticsearch at the moment

[00:16:58] <buck1> qwcode: i'm trying to refactor PackageFinder and it's real hard

[00:17:07] <buck1> do you have any ideas on the subject?

[00:17:16] <buck1> i see you're blamed to a good bit

[00:25:50] <codepython777> dstufft: what all information is indexed inside elastic search? where is that code?

[00:26:27] <dstufft> https://github.com/pypa/warehouse/blob/master/warehouse/packaging/search.py

[00:27:41] <codepython777> dstufft: Is there a way to get access to an up2date version of the database? Perhaps I can setup a mirror system?

[00:28:34] <codepython777> dstufft: thanks for the link. Where is the code that actually indexes the packages in elaseticsearch?

[00:29:01] <dstufft> https://github.com/pypa/warehouse/blob/master/warehouse/search/indexes.py

[00:29:04] <dstufft> and not really

[00:29:16] <dstufft> warehouse isn't design for mirrors really

[00:32:16] <codepython777> dstufft: how did you get access to the postgres db at pypi?

[00:32:40] <dstufft> I'm a PyPI administrator and warehouse is designed to replace the current code that runs PyPI once it's done

[00:36:00] <buck1> dstufft: could you look at this PR before you sign off?

[00:36:00] <buck1> https://github.com/pypa/pip/pull/2058

[00:36:44] <dstufft> buck1: what's the license on bottle.py

[00:37:10] <buck1> MIT

[00:37:17] <buck1> https://github.com/defnull/bottle/blob/master/LICENSE

[00:37:47] <dstufft> buck1: ^^

[00:37:53] <buck1> ty

[00:38:06] <buck1> my branches were getting topheavy w/o that

[00:38:37] <buck1> dstufft: is there anyone other than yourself willing to discuss the nitty gritty of PackageFinder?

[00:39:28] <dstufft> I have no idea what others are willing to discuss, you could post your questions to pypa-dev though

[00:39:37] <buck1> a fine idea.

[00:40:30] <dstufft> the mailing list that is*

[00:40:55] <buck1> i understood :)

[00:48:37] <codepython777> dstufft: does anyone fund your efforts for this project, or is it purely volunteering on your part?

[00:49:22] <dstufft> my employer (Rackspace) gives me ~50% of my time to work on improving Python packaging

[00:49:52] <codepython777> awesome.

[00:59:52] <buck1> that's sweet

[01:00:10] <buck1> dstufft: how does management justify it?

[01:01:03] <dstufft> OSS is real important at Rackspace, plus we use Python packaging all over the place in Rackspace, plus they wanted me and that was one of my conditions of hire

[01:01:20] <buck1> ah i think that last one was the clincher :P

[01:01:47] <dstufft> I mean it's not unusual for Rackers to work on OSS stuff

[01:01:52] <dstufft> 100% of my day is working on OSS

[01:02:00] <dstufft> jsut the other half of my time is spent on openstack stuff

[01:03:02] <codepython777> thats nice of them.

[01:04:48] <buck1> I hope they can be a good example

[18:40:25] <lifeless> jaraco: hi, wondered if you had thughts on https://bitbucket.org/pypa/setuptools/issue/250/develop-and-install-single-version ?