PMXBOT Log file Viewer

Help | Karma | Search:

#mongodb logs for Saturday the 27th of October, 2012

(Back to #mongodb overview) (Back to channel listing) (Animate logs)
[06:14:56] <abhi9> what is the best way to let the user download the queried data from a mongo using python
[06:15:58] <firebalrog> What type of data
[06:16:10] <firebalrog> Purpose?
[06:16:56] <firebalrog> Sophistication level of end user?
[06:17:22] <abhi9> I've a collection named customer, and user filter the data using query in GUI and should be able to download that data
[06:18:10] <firebalrog> Does it include orders or line items or just contact info
[06:19:09] <firebalrog> How is downloaded data going to be used
[06:19:35] <firebalrog> Is it one cust or multiple
[06:19:40] <abhi9> say 4 fields from contacts
[06:19:52] <firebalrog> Name them
[06:20:13] <abhi9> and say there are 500 entries found and user wants to download it
[06:20:28] <firebalrog> CSS
[06:20:38] <firebalrog> No csv
[06:20:51] <firebalrog> Dam spell checker
[06:21:00] <firebalrog> Not CSS
[06:21:32] <abhi9> csv
[06:21:34] <firebalrog> Csv could be imported into spread sheet
[06:21:53] <firebalrog> Comma separated values
[06:22:03] <abhi9> so the interate each document and make csv is the only way?
[06:22:17] <firebalrog> Not only way
[06:22:51] <firebalrog> But without answers to my questions I expect it would be the best
[06:23:59] <abhi9> i donno what user will do with downloaded data
[06:24:13] <abhi9> my object is to let user to download that
[06:25:59] <firebalrog> Give options, XML, json, csv, xls then
[06:26:42] <firebalrog> I bet csv and xls will be the most used
[06:27:34] <firebalrog> You should collect stats on which is used most
[06:28:34] <abhi9> ok but I just want to know to fetch data from mongo, find method only?
[06:29:20] <firebalrog> You got me I don't do python
[06:30:33] <firebalrog> Db.collection.find(criteria and constraints) I would expect
[06:31:57] <abhi9> ok
[06:35:27] <abhi9> thanx
[06:38:26] <firebalrog> Np
[12:10:29] <Zelest> Derick, around?
[12:38:04] <Derick> Zelest: am now
[13:34:12] <Zelest> Derick, I was gonna ask you what the "connect" option in the Mongo PHP driver does? "If the constructor should connect before returning" .. what does that mean?
[14:14:28] <Derick> Zelest: if you set connect => false, the driver will only start connecting when you run the first query
[14:41:36] <ElGoorf> rawr
[14:44:12] <Zelest> Derick, oh
[14:44:16] <Zelest> Derick, nifty/good?
[15:03:40] <ElGoorf> woot, got mongo_db working in codeigniter
[15:03:46] <ElGoorf> nwo for my first ever mong_db project :D
[15:03:47] <ElGoorf> mongo*
[15:05:28] <Derick> woo :)
[15:05:38] <Derick> what's the project hussein?
[15:32:26] <ElGoorf> Derick, i'm making a youtube annotations app, where the annotations are actually.. useful
[15:33:07] <ElGoorf> eg you film a train tour around europe, you can have a map next to the video with a marker that's synced tot he video's time showing where you are
[15:33:13] <ElGoorf> and clicking on the map takes you to that part of the video
[15:34:00] <Gargoyle> Derick: Was that debug info useful?
[15:34:18] <ElGoorf> or if you film yourself cycling, you can import sports tracker data and realtime counters show speed, altitude.. position on map etc
[15:34:32] <ElGoorf> maps maps maps :D
[15:35:02] <ElGoorf> just need a name for it though.. :/
[15:35:23] <Gargoyle> tubemap!
[15:36:10] <ElGoorf> well you could still have a video with no map annotation
[15:36:41] <ElGoorf> and tubemap.com's probably taken :P
[15:37:05] <mrpro> derpvidz
[15:39:11] <ElGoorf> lulz
[15:39:30] <ElGoorf> so ya, mongodb to store keyframes
[15:46:48] <Derick> Gargoyle: i've been traveling so not had time yet. Hannes did have a quick look at it
[15:48:47] <Gargoyle> Derick: OK. I'll be around most of the weekend, so ping if there's any more info I can dig up that would help.
[15:51:23] <doubletap> i have a collection that looks like {'someUsersObjectIDString':{type:'cool'}} I think i may have screwed myself on indexing by creating it this way because i want to index on '*.type'. Am I correct?
[15:53:05] <Derick> Gargoyle: I won't be - I need some sleep :-)
[15:53:18] <Derick> we'll get back to it next week
[15:53:52] <Gargoyle> Have a nice relaxing weekend! I'm just doing my homework for M101 & M102 :-)
[15:54:31] <doubletap> is it possible to create an index on something like *.type ?
[15:55:07] <Gargoyle> doubletap: I don't think so.
[15:55:23] <doubletap> Gargoyle: I don't either :(
[15:55:39] <doubletap> I thought i was so slick building this collection like this.
[15:55:53] <Gargoyle> doubletap: Just switch your doc around to move the id.
[15:56:40] <doubletap> Gargoyle: well, considering the codebase living on the collection, it will be weeks of work for me.
[15:57:18] <doubletap> move fast and break shit really does break shit.
[15:59:06] <dross> yuck school :P
[15:59:28] <dross> I completely skipped that and went to a systems engineer role
[15:59:40] <doubletap> if i could find a DB guy to be a cofounder, this would be so much easier.
[17:30:52] <findme> what does it mean that in 32-bit size of db is restricted to 2 Gig
[17:31:05] <findme> total size in a 32 bit version is 2 Gig
[17:31:13] <findme> and in 64 bit is unlimited ?
[17:31:18] <findme> 2 Gig seems so so small
[17:33:08] <Derick> 64 is not unlimited, but really high
[17:33:18] <Derick> it has to do with address space
[17:33:27] <Derick> with a 32bit version, you can address 2^32 bytes
[17:33:30] <Derick> which is 2Gb
[17:33:46] <Derick> with a 64bit version, you can address 2^64 bytes, which is a *lot*
[17:33:59] <findme> 2 Gig per file or 2 Gig per DB.
[17:34:06] <findme> I guess 2 Gig per installation
[17:34:15] <Derick> findme: per installation, yes
[17:34:24] <findme> Derick, that makes sense. Thanks
[17:34:32] <findme> it is so super fast
[17:34:37] <findme> at least on my laptop.
[17:34:58] <findme> is the source code Open Source ?
[17:35:32] <Derick> sure
[17:35:54] <Derick> it's all on github: http://github.com/mongodb/mongo
[17:36:17] <findme> awesome anyone offering training on the internals paid or otherwise?
[17:36:38] <findme> i am attending the free DBA training
[17:36:56] <findme> but over the years i have learnt that it is best to pay for the training and be at the top.
[17:37:24] <Derick> 10gen offers support and training: http://www.10gen.com/training and http://www.10gen.com/consulting
[17:44:42] <Zelest> Derick, finally setup my tiny template-engine system where the templates are stored in the DB with GridFS.. and nginx with php-fpm as frontend.. MVC-based where the views/layouts are located in the database..
[17:44:56] <Zelest> Derick, manage to pull over 1500 reqs/sec :-D
[17:45:01] <Derick> nice
[17:45:27] <Zelest> Need to find a decent way to handle templates though..
[17:45:46] <Zelest> using str_replace() or strtr() with {keyword} => value feels ugly/slow.
[17:45:55] <Zelest> but that's off-topic here. :-)
[17:46:04] <Zelest> also need to rewrite my wrappers for GridFS a bit
[17:47:13] <luser0> Python type casting issues are off topic here?
[19:43:26] <doubletap> which do you think would be faster? checking if a key exists in an object or checking if a value exists in an array?
[19:54:33] <doubletap> i guess it would also matter which can be indexed better.
[21:50:13] <lec^2> is the education site down again? AWS issues?
[21:51:31] <Gargoyle> lec^2: It would appear that way!
[21:52:06] <lec^2> how extremely frustrating!
[22:08:00] <doubletap> The National Weather Service has suggested that application owners begin migrating out of AWS US-East-1 in preparation for Hurricane Sandy
[22:08:30] <Zelest> :o
[22:08:48] <doubletap> i am not sure that is true
[22:08:53] <doubletap> just a tweet i saw
[22:09:05] <Zelest> I don't use AWS so.. no worries for me :D
[22:09:27] <doubletap> sometimes we use AWS and we dont even know it.
[22:39:49] <EuroNerd> I've got a mongo-node.js question: Can I open a number of collections upfront and assign to global vars and access them later, as need arises?
[23:49:12] <newbie22> *: I read this in the O'Reilly - Mongodb - The Definite Guide ----------- "Documents larger than 4MB (when converted to BSON) cannot be
[23:49:12] <newbie22> saved to the database." Is this still true ???