[07:25:36] <svm_invictvs> Using the Java drivers for MongoDB, I was curious if will properly treat the Collection types as lists when I set a List (or other collection) to a MongoDB type.
[07:26:22] <svm_invictvs> Oh hell. Reading is Fundamental: Note: MongoDB will also create arrays from java.util.Lists.\
[07:40:07] <soheilpro> is there any way to know when mongo has finished initializing the journal for the first time?
[07:40:28] <Zelest> doesn't it write about it in the logs?
[07:41:02] <soheilpro> it does but i need to know that in my script so that I can init the replic a set
[13:33:11] <rybnik> Hi there fellas, anyone got a spare minute? I've a few questions…. is there a way to perform something like a $where using the aggregation framework ?
[13:34:24] <ron> I love it when people confuse irc with a frontal chat.
[13:36:10] <Derick> $where is done through javascript, and the A/F is meant to avoid that
[13:36:59] <rybnik> Thank you Derick, and thank you harenson for your time. Please allow me to elaborate further….
[13:41:23] <rybnik> I've a collection fill with documents with a structure similar to the one represented here http://pastie.org/7813118
[13:43:13] <rybnik> my goal is to be able to properly find "rawEvents.wt" : "1367494483266-X1.XXX.XX.97-75119", retrieve that object and use the timestamp to "project" the searchHistory objects which "timestamp" matches the ts field
[13:43:43] <Derick> you mean you want the value of "ts" to become a key?
[13:44:07] <rybnik> I have some progress using $elemMatch, and something like the positional operator $ would be helpful, but I'm running out of ideas, so it would be nice to be able to unwind and then $where
[13:45:48] <Derick> You shouldn't have undescriptive (value) keys... it's bad practise
[13:46:32] <rybnik> I understand that, I also understand that $where is evil, but I was given some lemons and I must prepare some nice apple juice
[13:47:01] <rybnik> Derick, do you have any hint that would point me into the right direction ?
[13:47:24] <Derick> No, as I can't think of a way...
[13:47:47] <Berge> Does the write concern "replica acknowledged" imply that the data has been written to (the journal of) the master node in addition to being sent to a number of replicas?
[13:47:56] <Berge> Or does it just mean "it's been seen by a number of nodes, including master, and will be written soon"? (In which case the data is lost upon a total power failure, for instance.)
[13:52:26] <Berge> I'm coming from a RDBMS background, so this lack of commitment to data and the client's total control of the commitment feels very new and odd (-:
[13:52:34] <Berge> Derick: ah, I can. Good, thanks.
[13:52:47] <Berge> Sure it's slow. It's a hard problem to get fast. (-:
[13:52:50] <Derick> Berge: you do however not want to turn fsync on if you care about any sort of performance
[13:53:02] <Derick> w=majority is going to be good enough
[13:53:10] <Berge> So if I do care about both performance and data durability, I do what?
[13:53:23] <Berge> w=majority protects against random node failure, but not total cluster loss, aiui?
[13:53:53] <Derick> Berge: but the client of course will realise that, as the GLE command has timedout
[13:54:05] <Derick> unless it's on the same cluster...
[13:54:13] <Derick> but then you're basically screwed anyway
[13:54:27] <Berge> Yep, but waiting for timeouts isn't very latency- and performance friendly either.
[13:54:41] <Derick> nope, but w=majority is pretty fast
[13:55:04] <Berge> Sure, but then there's this window of data loss if the cluster goes down all at once.
[13:55:24] <Berge> It's a tradeoff you'll have to consider you're willing to take, of course.
[13:56:44] <Derick> Berge: yes, but an RDBMS handling a total outage on a cluster has the same issue...
[13:56:57] <Derick> and try scaling that as easily
[13:57:29] <Berge> Derick: Actually, no, as you can configure (most) RDBMSes to let a returned COMMIT mean for instance "commited to disk on master and sent to slave" or "commited to disk on master and slave".
[13:57:42] <Berge> The latter is of course not a performance winner.
[13:58:19] <Derick> right, and that's the same with mongo where you can do fsync and w=majority
[14:04:04] <wjb> I'm trying to turn on a unique index on a path within an array, but Mongo tells that there are duplicate keys with with value null. I'm having trouble querying to find them.
[14:04:22] <wjb> How do you query for null values within docs in an array?
[14:13:52] <Garo_> Is it normal that the oplog is almost completely in res memory (ie. it's "hot") in a master of a replica set. I used mongomem to determine that currently around 95% of the oplog collection is mapped into physical memory.
[14:30:05] <theRoUS> i'm getting unexpected segfaults and stacktraces wit no databases: http://pastie.org/7813310
[15:21:02] <Almindor> is there a way to improve mongodb caching?
[15:21:45] <Almindor> I am comparing a 200 million collection query on postgreSQL vs M$SQL vs mongodb and mongo seems to be best on the initial (non-cached, first time executed) query, but it never improves it's time on subsequents
[15:22:14] <Almindor> I get ~14s time on mongo constantly, while postgresql for example is 120s non-cached but 400ms cached
[15:22:55] <Almindor> the query only gets ~3000 documents out of the 200 million and uses geoindexing on postgres and mongodb, normal numeric indexing on MSSQL
[15:23:18] <x1a0> Hi, I am using Mongoose. For most find* query I want the result to be an object of which key is the ObjectId. Is there a switch for that? or what's the best place it make it?
[15:55:19] <rybnik> Hi! Anyone know if there's any difference at all between require('mongodb').ObjectId vs db.bson_serializer.ObjectID.createFromHexString
[19:10:47] <jgspratt> I don't see anything in server.cfg or any "users" in the system
[19:11:12] <leifw> can there be multiple chunk migrations occurring simultaneously within a cluster, if they are all to and from completely distinct shards? that is, can I have a migration from shard A to shard B and another migration from shard C to shard D?
[19:13:26] <apetresc> Mongo itself has username/passoword auth, and the very latest version has some sort of Kerberos/LDAP integration or something like that
[19:13:48] <apetresc> You set up the users and passwords in the admin table
[19:14:53] <apetresc> jgspratt: look into http://docs.mongodb.org/manual/reference/method/db.addUser/ and associated docs
[19:17:15] <jgspratt> apetresc: http://hastebin.com/viyibihupa.hs shows my admin table is empty?
[19:17:54] <jgspratt> Does Mongo use "default allow" security technology? Since there are no users, everyone can use it?
[19:49:16] <unr3al011> hey i am looking for an alternative to redis. i have a main db in mysql and actually copy them into ram via redis and work with a redis db then. i have to do alot of queries in large tables, and i would like to know if mongodb is also ram driven and an alternative for me? can sb. give me any advice please?
[19:57:47] <JanxSpirit> where does mongo hide replica set config?
[19:58:24] <Zelest> in the hidden secret mongo replica set config unit!
[19:58:28] <JanxSpirit> I had a replica set up and running to test, but needed to move the data
[19:59:01] <JanxSpirit> i brought all nodes down, blew away my old db directory and started with a new directory
[19:59:38] <JanxSpirit> all the nodes are still trying to contact one another based on old settings and they get wedged such that I cannot Ctrl-C out and have to kill -9 them
[19:59:58] <JanxSpirit> again, I blew away my dbpath
[20:00:14] <JanxSpirit> so it must be somewhere else
[20:01:13] <JanxSpirit> it's unusual to me that I can't do the kind of thing I'm trying to do more easily, but at this point I'd like to just go back to clean slate as the replica set was easy to set up initially
[20:03:23] <kali> JanxSpirit: it's in the "local" database
[20:08:18] <JanxSpirit> kali - where is that on my filesystem?
[20:12:25] <JanxSpirit> ok - I'll go on a node manhunt again - just wanted to make sure replica sets didn't introduce something new - I haven't messed with them before
[21:04:04] <leifw> In a sharded cluster, what happens if one of the config servers goes down and has different data than the rest of them? Will the first mongos to connect to it bring it back up to date?
[21:21:37] <leifw> looks like the mongos will fail to start and you have to recover the config servers manually
[21:28:03] <jgspratt> which mongo should I install if I want to connec to a remote mongo? http://hastebin.com/tuvoxaxitu.avrasm
[21:30:32] <leifw> jgspratt: I think you want 'mongodb', you don't need 'mongodb-server'. It looks like the python, perl, and php drivers are there as well as mongoose which is a driver for node.js, if you want to use it through any of those languages instead