Log file Viewer
#mongodb logs for Thursday the 21st of August, 2014
[01:40:46] <topwobble> the indexes seem to be rebuilt, but simple mongo queries that should use indexes are taking a long time (minutes)
[01:45:51] <topwobble> Index queries are taking a long time, depsiting using the index. Any thoughts?
[01:46:10] <topwobble> here’s the explain() of a find() https://gist.github.com/objectiveSee/c979f3676089dcd94e4a
[01:49:39] <topwobble> running the find() takes ~3 min. Running it again took 10 seconds, running a third time took ~4 seconds
[01:53:19] <Boomtime> do you seriously need to find 2 million documents and return them to the client?
[01:53:38] <topwobble> Boomtime: no. this was just a test to ensure that our indexes are working before we turn our game server live again
[01:54:05] <stefandxm> topwobble: what Boomtime is trying to say is; indexes will only make sense if you use them with constraints
[01:55:58] <stefandxm> toothrot: think of indexes as presorted data. if you have one million random numbers spread out in a file and add constraint number > 3 and number < 1 million it will have to loop through all numbers because there is no order. if you add an index it will be able to jump to 3 and start the loop linear.
[01:56:27] <stefandxm> toothrot: but if you take all of them, ie 0..max it will loop through the same amount of data anyways
[01:57:01] <stefandxm> of course, if you want them sorted, then the index can help, because then it is presorted so no extra sorting is required
[02:06:23] <topwobble> We use indexes with constraints… just in this example I was not using them to excersise the existense of indexes
[02:10:59] <topwobble> a query like : {foo: {$gt:3, $lt :1000} is compound and can’t be indexed… if i am not confused
[02:14:13] <joannac> you can use that index, find the first entry for which foo > 3, continue reading index entries until the one where foo > 1000, and bam, you're done
[03:12:40] <d0tn3t> i'm setting up replica mongodb, i set my server1 is Primary but after i use rs.initiate(....) my server1 become SECONDARY
[03:41:23] <joannac> for the second time, your first rs.status() is cut off. please pastebin a new one
[03:42:37] <joannac> also, the aim is to verify you can connect from your first host 192.168.100.111 to your second host 192.168.100.222
[03:59:44] <Boomtime> either an address is wrong, or a port, or one of them isn't running, or a firewall is blocking them, or some other network problem
[04:00:24] <Boomtime> the members of your replica-set cannot see each other, that is all we can know, you must investigate why
[05:01:58] <AlecTaylor> fooRec = {‘bar’: ‘can’, ‘haz’: ‘foo’}, barRec = {‘foo’,’can’, ‘haz’,’foo’}; - How do I join the first 50 fooRec’s with their corresponding barRec?
[05:11:18] <AlecTaylor> fooRec = {‘bar’: ‘can’, ‘id’: ‘foo’}, barRec = {‘foo’,’can’, ‘fid’,’foo’}; - How do I join the first 50 fooRec’s with their corresponding barRec?
[05:35:08] <Boomtime> if this were one collection then what you are doing is trivial using aggregation (though you could do it with map-reduce too)
[05:46:03] <AlecTaylor> Hmm, looking at: http://www.noppanit.com/merge-documents-two-collections-together-mongodb/
[05:51:17] <Boomtime> then the lnked article will not work, it sets the _id of the merge result to a value from the left-hand source, there is no way for the right-hand merge to multiply that by it's own occurrences
[05:52:09] <Boomtime> monogdb does not have joins, you must do at least some of the work on the client, or write a better schema
[05:54:36] <AlecTaylor> Hmm - http://stackoverflow.com/questions/5681851/mongodb-combine-data-from-multiple-collections-in-to-one-how
[05:56:33] <Boomtime> heh, i was about to say that looks like a lot of work, but the author already did:
[05:56:35] <Boomtime> "This technique should definitely not be performed on the fly. It's suited for a cron job or something like that which updates the merged data periodically."
[07:55:22] <Genitrust> is it possible with mongodb to allow a user to *only* insert new data in the mongodb?
[07:57:31] <frsk> Doesn't look like it according to http://docs.mongodb.org/manual/reference/built-in-roles/
[10:05:48] <cipher__> I'm getting a utf8 decoder failed invalid continuation byte at something the rather from python? I'm trying to load in data from a mongo database, is there a way to repair utf-8 before doing this?
[13:21:39] <tscanausa> jordana: I could. I just need to feel up disk space on all of the nodes with out blocking.
[13:21:43] <sfix> hi guys, on the latest build of MongoDB the /var/run/mongodb directory is deleted every time the machine reboots, why's that?
[13:25:21] <tscanausa> I dont care about blocking the slaves just not writes to the master. I didnt know if repairDatabase was a master only operation.
[13:27:39] <jordana> tscanausa: then you should be able to use it. If the database is empty though why don't you just delete the db files?
[13:28:55] <tscanausa> its an analytics cluster where the amount of data get out of hand. I need the indexes to stay around. I used to just drop the entire database, but I cant do that any more.
[13:43:23] <sfix> so to ask again, is there any reason why MongoDB no longer creates /var/run/mongod when started?
[15:29:06] <jasondockers> I'm using mongo::bsonobjbuilder with std::strings of header and body info from emails. It inserts and looks correct in mongodb, yet python is giving me errors that indicates it's invalid utf8- doesn't the mongo driver ensure it's utf8 encoded, or it can't be inserted?
[15:39:10] <sebastian_o|> hi guys, after upating/upgrading via breew, mongd command doesn't start mongodb anymore here. Any hint in how to get it loading the .conf again?
[16:13:17] <kees_> using PHP, what could be the reason for this behaviour?; I'm storing an integer (confirmed with var_dump just before i do save()), but when i retrieve that value i get a float
[16:14:58] <Derick> hmm, makes no sense. Can you show me a very simple script that shows this behaviour?
[16:21:51] <sebastian_o|> anybody knows what's the path that mongodb expects to find mongodb.conf by default in a OS X brew installation?
[16:22:29] <kees_> not yet.. if i use the very basics it works, if i use our entire codestack it doesn't :/
[16:41:38] <hubertus> Hi Everyone. I have a question regarding an aggregate problem. I basically have a collection which stores impressions of an article by a visitor. I want to get some stats for a certain article. I have a writeup of my problem here: http://paste.ofcode.org/a6J3Ni4cEbgFWFWCLneJRM Could someone assist me with the question at the end?
[16:50:32] <blizzow> I have a db(mydb) with a few collections within it. The collections are named A,B,C,D... From the mongo shell, how would I remove a specific collection? Say C. I already logged in and did: use mydb. but I'm mildly stumped from there. The db.collection.drop documentation says it takes no arguments and I don't want to drop A,B, or D.
[17:49:45] <hubertus> Hi Everyone. I have a question regarding an aggregate problem. I basically have a collection which stores impressions of an article by a visitor. I want to get some stats for a certain article. I have a writeup of my problem here: http://paste.ofcode.org/a6J3Ni4cEbgFWFWCLneJRM basically what I want is to group and count distinct.
[17:50:10] <kees_> Hmpf. got to love the fact how random this is and i still haven't figured it out.. tcpdump shows me inserting a Int64(0x12)46943, and when i query it is get a Double(0x01)46942.. but not always
[19:36:38] <JonSno> Im new to mongodb land and need advise on how I can easily import my json file into mongodb
[19:39:16] <JonSno> currently I have a wordpress site that generates a 124k json file of all posts and pages. I will then import into mongodb
[19:39:33] <dberry> mongodb config server question: I have mongo1,mongo2,mongo3 as my config servers. If I use host files can I change the name to mongo{1,2,3}-cfg (same IP) and restart mongos?
[19:51:19] <Zelest> jasondockers, string.chars.select{|i| i.valid_encoding?}.join.strip .. if you were using ruby.. can't you do something similar in c++?
[19:51:22] <SkramX> in an aggregate query's project, how do i reach into an array and get just the first item?
[19:53:58] <svinay> hi! In our mongo logs, we see a lot of entries like "insert <our_db_name>.system.indexes keyUpdates:0 locks(micros) w:93" ... does it mean that an index rebuild happened at that instant?
[19:55:05] <svinay> too many such entries, around 1000 such entries in a time span of 50 mins, for a minimal load of around 1000 connections at the max
[20:00:21] <meonkeys> (FYI, related to my earlier question: http://stackoverflow.com/questions/25434872/why-are-two-equivalent-isodate-values-not-equal )
[20:11:05] <darkpassenger> is there such a thing as "if not found, create, if not found, don't do anything" query ?
[21:17:07] <ngl> Hi all. I'm doing some research and wanting to make an alert system of sorts. I don't mean on mongo metrics, but a simple example would be: A user is expected to log in by a specific time. But, that user failed to login... send alert.
[21:19:17] <ngl> I can use that to send, but can I watch a value within mongo and cause some event... hmm.
[21:21:27] <ngl> I was just trying to utilize mongo, but maybe my idea isn't going to work. I didn't want to keep... ah, I can keep just the next expected "login" in memory and when that is reached I'll do alert and grab the next from mongo.
[23:13:16] <jaraco> I want to reset the authentication state for a MongoDB instance. Can I simply wipe admin.system.users?