Log file Viewer

[00:26:09] <jcims> hey folks, n00b here, i'm trying to put together my first non-trivial document design and am wondering if there are any particular tools that people like to use

[01:10:59] <snihalani_> Hi Everyone

[01:11:21] <snihalani_> I needed help with sdeciding the schema for my app

[01:11:23] <snihalani_> in mongo

[01:11:36] <snihalani_> Anyone there?

[01:12:22] <snihalani_> testing

[01:12:38] <snihalani> #testing.

[01:12:49] <snihalani> Can anyone help me

[01:12:50] <snihalani> ?

[01:33:40] <svm_invictvs> Heya

[01:34:45] <svm_invictvs> I have a document in my database that contains an array of items. I have a single item and I want to find all of the documents whose array contains the given single item.

[05:01:17] <mrpro> awesome

[05:01:19] <mrpro> Sun Nov 4 00:06:31 [conn146480] authenticate: { authenticate: 1, nonce: "73352e1356070e9", user: "test", key: "090f270f23645db959949133a1aa121d" }

[05:01:19] <mrpro> Sun Nov 4 00:06:31 [conn146480] authenticate: { authenticate: 1, user: "test", nonce: "f877e2cc1cf8c303", key: "945be6ddc59784e9e91a39eb4b6c5629" }

[05:01:20] <mrpro> Sun Nov 4 00:06:31 [conn146480] warning: virtual size (17305MB) - mapped size (13086MB) is large (4218MB). could indicate a memory leak

[05:01:20] <mrpro> Sun Nov 4 00:06:31 [conn146480] end connection 127.0.0.1:40897

[05:01:20] <mrpro> Sun Nov 4 00:06:33 [initandliste

[05:01:29] <mrpro> truncated log

[05:01:31] <mrpro> process dead

[05:02:02] <frsk> disk full?

[05:03:03] <mrpro> haha

[05:03:03] <mrpro> yes

[05:03:05] <mrpro> fml

[05:03:13] <bakadesu> fun times

[05:03:14] <frsk> hah! :)

[05:03:16] <mrpro> i first assumed it and then i was like naaaah

[05:03:23] <mrpro> cant be i had 28gb yest

[05:03:30] <mrpro> dont worry not production

[05:03:30] <mrpro> :)

[05:03:52] <mrpro> so why that leak msg tho

[05:03:56] <mrpro> it couldnt flush?

[05:04:16] <frsk> Disks filled up cause a lot of fun problems all over.. not just with mongodb :p

[05:04:32] <frsk> Yeah, probably

[05:04:46] <frsk> (Wild guess, though)

[05:05:03] <bakadesu> So how would one recover from this? Is it possible to spin it back up, create a replica on a bigger server?

[05:05:48] <frsk> Hm.. Interesting

[05:05:57] <frsk> I've never had a mongodb server run out of space

[05:06:05] <frsk> So.. no idea

[05:06:12] <mrpro> looks like my mongo db files are too damn big

[05:06:17] <bakadesu> I heard you need space to do repair/compact

[05:06:27] <frsk> bakadesu: In theory you could probably get away with moving to a new server

[05:06:28] <mrpro> bak: well i can delege the 600meg log file to start

[05:06:29] <mrpro> :)

[05:06:31] <frsk> But the oplog could be messed up

[05:06:44] <mrpro> damn oplog messed up why

[05:06:48] <mrpro> wouldn't it reject transaction if cant write

[05:07:12] <frsk> it *should*

[05:07:18] <mrpro> hmm

[05:07:24] <mrpro> i need to find large files

[05:07:26] <mrpro> see where it filled up

[05:07:28] <mrpro> any suggestions?

[05:07:39] <bakadesu> linux distributions?

[05:11:04] <mrpro> centOS

[05:11:14] <mrpro> yea so like… Python-Diamond filled up logs

[05:11:20] <mrpro> its a stats daemon

[05:11:29] <mrpro> def need archiver in prod

[15:56:50] <sulaiman> Hi

[15:56:57] <sulaiman> what is the difference between save and insert?

[16:44:56] <sulaiman> sulaiman: save updates if _id already exists, inserts otherwise

[16:45:11] <sulaiman> sulaiman: thanks

[17:33:09] <moskiteau> i have a mongodb capped collection with a tailable/awaiting cursor. A user can make a request with criteria. Each time he does, a thread is created on the server listening and pushing to the client the new items.

[17:33:38] <moskiteau> but that doesn't sound like a good idea, if i have many users, everything will crash, so how can i build something smarter?

[17:47:34] <moskiteau> the best would be to register triggers that fire events when insertion match the user queries

[17:47:45] <moskiteau> but how is that even possible?

[18:01:28] <desiac> Anyone here to help? Every 30 mins my mongo disk io writes going to 100% and getting messages like [DataFileSync] flushing mmaps took 73578ms for 12 files