Log file Viewer

[00:00:32] <Waheedi> so you basically create the dbpath on a cloud block storage volume that you attach to your machine.. and you can play with it

[00:01:17] <joannac> do you control the base hardware?

[00:01:29] <Torkable> is there a way to run mongoose validation on each doc in a collection?

[00:01:47] <joannac> Torkable: -> #mongoosejs

[00:01:52] <Torkable> gotcha

[00:02:13] <joannac> I mean, you can stay here, but I can't help you

[00:02:15] <Waheedi> joannac: i don't think i control the base hardware I wish i do

[00:02:34] <joannac> wait that sounds mean. i just mean i don't know about mongoose

[00:02:35] <Waheedi> joannac: you are such a nice person :)

[00:02:41] <Torkable> joannac: thanks, I went to #mongoose but it was empty and came here :)

[00:03:21] <Waheedi> yes Torkable: #mongoosejs is a different channel

[00:03:34] <Torkable> ....

[00:03:59] <joannac> Waheedi: basically, what happens if stuff goes wrong? don't forget if your storage dies you need to 1. get some more 2. restore from backup 3. catch up from oplog

[00:04:33] <joannac> network problems might not be resolved within 30 mins

[00:04:38] <joannac> ...etc

[00:04:48] <Waheedi> true

[00:05:13] <joannac> pick a number, make your decisions

[00:07:03] <joannac> oh, one more thing. oplog window also restricts how long it takes to do a full sync

[00:07:04] <Waheedi> i just went through a tough case joannac i had three nodes one primary another sec and arbt. the primary node went down and the secondary was elected. the secondary(elected primary) have not catch up with the primary for a long time it was almost a month old compared to the old primary. (my mistake didn't monitor replication lag) now when i restarted the old primary it started giving the fatal state

[00:07:31] <joannac> heh

[00:07:44] <joannac> yup, that'll happen

[00:08:02] <Waheedi> I thought that the problem was with the fatal state node

[00:08:11] <joannac> too much data to rollback

[00:08:24] <joannac> well, it depends on why the primary went down

[00:08:31] <joannac> to begin with

[00:08:55] <joannac> did the machine die? did someone force kill the mongod process? did it crash?

[00:09:03] <Waheedi> it crashed

[00:09:11] <joannac> why?

[00:09:14] <Waheedi> I will now go back to logs and figure out what really happened

[00:09:18] <Waheedi> but after few hours figured out that the secondary (elected primary) node should had the fatal state one

[00:10:05] <Waheedi> i created a copy from the fatal state node dbpath volume and attached it to the elected primary

[00:10:32] <Waheedi> and reconfigured the rs and it worked again syncing on the second

[00:13:18] <joannac> right. so your data is up to date now?

[00:13:42] <joannac> you probably lost a bunch of writes on the old secondary (new primary) though

[00:15:52] <Waheedi> i stopped the writes on the old primary while creating a snapshot from its dbpath volume

[00:16:04] <Waheedi> I'm up to date 100%

[00:16:19] <Waheedi> and the fatal state was about to mislead me to a disaster

[00:19:36] <Waheedi> maybe i lost couple of writes though :)

[00:19:58] <joannac> sounds like you're in an okay state now

[00:20:03] <joannac> anyway, i gtg

[00:20:05] <joannac> good luck

[00:20:10] <Waheedi> pleasure. thanks

[07:20:02] <Draiden> Hello, I've got an issue with Node.js and Mongodb, when I initialize Mongodb and do a fetch for all data (only 2 documents) in a collection it freezes every 5 requests, is anyone familiar with this?

[07:20:08] <Draiden> every +/- 5 requests

[07:24:24] <afroradiohead> Ahh a mongodb chatroom

[07:24:42] <Draiden> hm, after benchmarking a bit futher it seems that it's in the randomizer I am applying to the data...

[07:24:58] <afroradiohead> alrighty, I asked this question to one of my co-workers who apparently knows his stuff about databases.. but I really want more opinions

[07:25:12] <afroradiohead> would you guys prefer to use a nosql database over a sql database anytime?

[07:25:42] <Draiden> http://pastebin.com/0zvuEH4f

[07:26:14] <afroradiohead> or moreso... is it possible to have a big tech website, and I mean big like facebook/amazon with just mongo? (theoretically of ccourse)

[07:30:41] <Draiden> I think that depends on your data wishes, what kind of data do you want to store (I am not a nosql guru)

[07:31:57] <afroradiohead> right, if you're not storing relational data I'm assuming

[07:33:53] <Draiden> yes, so articles and such would be easy

[07:35:36] <Draiden> but storing user related data all in one document would make it less easy to re-use with other data. For exmaple, a user likes an article, you would store that like, in a relational database, in another table with the userId

[07:36:29] <afroradiohead> right, a userid_to_article type table right?

[07:36:45] <Draiden> in a nosql you could save it in key: array setup with some additional information but in this case it would "stick" to that user, and it is the question whether that's a problem

[07:36:46] <Draiden> yes

[07:36:49] <Draiden> for example

[07:37:02] <Draiden> there is some relational setup available though

[07:37:26] <Draiden> http://docs.mongodb.org/manual/tutorial/model-referenced-one-to-many-relationships-between-documents/

[07:37:36] <afroradiohead> but?

[07:45:14] <Draiden> I don't know whether that can immediately solve your problems. I think it really depends on what you want to do with the data to go nosql all the way. another advantage would be speed

[07:45:57] <Draiden> many nosql setups are used as a messaging queue at speeds MySQL cannot easily handle

[07:46:16] <Draiden> and at the end of that queue there could be a sql database storing them for easier access

[07:46:32] <afroradiohead> gotchya

[07:46:45] <afroradiohead> thank you Draiden

[09:56:52] <iksik> any robomongo users here? i'm wondering what's the deal with 'copy collection to database' functionallity... it seems it doesn't work 99 of 100 times :|

[17:21:16] <MacWinner> so i'm storing some PDFs in my gridfs, and am rendering out the PDF into png pages.. any suggestions on how to store the pages in gridfs as well? I was thinking of just storing metadata about slidecount into main PDF.. then storing each slide as "pdf_md5-slide-X"

[17:21:21] <MacWinner> I guess I could also just store an array of md5 hashes for each slide into the metadata of the PDF as well..

[17:21:44] <MacWinner> any suggestions on this?

[18:44:33] <laurensvanpoucke> hello

[18:46:05] <laurensvanpoucke> when I populate after a query. I want to populate 'userId placeId' so 2 fields, but at userId I want to exclude password, how cna I do that ?

[19:27:11] <IvailoStoianov> hey guys, any idea how can I make the int type accept numbers like 08, instead auto making them for example to 8

[19:28:06] <preaction> 08 is not a number. either that's a string "08" or it's an octal, which doesn't have "8" as a digit

[19:28:31] <preaction> if you want leading zeros, you want a string

[20:49:34] <matt17> Hi, I have a question. Without running `mongod`, can I initialize a mongodb database in `/data/db`

[20:54:57] <voidDotClass> If you're querying to find a single record, you would do db.bla.find({foo: "bar"})

[20:55:07] <voidDotClass> what if you wanted to find multiple items, could you pass in an array?

[20:55:20] <voidDotClass> e.g db.bla.find({foo: ["bar", "baz", "bla bla"]}) ?

[20:55:38] <preaction> voidDotClass: try it and see

[20:56:00] <voidDotClass> i'm not logged in to shell so its not that simple to try, i'm writing java code

[20:56:13] <preaction> then write it in java and see

[20:56:22] <voidDotClass> or you can just tell me?

[20:56:36] <preaction> i'll let someone else do that

[20:57:21] <voidDotClass> it would've taken you less time to say yes than to type all of that

[20:57:22] <preaction> but if what you have doesn't work, there's $elemMatch and $in

[20:57:28] <voidDotClass> ah

[20:57:30] <voidDotClass> thanks

[20:57:36] <voidDotClass> in is what i want

[20:57:36] <preaction> it would have taken you less of _my_ time to try it

[20:57:46] <voidDotClass> no it wont have

[20:57:54] <voidDotClass> writing code, compiling, etc

[20:58:04] <preaction> yes, because then _i_ wouldn't have had to do anything at all

[20:58:33] <voidDotClass> anyway, thanks. in is what i want