Log file Viewer

[00:27:43] <willwh_> hi guys - is there a mongoose channel? :)

[01:08:51] <rpcesar> im planning out an architecture that involves using local redis instances on 2 core systems for fast access on lightweight nodes for user sessions and items created on the particular node, however I am considering using a mongo replica set for storing persistant data such as long term user data and "archives" (migrating data to redis for counts and lists which get map/reduces later)

[01:09:40] <rpcesar> however, im concerned (curious) about the use of blocking tailable cursors in a replica-set situation. I know that capped collections cannot be shared, but whats the performance metrics and are there any problems related to replication with them?

[01:10:06] <rpcesar> *sharded not shared

[01:10:36] <rpcesar> im consderned with things like if its slaveOK safe and stable, etc

[01:10:57] <rpcesar> and is it only consistant with writes, what about slaves? etc.

[02:05:03] <xudongz> how can I specify the projection for a query through the wire protocol?

[02:08:26] <xudongz> meh should have read more carefully. returnFieldsSelector is what i was looking for

[05:34:00] <rpcesar> do tailable cursors (in await mode) support filters? I understand they do not support indexes, but I can't get a clear answer on whether it (in combination with blocking) allow blocking tailable cursors to maintain a filter.

[05:36:12] <rpcesar> in short, im using a few capped collections as a message pump of sorts. frontends write to the collection (single standalone mongo instance which contains only 4 capped collections). The plan is The frontends tail these collections as well and recieve the data. Ideally, i dont want the low-weight frontends to be recieving more data then necessary, only what would apply to those in its session

[05:37:49] <rpcesar> now originally, i was going to tail all that data and split it up on the consumer end and avoid the question (since I thought I read something that preciptates issues with that), but if the filtration could be done on the server, i could easily partition the data the server recieves at an earlier level, eliminating unnecessary network congestion and processing on stressed frontends

[05:39:18] <rpcesar> is this at all possible?

[07:46:51] <darkpassenger> hi all!

[07:47:24] <darkpassenger> Why is it that mongodb wraps my json object into another object just so it seems to be able to add its _id key ?

[07:47:44] <darkpassenger> does anybody know what im talkinga bout

[07:51:03] <darkpassenger> help

[07:51:03] <darkpassenger> lol

[08:12:22] <Infin1ty> when resync a replicaset member, i notice that the most consuming task is building the index, is there a way to make it multi-threaded, it's seem as this process is single-threaded

[08:17:57] <spyzer> hey guys, if i have a field as an array in a document and i have to do a projection where only that array field is retrieved so how do i do that in projection

[08:18:19] <spyzer> e.g {'name': 'username', permissions: ['1','2','3']}

[08:18:29] <spyzer> so i just wanted to have permissions

[08:22:14] <spyzer> seems that was easy

[09:59:07] <zoek1> spyzer can do it with db.collection.find(query, { permissions:1, _id: 0})

[10:16:28] <statu> hi!

[10:18:16] <statu> I have a schema which stores a serie of ObjecId of other Schema (as a foreign key)

[10:18:49] <statu> is it possible to make a query which gets all the documents referenced by these ObjectId?

[10:19:26] <ron> yes, but not in a single query. that is, you can't get the referring objects and the referenced ones in a single query.

[10:19:41] <statu> ron, I have to use forEach?

[10:20:51] <foofoobar> Hi. So lets say I have a collection with a few million entries. Is it slow to access/search in it?

[10:21:09] <statu> ron, I was thinking to make it using something like that: Schema1.find(where, function(error, result) { result.forEach(Schema2.findOne(result.get('foreignKey'))})

[10:23:11] <statu> ron, but I don't know if is it the best way

[10:23:27] <ron> I can't say really.

[10:23:52] <statu> Ok

[10:24:03] <statu> I will search more info in google. Thanks :)

[10:24:25] <ron> possibly ask tomorrow when the channel is more active.

[10:25:05] <statu> Ok, thanks!

[10:33:49] <mnml> is it possible to aggregate on a subfield using the Java Driver ?

[10:34:35] <mnml> I would like to use the GroupCommand class but I'm not sure If I can describe a subfield using BasicDBObject

[10:35:08] <ron> foofoobar: that's easy enough to test on your own.

[10:35:43] <foofoobar> ron, I just need some general data

[10:35:47] <foofoobar> does it need seconds?

[10:35:51] <foofoobar> or ms?

[10:36:04] <ron> that depends on many variables, but I imagine ms.

[11:36:41] <teeceepee> is it ok to delete mongodb log files

[11:36:45] <teeceepee> its taking huge space

[11:43:07] <TripleDES> Hi :)

[11:43:59] <ron> teeceepee: http://docs.mongodb.org/manual/tutorial/rotate-log-files/

[11:44:06] <TripleDES> Does this command "mongo admin --eval "printjson(db.system.users.find())"" work properly for anyone? (needs to have some users created)

[11:44:17] <teeceepee> ron here its on log rotate

[11:44:31] <teeceepee> but its still huge nevertheless 12G

[11:44:41] <teeceepee> I am on a 14G server

[11:44:59] <teeceepee> ron is it fine to delete old .gz log files?

[11:45:12] <ron> dunno

[11:51:24] <TripleDES> hmm if I add .toArray() to the find it works, otherwise it prints find's help

[15:10:51] <coldclimate> Afternoon all, can anybody help me with an odd request - is it possible to add a new member to a replica set with it hidden and with no voting rights right from the start, rather than adding it and then setting?

[19:22:59] <ml623> Hello, newbie with mongodb abd scala/casbah, with an issue with geointersect query: https://gist.github.com/lrhazi/670c3fc20086011cadcf

[19:23:27] <ml623> the error is: [MongoException: can't parse query (2dsphere): { $geoIntersects: { $geometry: { $type: "polygon", coordinates: [ [ -7.739, 33.615 ],...

[19:23:56] <ml623> any hints appreciated, a lot.

[19:42:07] <remonvv> \o

[19:44:05] <ml623> Anyone knows if the google group mongodb-user is moderated? I posted my question but it does not seem to show up!

[19:45:05] <remonvv> I think it is.

[19:46:12] <ml623> remonvv: Thanks. maybe my post will showup later then.

[19:47:10] <remonvv> Yep, or try here

[19:47:52] <ml623> I tried earlier: an issue with geointersect query: https://gist.github.com/lrhazi/670c3fc20086011cadcf

[19:48:11] <ml623> err is: [MongoException: can't parse query (2dsphere): { $geoIntersects: { $geometry: { $type: "polygon", coordinates: [ [ -7.739, 33.615 ],

[20:00:57] <remonvv> Isn't $type parameter case sensitive?

[20:00:57] <geoffw8_> Howdy mongo

[20:01:13] <geoffw8_> newbie here, I'm trying to get to grips with queries. This isn't currently an OR statement, right?

[20:01:14] <geoffw8_> @feed = coll.find("feed.id" => {'$in' => stringy_store_ids}, "brand.id" => {'$in' => stringy_brand_ids})

[20:01:29] <geoffw8_> I can't for the life of me work out how to make it an OR, using the syntax

[20:01:49] <remonvv> geoffw8_, try shell syntax so more people can help ;)

[20:02:11] <geoffw8_> remonvv: you mean literally mongo shell syntax? crikey, would if I could!

[20:02:19] <remonvv> It's certainly not an OR operator, although an $in can be seen as such

[20:02:39] <geoffw8_> remonvv: my problem is arguably working out how to get the mongo query into something rails likes

[20:02:50] <remonvv> Yes, like your query is actually {feed.id:{$in:stringy_store_ids}, brand.id:{$in:{stringy_brand_ids}}}

[20:03:18] <remonvv> Yes, so first learn how to do the query in JSON syntax, and then translate to your language of choice ;)

[20:03:20] <geoffw8_> remonvv: yeah, thats what the docs tells me, where the "," in this context acts as an OR, right?

[20:03:26] <remonvv> No

[20:03:29] <remonvv> comma's are AND

[20:03:33] <geoffw8_> oo

[20:03:35] <geoffw8_> ok

[20:03:39] <remonvv> so {a:1, b:1} is a:1 AND b:1

[20:03:45] <remonvv> ORs are done through $or

[20:03:50] <ron> remonvv: dafaq? don't ignore me

[20:03:53] <geoffw8_> ok, I'll have a play in the console I guess

[20:03:53] <remonvv> {$or:[{a:1}, {b:1}]}

[20:03:59] <ron> :*

[20:04:06] <geoffw8_> ah, the or goes first

[20:04:11] <geoffw8_> ok, I'll have to have a play in the console

[20:04:20] <geoffw8_> thanks remonvv

[20:04:33] <remonvv> yw

[20:09:44] <ml623> remonvv: Regarding case sensitivity.. I assumed the examples in the casbah doc are correct: http://mongodb.github.io/casbah/guide/query_dsl.html#geospatial-operators

[20:12:35] <ml623> remonvv: actually just tried Polygone and gives same error: [MongoException: can't parse query (2dsphere): { $geoIntersects: { $geometry: { $type: "Polygon", coordinates: [ [ -7.739, 33.615 ]...

[20:13:53] <ml623> also tried without $ in $type: [MongoException: can't parse query (2dsphere): { $geoIntersects: { $geometry: { type: "Polygon", coordinates:...

[20:17:49] <ahershko> Hi

[20:18:44] <ahershko> Is it better to ask questions or, or via stackoverflow.com?

[20:18:49] <ahershko> (or = here)

[20:20:48] <ml623> I'd try everywhere, also google group mongodb-user

[20:21:23] <ahershko> Ok, I'll start from here then :)

[20:21:31] <ahershko> It's a MapReduce question.

[20:23:14] <ml623> that's what I am dong too, trying. I cant help u with map/red, but maybe you ll get lucky with someone elese.

[20:23:49] <ahershko> Ok, might try the other places then :)

[20:23:55] <ahershko> Maybe I can help you, if you have a question.

[20:24:30] <ml623> its scala/casbah/geointersects .. gives me syntax errors

[20:30:05] <ml623> I just tried copy/pasting the exact example in the documentation for geointersects and get the same error!!!

[20:44:51] <remonvv> ml623, using the right db version?

[20:45:23] <remonvv> ml623, needs 2.4+

[20:45:32] <ml623> I think so. I used Python to load my docs and tested my geointersect queries... works fine.

[20:46:08] <remonvv> Okay, odd.

[20:47:16] <remonvv> casbah issue maybe?

[20:48:55] <ml623> remonvv: just checked db version is 2.4.5... yeah this is definitely casbah issue... maybe I have wrong version there somehow... I used sbt which I assumed would get the latest... will double check that. thanks.

[20:49:45] <remonvv> Yep, good luck ;)

[20:49:52] <remonvv> I'm off to bed. tc

[20:50:47] <ml623> thanks.

[23:24:53] <pquery> can anyone help with a replication issue? I'm trying to replicate with ssl in aws, I keep running into an exception exception: need most members up to reconfigure, not ok ..." this is for both the ip and the hostname, and I can telnet to port 27017 on the instance(s)

[23:25:36] <pquery> I can't seem to rs.add or do a rs.reconfig

[23:43:44] <pquery> never mind it all came down to my keyfile being 1 character off

[23:52:29] <PaiSho> does anyone know how to retrieve a collection from a DBObject with the java driver?

[23:52:40] <PaiSho> i have a db object called "user"

[23:52:47] <PaiSho> oh

[23:52:49] <PaiSho> wait

[23:52:53] <PaiSho> nvm i think i figured it out