PMXBOT Log file Viewer

Help | Karma | Search:

#mongodb logs for Wednesday the 20th of March, 2013

(Back to #mongodb overview) (Back to channel listing) (Animate logs)
[01:00:07] <fredix> hi
[01:04:52] <fredix> I try to compile my app with mongodb 2.4 but I get this error external/mongodb/src/mongo/base/status.h:21: erreur : mongo/base/error_codes.h: No such file or directory
[01:26:18] <jzk> fredix: I just came for the same thing
[01:26:56] <jzk> fredix: it seems to have moved to: mongo/build/linux2/normal/mongo/base
[01:27:25] <fredix> jzk: it works with the c++ driver http://dl.mongodb.org/dl/cxx-driver
[01:28:26] <fredix> jzk: in fact scons generate the file : /usr/bin/python src/mongo/base/generate_error_codes.py src/mongo/base/error_codes.err build/mongo/base/error_codes.h build/mongo/base/error_codes.cpp
[01:29:07] <jzk> fredix: for me it was under the src/ directory, but now it builds into the build/ directory, so that has to be part of the include path
[01:33:33] <fredix> jzk: ok
[02:12:30] <akamensky> Folk, i am having problem with getting a subset of embedded documents. Please check this question on SO http://stackoverflow.com/questions/15496071/finding-embedded-documents-in-mongoose-odm
[02:25:17] <bodik> hi
[02:25:46] <bodik> it look that i cannd do a MR job on the top on sharded collection with output reduced into othe other sharded collection
[02:25:58] <bodik> according to docs it should be possible
[02:26:04] <bodik> does anyone have some idea ?
[02:31:28] <bodik> ok i probably found it, i have bad sharding key in the output collection
[03:57:35] <akamensky> Folks, i am having problem with getting a subset of embedded documents. Please check this question on SO http://stackoverflow.com/questions/15496071/finding-embedded-documents-in-mongoose-odm
[04:57:44] <resting> !log
[04:57:52] <resting> !logs
[04:57:52] <pmxbot> http://dcpython.gekitsuu.org
[08:31:17] <[AD]Turbo> hi there
[08:43:38] <ianserlin> congrats on the newest release! looking forward to the new geospatial features
[08:46:31] <Mmike> And hoping that Debian package will finaly get fixed! :)
[09:08:24] <Nodex> 2.4 now running :D
[09:08:39] <Zelest> ...with... FTS!! zomgzomgzomg!
[09:10:09] <kali> patching 2.4 now :)
[09:25:22] <Nodex> capped arrays look interesting
[09:26:50] <Nodex> some docs on it would be nice however!
[09:27:10] <ron> stop whining
[09:27:16] <ron> write your own docs
[09:27:28] <ron> sorry, this disease is killing me.
[09:28:28] <Nodex> http://docs.mongodb.org/manual/reference/operator/setOnInsert/#_S_setOnInsert
[09:28:36] <Nodex> that's a pretty cool feature
[09:29:41] <ron> too bad I won't really be using mongo :-/
[09:30:26] <Nodex> unlucky
[09:31:18] <ron> well, it's a licensing issue.
[09:32:30] <ron> I hope orientdb won't be disappointing.
[09:36:56] <kali> Nodex: yeah, setOnInsert is something that i've often missed
[09:46:03] <rendar> ron: what kind of licensing issue?
[09:47:06] <rev0> hey. someone here?
[09:47:15] <Zelest> o/
[09:48:18] <rev0> i'm using node.js +mongodb+mongoose. do you know why _id's are not generated for mixed schema types?
[09:48:37] <ron> rendar: mongodb is AGPL.
[09:49:01] <rendar> ron: oh..really? i thought it was MIT or APACHE or something
[09:49:14] <ron> nope
[09:49:54] <rev0> the question is about mongoose :)
[09:49:56] <rev0> so?
[10:44:07] <millun> hi can i ask for your favorite Mongo JAVA framework?
[10:45:07] <Zelest> the non java one :-D
[10:49:21] <ron> millun: I have experience with morphia. while it's nice, it has its fault and not really under development anymore. I'd try looking at jongo as well.
[11:13:43] <millun> ron, cheers. didn't know jongo. had experience with morphia, but i figured it's dead either
[11:14:11] <ron> millun: there's a list of available wrappers on mongodb's website
[11:15:12] <millun> ok. last time i was checking jongo wasn't there. or maybe i was browsing another section of the site. maybe they assigned it to a framework category.
[11:15:37] <ron> it's under the java thingie
[11:17:27] <millun> ok
[11:32:44] <fredix> hi
[11:33:06] <fredix> is it possible to replicate gridfs on each node of a replica set ?
[11:33:47] <fredix> it seems that when I store a file to gridfs the file is only in the primary
[12:30:00] <GeertJoh1n> Is there a convention for naming fields that contain a referencing ObjectId?
[12:30:13] <GeertJohan> Maybe user_id or userId?
[12:30:14] <GeertJohan> user-id?
[12:30:31] <GeertJohan> _user_id?
[12:30:55] <GeertJohan> I'm using userId now, but would like to stick to whats being used 'out there'..
[12:32:24] <kali> GeertJohan: the close thing to this is the dbref convention http://docs.mongodb.org/manual/applications/database-references/
[12:33:14] <kali> GeertJohan: but for the rest... you'd better avoid the "user-id" variant, it will drive you crazy when you'll need to query the database in the mongodb shell
[12:33:28] <GeertJohan> kali: ok :)
[12:33:35] <GeertJohan> yeah I don't like a dash either..
[12:33:57] <GeertJohan> DBRef is more about the value of the field, but definitly worth checking out.. Now using manual references..
[12:34:11] <GeertJohan> As the example uses underscore I think I'll use that too...
[12:47:12] <GeertJohan> Hmm, a small note DBRef support. The Go driver for MongoDB (named: 'mgo') does support DBRef: http://godoc.org/labix.org/v2/mgo#DBRef
[12:52:26] <CupOfCocoa> Hey guys, does anybody know how to dump multiple dbs at once with mongodump?
[12:52:39] <CupOfCocoa> eg. I have three dbs a,b and c and I want to dump a and b
[13:12:08] <Nodex> CupOfCocoa : spawn 3 instances :)
[13:12:22] <Nodex> for i in .......... mongodump foo bar baz
[13:48:03] <saml> how do I do faceted search?
[13:53:09] <Nodex> faceting is not part of mongodb
[14:42:16] <underguiz> hi, is it safe to run a mongos 2.4 instance with the --upgrade option while having mongod and mongos on the same sharded cluster?
[14:44:26] <underguiz> the documentation says "The upgrade to MongoDB 2.4 adds epochs to the meta-data for all collections and chunks in the existing cluster. MongoDB 2.2 processes are capable of handling epochs, even though 2.2 did not require them."
[14:44:33] <underguiz> so I guess it's safe
[14:44:38] <underguiz> I just want to be sure
[14:49:01] <kali> underguiz: mongos 2.4 will refuse to start if you haven't run the upgrade before (unless it's the one running with --upgrade, obviously)
[14:49:35] <underguiz> kali, yeap, that's exactly why I'm asking this question
[14:49:59] <underguiz> I'm trying to upgrade my mongos instances
[14:50:32] <underguiz> but I'll keep the mongod proccess running for a while until I can find a safe upgrade window
[14:50:50] <underguiz> that's why I'm trying to figure out the safety of this operation
[14:53:34] <underguiz> there's also this section of the doc: http://docs.mongodb.org/manual/release-notes/2.4-upgrade/#rolling-upgrade-limitation-for-2-2-0-deployments-running-with-auth-enabled
[14:53:47] <underguiz> That says "MongoDB cannot support deployments that mix 2.2.0 and 2.4.0, or greater, components. MongoDB version 2.2.1 and later processes can exist in mixed deployments with 2.4-series processes. Therefore you cannot perform a rolling upgrade from MongoDB 2.2.0 to MongoDB 2.4.0. To upgrade a cluster with 2.2.0 components, use one of the following procedures."
[14:54:21] <underguiz> if I understood it correctly, I can't upgrade it, since my mongod processes are all running 2.2.0
[14:54:29] <underguiz> am I right?
[14:56:04] <Nodex> you need to beat least 2.2.1 to upgrade
[14:56:25] <Nodex> be at *
[14:58:01] <underguiz> Nodex, thanks, is there an option on mongos 2.4 to run in some kind of compatibility mode (like it was 2.2)?
[14:58:30] <Nodex> I'm not sure sorry
[14:58:40] <Nodex> you will need to update to 2.2.1 then upgrade everything after that
[15:00:18] <underguiz> Nodex, that will be a PITA, but thanks
[15:03:27] <GeertJohan> I have a collection containing documents that have a timestamp, reference_id and other fields.. What would be the best approach to get the latest document (based on the timestamp) for each phone_id?
[15:03:33] <GeertJohan> (This is only done at server init)
[15:05:15] <GeertJohan> I could probably use aggregation/pipes with $group. But won't that leave me with just the fields I have named in the $group properties? Seems like a wrong approach...
[15:05:54] <GeertJohan> also I don't want sum or antyhing.. just the last doc..
[15:15:31] <Codewaffle> GeertJohan, If you figure it out, let me know - I'm sort of doing the same thing and $grouping feels clunky
[15:17:16] <GeertJohan> indeed, it seems that with $group you need to name each field.. I don't want to do that..
[15:17:32] <GeertJohan> Also, I don't think that could be the proper way..
[15:17:40] <GeertJohan> Codewaffle: ^
[15:38:28] <saml> how do I serialize object to json?
[15:38:30] <saml> JSON.serialize() ?
[15:38:36] <saml> in javascript
[15:39:49] <saml> i have an object, how can I create a new database /collection and insert the object?
[15:39:58] <saml> mongo old_db schema_change.js
[15:49:07] <Codewaffle> saml, JSON is Javasciprt
[15:49:49] <saml> no, I want to print serialized json
[15:49:56] <saml> so that i can use mongoimport
[15:50:07] <kali> Codewaffle: well, not entirely :)
[17:16:47] <lbjay> question about authentication: I can add users *before* enabling the --auth=true option, right?
[17:17:09] <Nodex> yer
[17:17:23] <Nodex> afaik
[17:18:21] <lbjay> ahh, i just finally found the relevant line in the docs. yep.
[17:18:26] <lbjay> Nodex: thanks
[17:40:48] <millun> ron: have you given a thought to QueryDsl?
[17:49:58] <pior> Hi there
[17:52:22] <pior> Simple question: is there an issue to frequently use the listDatabases command ?
[18:06:13] <Scrat> is the $setoninsert modifier in 2.4 available on findAndModify?
[18:06:24] <Nodex> only on UPSERT!
[18:06:42] <Scrat> upsert, yes of course
[18:09:46] <ron> millun: can't say that I have
[18:28:27] <Mmike> Setting up mongodb-10gen (2.4.0) ...
[18:28:27] <Mmike> Starting database: mongodbstart-stop-daemon: unrecognized option '--interleave=all'
[18:28:27] <Mmike> Try 'start-stop-daemon --help' for more information.
[18:28:29] <Mmike> this is so sad :/
[18:29:51] <azylman> What happens if I have an expireAfterSeconds index on a field in a collection and some of the documents in that collection don't have that field? Will they just not ever expire, or could worse things happen?
[18:30:12] <kali> azylman: they will just stay forever
[18:30:15] <bean> Mmike: what OS
[18:30:19] <azylman> Cool, thanks!
[18:32:47] <Mmike> bean, debian
[18:33:13] <bean> ah, can't really help there, only really have used it on ubuntu, which apparently has a different startup script
[18:33:31] <Mmike> yes, upstart is there
[18:33:36] <Mmike> sysV init - fails
[18:33:39] <Mmike> https://jira.mongodb.org/browse/SERVER-6008
[18:34:03] <Mmike> But this is so serious issue that I'm having doubt's in the rest of mongodb, if a installer can't be fixed for so long
[18:38:23] <kali> Mmike: numa is highly problematic for mongodb, it is explicitely said in the production notes
[18:38:48] <Mmike> kali, but the installation is not working, package is broken
[18:39:08] <Mmike> one can not install mongodb on debian as it is explained in the documentation
[18:39:17] <Mmike> and it's been like that since mongo 2.2.0 at least
[18:40:32] <kali> Mmike: the problem is numa and mongodb are not working well together... there is not a big interest in making the installer works as the real stuff will not be working anyway
[18:41:05] <Mmike> kali, what you're saying is - mongodb is not supported on debian, unless you patch the installer yourself?
[18:41:39] <Mmike> btw, I have several mongodb clusters that work pretty fine, once I applied patch to the startup script
[18:41:44] <kali> i'm saying numa is bad for databases, including mongodb.
[18:41:56] <Mmike> hm
[18:41:59] <kali> debian is not the problem, it's numa
[18:43:47] <Mmike> on Feb 25 14:29:34 [initandlisten] ** WARNING: You are running on a NUMA machine.
[18:43:48] <Mmike> Mon Feb 25 14:29:34 [initandlisten] ** We suggest launching mongod like this to avoid performance problems:
[18:43:48] <Mmike> Mon Feb 25 14:29:34 [initandlisten] ** numactl --interleave=all mongod [other options]
[18:43:54] <Mmike> this is what I get when starting mongodb
[18:44:12] <Mmike> so, when I start mongo with 'numactl --unterleave=all' - all is good
[18:44:13] <Mmike> correct?
[18:44:27] <kali> probably yeah.
[18:44:46] <kali> i'm not saying there is not a bug. i'm saying there is low interest in fixing it
[18:45:01] <Mmike> but mongodb is not installable on debian
[18:45:12] <Mmike> and a fix is pretty simple
[18:45:14] <ron> O_O
[18:45:27] <ron> did he just say that?
[18:45:31] <Mmike> what you're saying is 'there is low interest in getting mongodb to run on debian'
[18:45:39] <Mmike> or I am missing something :/
[18:49:17] <bobbytek> Should one be able to connect to a mongo db even if you are not authenticated?
[18:49:40] <bobbytek> Seems weird
[18:49:59] <ron> one should be able to do so unless one turned on mongodb's authentication mechanism.
[18:50:38] <Mmike> bobbytek, that's default. If you can connect, you are in, no auth required.
[18:51:04] <bobbytek> we enabled auth but we can still connect via the shell, but cannot do anything
[18:51:07] <bobbytek> is that expected?
[18:52:52] <bean> yes
[18:52:53] <Mmike> BobbyBigWheels, yes
[18:52:55] <bean> I believe so
[18:53:01] <Mmike> you need to do db.auth('user','password')
[18:53:10] <Mmike> that should return '1', if it does, you're authenticated
[18:53:42] <Mmike> (but you may wish to recheck the docs about that)
[18:55:00] <Mmike> s/BobbyBigWheels/bobbytek
[18:55:00] <Mmike> :)
[18:55:09] <Mmike> xchat's fault, not mine! :)
[18:56:04] <bobbytek> Thanks guys!
[19:01:15] <fjay> when a replica set is a member of a sharded database.. what interaction is there with the config servers?
[19:09:12] <kali> fjay: i don't think they have any (not 100% sure)
[19:09:57] <fjay> i do see one of my shard replica set members having 6 open connections.. 2 to each config server..
[19:10:14] <kali> ha !
[19:10:22] <kali> well i don't know what they are for :)
[19:10:38] <fjay> me either.. thats what I am wondering.
[19:11:02] <fjay> trying to troubleshoot some connection reset by peer errors between replica set members.. thus causing random elections that should not happen
[19:11:16] <kali> on ec2 ?
[19:11:26] <fjay> rackspace
[19:11:36] <fjay> but.. public cloud so..
[19:11:43] <fjay> same stuff diff vendor :)
[19:12:05] <fjay> kali: have you seen similar on ec2?
[19:12:32] <kali> ok. i've seen this kind of thing on ec2... the cause was changes in security group were sometimes making messing with firewalling rules they had no reason to mess for a short amount of time
[19:13:02] <fjay> interesting
[19:13:14] <kali> enough to be picked up as node failure by mongodb replica, not enough for us to understand what was happening for quite some time :)
[19:14:44] <fjay> one theory someone else has.. (which i call shenanigans on) is that we have too many mongos running and its causing contention w/ the config servers.. hence my question about config servers earlier.. but that has NO input on master elections for the shards
[19:15:20] <kali> i've had connection pool issues to, but the logs were very explicits on this one
[19:16:04] <fjay> this is connection reset by peer between two members of the replica set.. and getting sometransport errors in the logs from the java driver..
[19:46:50] <ron> Nodex: bad linkedin picture.. bad.. bad.. bad...
[20:01:54] <hydrozen> Hey, just wondering, how do people deal with super long uuids (like those generated by mongodb or couch by default) in the url? It's passable when you only have one in your url, but as soon as you have nested resources… having super long ids make URLs pretty intense.
[20:04:13] <ron> you're overwhelmed by it when you type the URLs by hand?
[20:04:43] <hydrozen> I guess all there is to do is generate a slug or anything else unique and shorter..
[20:05:12] <ron> or... it doesn't really matter.
[20:05:16] <hydrozen> i dont type it by hand… it just gets scary looking
[20:05:26] <hydrozen> ./manage/routes/c4a7d2894daf712d8304ccde73036c98/services/c4a7d2894daf712d8304ccde73037c8f/edit
[20:06:10] <ron> ah, so you're worried about the aesthetics of the URLs. you want them to be lean and skinny. use photoshop.
[20:06:52] <hydrozen> thanks
[20:06:55] <Scrat> generate a smaller uid (on another field)
[20:06:57] <Scrat> problem solved
[20:07:51] <Scrat> make it a unique index, check for error 11000 on insertion
[20:13:09] <kgriffs> Question: Does mongo still use a 4k page size?
[20:24:36] <kgriffs> Anybody know?
[20:24:42] <kgriffs> Does mongo still use a 4k page size?
[20:25:33] <pior> kgriffs, why?
[20:26:20] <kgriffs> I heard somewhere that keeping doc sizes under that limit helps with performance.
[20:26:30] <kgriffs> (or maybe I heard wrong?)
[20:27:15] <kgriffs> looks like 4KB is still the norm
[20:27:16] <kgriffs> http://blog.mongodb.org/post/40769806981/checking-disk-performance-with-the-mongoperf-utility
[21:14:18] <Sep1> Hello guys, is there any way, how to get the next and the previous document from MongoDB with using RoR+ActiveRecord?
[21:17:38] <kali> activerecord for mongodb ? that's... unusual
[21:33:27] <fjay> okay.. so i am seeing a ton of connections to my primary mongod's looks like roughly 18k per shard.
[21:33:32] <fjay> is that on the high side?
[21:33:39] <fjay> and should i limit that?
[21:43:57] <ixti> hi all
[21:44:21] <ixti> would like to ask a question about MongoDB ruby driver
[21:44:57] <ixti> sorry. just realized that i know the answer
[21:53:45] <yfeldblum> after a replSetInitiate on the local mongod which is the only member of the replset (i'll add peers later), and calling isMaster, it reports the local node as a secondary ... what i'd like to do is to figure out if it's currently voting for a new primary and wait for that voting to be finished ... how can that be done?
[21:57:26] <fjay> yfeldblum: you could give it 2 votes
[21:57:29] <fjay> perhaps?
[21:57:56] <yfeldblum> fjay, that's not the problem; the problem is i need to wait until the voting is finished
[21:58:07] <yfeldblum> fjay, so i need to know what flag or property to wait on
[21:58:35] <fjay> i guess I am confused as to what you are doing
[21:59:38] <yfeldblum> fjay, automating some sysadmin
[22:00:07] <yfeldblum> fjay, i'm setting up a replset with a single node, and waiting for the state to stabilize to primary, and after the state is stabilized, do some more things
[22:00:57] <fjay> can you just create it standalone. then make it a replica set later?
[22:03:20] <yfeldblum> fjay, no
[22:03:57] <yfeldblum> fjay, i mean i'm sure i could, but that will require a lot more automation work
[22:04:24] <fjay> the voting should take i think 10-20 sec at most
[22:04:41] <fjay> you could just keep querying it as to its state
[22:04:45] <yfeldblum> fjay, i just need a property to look for
[22:04:56] <fjay> rs.status() should have info
[22:05:03] <fjay> is that what you mean?
[22:19:09] <fjay> ooh.. i think i found my issue..
[22:19:21] <fjay> connection refused because too many open connections: 20000
[22:23:13] <fjay> kali: looks like i found my smoking gun :)
[22:55:39] <djangoobie> Hi I'm very new to mongodb and I'm using mongoose. When defining a schema with a field to a related schema I sometimes see people using ObjectID with a ref attribute and sometimes the related schema itself. Is there a difference between the two?
[23:58:14] <nemothekid> How long does mongos --configdb <config server> --upgrade take?
[23:58:50] <nemothekid> and can I run 2.2 mongos processes in parallel (so I don't have any downtime?)