pmxbot IRC Log Viewer

[00:07:10] <bambanx> guys any good data visualizer? like navicat for mysql ?

[00:13:15] <bambanx> is any good? thanks

[00:19:18] <whatsdoom> if the mongod service hangs for a significant period of time before responding to requests to stop i.e. shutting down the machine. is there anything I can do to figure why?

[00:20:07] <Boomtime> whatsdoom: look in the mongod.log

[00:21:55] <whatsdoom> Boomtime: I have, it doesn't say anything that would suggest what is taking so long to stop

[00:30:52] <whatsdoom> Boomtime: actually thanks, I lied apparently I set the logging level to none rather than most.

[00:38:53] <Boomtime> whatsdoom: loglevel zero will still log a few things, and might even cover why a shutdown would take awhile

[00:39:43] <Boomtime> whatsdoom: what do you call "significant" by the way, can you put a figure on that? 2 seconds, 10 seconds, 10 minutes?

[00:41:36] <whatsdoom> 10 minutes

[00:42:18] <whatsdoom> log level 0 was only saying things periodically about the memory usage

[00:57:15] <Boomtime> whatsdoom: is this a replica-set?

[01:07:45] <whatsdoom> Boomtime: It is not

[01:10:06] <whatsdoom> I think one of the processes attached to the db is not stopping when I think it is, and that is keeping from mongo. I will in investigate more. Thanks Boomtime

[01:10:42] <whatsdoom> s/from mongo/mongo from stopping/

[02:06:56] <chris_______> Hi Folks!

[02:07:41] <chris_______> I'm a C/C++ programmer venturing into the world of Python/MongoDB

[02:08:43] <chris_______> I've got a quick question but I'm not sure if it's Python or MongoDB

[02:09:39] <chris_______> I'm writing a simple utility app using Python. It scans predefined directories for plugins and then writes them to a database.

[02:10:17] <chris_______> I can write to the database OK but I'm having trouble getting the search to work

[02:10:36] <chris_______> in the Python code!

[02:10:48] <GothAlice> Boy howdy, that's a lot of underscores.

[02:10:55] <chris_______> But I can get it to work from the mongo console

[02:11:01] <GothAlice> Give me a moment and I'll dig up a gist of some Python code that does exactly what you're looking for.

[02:11:31] <chris_______> Cheers!

[02:11:46] <chris_______> Underscores were put there automatically!

[02:12:54] <GothAlice> chris_______: https://github.com/marrow/package/blob/develop/marrow/package/host.py#L16

[02:13:07] <chris_______> Thanks! I'll have a look

[02:13:13] <GothAlice> And/or https://gist.github.com/amcgregor/dda39062f8b4f74f5e1a#file-migrate-py-L16

[02:15:37] <chris_______> Ha! Over my head Python-wise already!

[02:16:16] <chris_______> What I wanted to know was why:

[02:16:31] <GothAlice> chris_______: Both of these expect "plugins" to be installed Python packages. ("setup.py install" or "setup.py develop" or "pip [options] .", etc.) The PluginHost lets you register additional directories to search for packages in, however it also expects these packages to participate in the de-facto "plugin" standard called "entry_points". https://github.com/marrow/marrow.mailer/blob/develop/setup.py#L75 is an example.

[02:16:44] <chris_______> > db.audio_effects_collection.find({"name":"AradazMaximizer5.vst"}).count()

[02:16:45] <chris_______> 1

[02:17:02] <chris_______> works.

[02:17:04] <chris_______> but

[02:17:25] <chris_______> result = db.collection.find({"name":"AradazMaximizer5.vst"}).count()

[02:17:26] <chris_______> print result

[02:17:31] <chris_______> returns 0

[02:17:32] <chris_______> ?

[02:17:53] <GothAlice> … they're not the same collection?

[02:18:00] <joannac> collection vs audio_effects_collection ?

[02:18:03] <GothAlice> Indeed.

[02:18:13] <GothAlice> Those are different collections. db.<collection>.<operation>

[02:18:17] <chris_______> One is from the console, the other is Python

[02:18:28] <GothAlice> They should match in this respect.

[02:18:35] <GothAlice> Otherwise you've got apples and oranges.

[02:19:13] <chris_______> Ok, I'll have a look. The write to the database works though.

[02:19:18] <GothAlice> It would.

[02:19:24] <GothAlice> "collection" is a valid collection name.

[02:19:41] <GothAlice> (run db.getCollectionNames() in the mongo shell ;)

[02:19:54] <chris_______> ok

[02:20:27] <chris_______> [ "audio_effects_collection", "system.indexes" ]

[02:20:54] <GothAlice> What's your "write" line?

[02:24:09] <chris_______> db = conn['audio_effects_database']

[02:24:17] <chris_______> collection = db.audio_effects_collection

[02:24:35] <chris_______> for effect in effects_list:

[02:24:36] <chris_______> doc = {"name":effect[0],"location":effect[1],"type":effect[2]}

[02:24:44] <chris_______> collection.insert(doc)

[02:24:51] <GothAlice> Looks great.

[02:25:21] <chris_______> That's what I thought too!

[02:25:28] <GothAlice> result = db.collection.find( # problem here, the part that matches s/db\./

[02:26:09] <GothAlice> That's getting a reference from "db" for a collection called "collection". It is not using the variable named "collection" that is the "audio_effects_collection" collection.

[02:26:22] <chris_______> Ah

[02:26:35] <GothAlice> Apples and oranges. :)

[02:27:14] <chris_______> I'll give it a try

[02:30:39] <chris_______> Working now - yay!

[02:31:00] <chris_______> Many thanks GothAlice :-)

[02:31:08] <GothAlice> In Python, though, there is a standard for plugins.

[02:31:41] <GothAlice> They're searchable, namespace-able, and can give names to arbitrary object imports, so you can have data associated with them. (This also lets plugins define their own dependencies for installation/use.)

[02:32:11] <GothAlice> Search around for "setuptools entry points" (how you declare plugins) and "pkg_resources" (how you search and load plugins).

[02:32:37] <chris_______> Ok, thanks for the help.

[02:32:39] <chris_______> Bye

[03:34:39] <NoOutlet> Hey everybody.

[03:35:17] <NoOutlet> Anyone here attempted mongodb on a raspberry pi?

[03:36:09] <GothAlice> NoOutlet: It's the wrong endianness.

[03:36:22] <joannac> not officially supported, if you want to build your own, go nuts

[04:41:51] <daidoji> hello quick question if anyone's in here, does mongod --repair finish or does it work in place as a daemon process?

[05:05:50] <giowong> anyone know

[05:06:09] <giowong> if there exists a command to get collectionNames not in mongo shell?

[05:12:13] <Kamuela> what's the naming convention for things like user_id and such as i'm guessing it isn't underscores

[05:55:00] <jalcine> uid

[05:55:06] <jalcine> wait this is mongo

[05:55:10] <jalcine> user_id makes more sense

[06:10:55] <Kamuela> jalcine: does it really?

[06:11:17] <Kamuela> i thought mongo was more json-ish so it used more js convention

[06:11:27] <jalcine> real talk, it's what you make of it

[06:11:36] <jalcine> if it doesn't break your schema, then you're good

[06:11:41] <jalcine> "best practices" are fun in production

[06:13:04] <Kamuela> interesting

[09:25:47] <jdo_dk> It is possible to update a element in an array directly in mongo shell ? I have tried: db.coll.update({_id:ObjectId(...)}, {$set: {log[0].text: 'Changed text'}}) but it is not working.. :(

[10:36:29] <Rickky> Morning

[10:36:41] <Rickky> Can I pose questions about the new Ops Manager here as well?

[10:46:44] <spuz> hello

[10:47:24] <spuz> I want to implement optimistic locking, what kind of field should I use to verify a document has not changed since it was last read?

[10:47:48] <spuz> I am thinking of adding either a timestamp or a sequence number field to each document but not sure which is preferred

[10:56:18] <spuz> I will use a version number field: http://docs.mongodb.org/manual/tutorial/update-if-current/

[11:28:52] <akanksha> Hello.

[11:29:19] <akanksha> I need help installing mongodb on my ubuntu 14.04

[11:29:26] <akanksha> Can someone help?

[12:54:48] <joannac> akanksha: http://docs.mongodb.org/manual/tutorial/install-mongodb-on-ubuntu/

[13:17:43] <FiftyFivePlus> in node.js is mongodb without mongoose like toast without butter?

[14:48:53] <NoOutlet> FiftyFivePlus, no, I don't think so.

[14:51:16] <NoOutlet> I find it preferable to not use mongoose.

[14:51:29] <NoOutlet> Though maybe some people prefer plain toast.

[15:07:30] <pgora2013> How do I get the workingSet in mongodb 3.0 ? I did set the workingSet : 1 using serverStatus() but, I don't see it being displayed in the output of serverStatus()

[15:16:57] <ihaveaquestion> hello

[15:21:11] <ihaveaquestion> ng

[15:21:13] <ihaveaquestion> ing

[15:31:50] <boolman> how can i create a instance with multiple replica sets?

[15:32:15] <boolman> if I don't set a --replSet I cant initate, but if I do, I cant create multiple

[15:34:30] <webdevsHub> hi guys. I try to restart mongod because that node shows "startup2" status for a couple of days. When I try to start the mongo-shell I get "Error: couldn't connect to server 127.0.0.1:27017 at ... src/mongo/shell/mongo.js:145". When I try to run --shutdown I get "There doesn't seem to be a server running with dbpath: /data/db". Wenn I try to kill it with "kill PID" or "kill -2 PID" nothing happens. I do not want to try "kill -9 PID" because there is a

[15:34:30] <webdevsHub> big warning about that in mongodb doc. Any suggestions how to stop that?

[16:01:05] <mdb-hater2> showtime again, hello inbred MongoDB scum, everyone still licking the balls of Eliot Horowitz? Or jerking off while moaning "3.0 is fucking crazy"?

[16:03:04] <mdb-hater2> where is my asshole friend Derick? drunk again? or wanking off?

[16:04:44] <mdb-hater2> mongodb: the database created by programmer scum for programmer scum

[16:10:46] <colock> hello

[16:15:40] <kakashiAL> hey guys, I am using mongodb in one of my projects

[16:15:42] <kakashiAL> if I do a GET request to http://localhost:3000/users/ I get the user with the name Peter and the ID 54974c4ed74851620bbf7498

[16:15:44] <kakashiAL> if I do a GET request to http://localhost:3000/users/54974c4ed74851620bbf7498 I get the user with the name PeterAAA, the same way how I changed it

[16:16:23] <mdb-hater2> mongodb: the database created by programmer scum for programmer scum

[16:16:25] <mdb-hater2> where is my asshole friend Derick? drunk again? or wanking off?

[16:19:23] <mdb-hater2> kakashiAL, hello idiot

[16:26:34] <mdb-hater2> where is my asshole friend Derick? drunk again? or wanking off?

[16:26:38] <mdb-hater2> showtime again, hello inbred MongoDB scum, everyone still licking the balls of Eliot Horowitz? Or jerking off while moaning "3.0 is fucking crazy"?

[16:36:11] <mdb-hater2> showtime again, hello inbred MongoDB scum, everyone still licking the balls of Eliot Horowitz? Or jerking off while moaning "3.0 is fucking crazy"?

[16:36:13] <mdb-hater2> where is my asshole friend Derick? drunk again? or wanking off?

[16:36:17] <mdb-hater2> mongodb: the database created by programmer scum for programmer scum

[16:36:46] <quattr8> :v

[16:41:16] <steblar> Hi all

[16:41:29] <steblar> i have a problem with the new mongodb 3.0

[16:41:34] <steblar> log present this error

[16:41:45] <steblar> Old 2.4 style user index identified. The authentication schema needs to be updated by running authSchemaUpgrade on a 2.6 server.

[16:42:06] <steblar> after migrating from standard storage to wiredTiger

[16:44:34] <mdb-hater2> and?

[16:45:39] <steblar> And mongod can't start-up

[16:45:43] <steblar> what can i do ?

[16:47:09] <mdb-hater2> what you can do?

[16:47:21] <mdb-hater2> not being an idiot

[16:48:32] <steblar> sorry, if i stole you time, but i'm not so skilled about this and i'm only ask support without pretend nothing

[16:48:59] <mdb-hater2> idiot

[16:49:06] <mdb-hater2> no support for idiot scum like you here

[16:49:09] <mdb-hater2> move on

[16:52:02] <steblar> I do not understand what I have done to get these answers

[16:54:05] <mdb-hater2> because you are an idiot

[16:54:08] <mdb-hater2> wrong place

[16:54:15] <mdb-hater2> we don't need idiots here

[17:02:25] <mdb-hater2> steblar: you're still there? Idiot!

[17:11:40] <mdb-hater2> showtime again, hello inbred MongoDB scum, everyone still licking the balls of Eliot Horowitz? Or jerking off while moaning "3.0 is fucking crazy"?

[17:13:27] <mdb-hater2> useless database

[17:13:30] <mdb-hater2> useless idiots here

[17:13:37] <mdb-hater2> what can be more horrible?

[17:13:51] <steblar> maybe you ?

[17:14:04] <mdb-hater2> you are hard to beat

[17:14:36] <steblar> keep dreaming

[17:32:07] <daidoji> man who is that guy(gal)???

[17:32:46] <daidoji> anyways, is there a way I can set a hard limit on a database size through some configuration option?

[17:35:13] <daidoji> or is the best practice just to run mongod --repair every once in a while?

[17:38:31] <cheeser> oh, to reclaim space? you might consider wiredtiger/compression

[17:38:45] <cheeser> or sharding which can constrain space use, iirc

[18:22:11] <smartattack> Does anyone know offhand if Mongo C# driver can be made to use a hash other than MD5, which is not FIPS compliant and breaks with win2012 where we have FIPS enabled?

[18:24:09] <girb> please help .. I'm in process of adding a shard

[18:24:11] <girb> http://pastebin.com/WL6L8d28

[18:24:28] <girb> ^^ getting error even though I removed test

[18:25:45] <girb> done .. please ignore ^^

[18:45:39] <kesroesweyth> Is there a good way in a PHP app to have a query for a document which contains references to other documents by ObjectID be automatically resolved, without making additional queries for the referenced documents?

[18:45:39] <kesroesweyth> I'm reading through the documentation but not seeing anything other than that some drivers may support this.

[19:06:14] <girb> how much time a 600GB data of a DB indexing takes ?

[19:06:25] <girb> new to mongo please help

[19:06:42] <Number6> girb: Depends on a number of factors - the amount of indexes, index type, speed of disk, amount of RAM

[19:07:27] <girb> Number6: ok .. any rough estimation about 2 , 3 hours ?

[19:07:57] <Number6> girb: Not really, no. The logs should give you a rough indication as to the progress thus far, and you could guess based on that

[19:08:07] <girb> ok

[19:18:22] <girb> Number6: I have another collection which is of 200GB .. so is it safe to start that also ?

[19:32:10] <girb> I have an existing index on a collection { "v" : 1, "key" : { "_id" : 1 }, "name" : "_id_", "ns" : "analytics.Page_URLs" }

[19:32:27] <girb> can I use that for sharding

[19:33:12] <girb> sh.shardCollection("db.analytics.Page_URLs ", { "_id": 1 } )

[19:54:06] <xjrn> is there a mongo client for couchdb replication?

[20:22:14] <fxmulder> I have 3 config servers running on 3 machines and I plan on flattening one and resetting it up, do I want to preserve the config data or can it pull from the others once its back up?

[20:24:16] <w96> Hi everyone. After following the tutorials to setup auth on a clean install of MongoDB 3.0, I get this error whenever I try to authenticate from an external program (RoboMongo, C# MongoDB driver): credentials missing in the user document

[20:24:37] <w96> Does anyone have any ideas why it would be doing this?

[20:25:59] <fabiobat_> The indexes created on a PRIMARY Node are not replicated automatically to the SECONDARY nodes?

[20:26:24] <fabiobat_> I must ensure any index in any secondary node?

[20:26:42] <fabiobat_> I must ensure each index in any secondary node?

[20:27:16] <fabiobat_> I must ensure each index in each secondary node? "now is better"

[20:36:54] <fewknow> fxmulder: you can just dump from another config server

[20:37:08] <fewknow> but are you using CNAMES for the config servers?

[20:37:28] <fewknow> you can't switch out config servers without bringing down the entire cluster...unless you are using CNAMES

[20:37:35] <fewknow> fabiobat_: indexes are replicated

[20:37:59] <fabiobat_> there are any configuration for that?

[20:38:15] <fabiobat_> because I have 1 primary and 2 secondary nodes.

[20:38:29] <fabiobat_> i did a copydatabase in the primary.

[20:38:49] <fabiobat_> the database was copied and the indexes also.

[20:38:57] <fxmulder> fewknow: I plan to recreate the machine using the same IP

[20:39:04] <fabiobat_> but the replicas received just the data not the indexes.

[20:39:29] <fewknow> fxmulder: did you use ip of dns when setting up cluster?

[20:39:34] <fewknow> or*

[20:39:59] <fabiobat_> I have just checked the currentOp on the PRIMARY node and all the indexes was already produced. { "inprog" : [ ] }

[20:40:04] <fxmulder> I plan on using the same IP and hostname, it will be the same machine we just have some filesystem corruption I want to get rid of

[20:40:13] <invapid> a = ["a", "b", "c"] # how do you find all items in which "a" has all those items (can also have more)

[20:40:47] <invapid> "$in" will match if any of the array items are true (but I need all to match)

[20:41:37] <invapid> any easier way to do that other than nesting "$in" statements in an "$and" statement for each item of that array?

[20:46:06] <fewknow> fxmulder: then it will be fine...you can dump and restore config from another config server

[20:46:14] <fewknow> takes seconds

[20:53:20] <fxmulder> fewknow: I am in the middle of a shard migration, we have a couple weeks before this completes, but from the sound if it I can't have any of there config servers down while that is happening correct?

[21:00:14] <fewknow> fxmulder: you can have 1 down...if 2 go down you are in a READ ONLY mode

[21:00:23] <fewknow> GothAlice: that is right, right? ^^

[21:00:40] <fewknow> fxmulder: what is a shard migration?

[21:15:09] <greyTEO> I am working with Hadoop(Spark) and mongo

[21:15:25] <greyTEO> how can I get spark to avoid null documetns

[21:16:02] <greyTEO> I am not sure how to override this methods https://github.com/mongodb/mongo-hadoop/blob/master/core/src/main/java/com/mongodb/hadoop/output/MongoRecordWriter.java#L100

[21:16:15] <greyTEO> it's instantiated here https://github.com/interllective/MongoReduce/blob/master/src/org/apache/hadoop/contrib/mongoreduce/MongoOutputFormat.java#L55

[21:17:29] <cheeser> avoid them?

[21:17:53] <cheeser> you shouldn't be getting null documents at all from mongo...

[21:18:00] <cheeser> or back out your RDD...

[21:18:06] <cheeser> out *of*...

[21:18:37] <greyTEO> I am using Spark as ETL

[21:18:49] <greyTEO> so when something doesnt fit my model, it returns a null

[21:19:18] <cheeser> so the doc comes out of mongo fine but doesn't match your java/scala model class?

[21:19:34] <greyTEO> I am going from XML -> mongo

[21:20:08] <cheeser> oh. read some xml, twiddle the doc, write to mongo.

[21:20:27] <greyTEO> I parse it into my classes with JABX and if it doesnt fit my model, it is a null

[21:20:33] <greyTEO> cheeser, correct

[21:21:08] <greyTEO> I have to return this: return new Tuple2<>(null, null);

[21:21:36] <greyTEO> it's required my my function as a return value. return null throws an exceptio

[21:22:06] <cheeser> you'd need to subclass MongoRecordWriter and override write() to check for null before calling the super class's method.

[21:22:12] <greyTEO> and the null tuple gets inserted into Mongo because of the function I cannot override

[21:22:18] <cheeser> then just configure your spark job to use your writer.

[21:22:33] <greyTEO> That is what I am trying to do but can't get it

[21:22:40] <cheeser> why not?

[21:23:27] <greyTEO> it is throwing errors as some methods are private in the write class

[21:23:34] <greyTEO> so I think I have to override the entire class?

[21:24:01] <cheeser> you'd subclass and just override write().

[21:24:07] <cheeser> your Writer would have one method.

[21:24:34] <greyTEO> hmm let me try again

[21:24:58] <greyTEO> Im sstill learning the in's and out's of java

[21:27:43] <greyTEO> cheeser, https://gist.github.com/dmregister/f3335490e658154e5cd1#file-gistfile1-txt-L27

[21:27:45] <cheeser> i'm about to head to bed because I have an early flight to catch. if you get stuck, you can try asking here and hopefully i'll notice (though probably not until monday...) or you can post the mongodb-user list and either myself or luke will try to answer: https://groups.google.com/forum/#!forum/mongodb-user

[21:27:58] <greyTEO> is a private method

[21:28:09] <greyTEO> cheeser, thanks again for your help

[21:28:11] <greyTEO> have a safe flight

[21:28:53] <cheeser> commented.

[21:29:08] <cheeser> that should get you unstuck. if not, see above. good luck.

[21:29:50] <greyTEO> cheeser, that is what I needed. Thanks!

[21:30:19] <cheeser> awesome

[21:46:34] <bramgg> Hi all

[21:47:51] <bramgg> I'd like to find all documents who's array "history" contains values in a specific order in a specific time-span. I've tried to make my question very comprehensible here: http://pastie.org/10006013

[21:48:04] <bramgg> If anyone can help me out it would be hugely appreciated, thanks :)

[21:55:07] <bramgg> Realized my question might be better suited for SO, so if anyone wants to answer there: https://stackoverflow.com/questions/28908321/find-all-documents-by-array-values-with-a-specific-order-and-time-span

[22:19:22] <daidoji> cheeser: what is wiredtiger/compression?

[22:20:30] <daidoji> cheeser: like is that something I can enable? and I see its available for 3.0 but I'm running 2.6.5 here.

[23:58:10] <meisth0th> hello

Log file Viewer

Help | Karma | Search:

#mongodb logs for Friday the 6th of March, 2015