[02:02:09] <aaxxo> Can I request some help please? I have a query and want to pass output as json using express, but I am stuck with the correct syntax http://pastebin.com/fLBcpgsQ
[06:27:35] <synthetec> can you do mongodump to remote server
[06:30:12] <joannac> sure. install mongodump on the remote server and run it there
[08:04:55] <synthetec> is it possible to dump every database
[08:04:59] <synthetec> will just mongodump do that
[08:05:03] <synthetec> without specifying a collection
[10:32:35] <student3102> I am trying to use distinct command on 3.0 driver but no luck, can someone give me example how to get results of a single column to array
[10:41:41] <student3102> can someone please give me example of distinct command on 3.0 driver in java, I am having troubles with Tresult(got no idea what it stands for)
[10:49:46] <student3102> can I use both old and new 3.0 driver?
[10:51:13] <darius93> student3102, you could provide some code that you currently have and we could help you base on that
[10:52:25] <student3102> List states = database.getCollection("CC").distinct("State", );
[10:52:40] <student3102> I dont know what to put as second argument in distinct method
[11:15:03] <cheeser> why put anyting, student3102 ?
[11:23:17] <student3102> let me take another look, brb
[11:23:27] <cheeser> sounds lieke maybe you have null in the State field
[11:23:55] <cheeser> if you makes states a DistinctIterable instead, you can call filter() to remove those from the results
[11:25:14] <student3102> yeah, probably, tried with another field that has no null in it, and it worked, I will try now with distnct
[11:25:53] <charnel> Hi I want to get all the records in a collection and update to 2d box . Like getting lat and long and create a [lat, lng] what is the best way ?
[11:27:05] <student3102> same thing even after using filter
[11:27:18] <cheeser> you want to add that array to the documents based on other fields in the docs, charnel?
[11:27:56] <cheeser> student3102: run a distinct query in the shell and see what you get back
[12:16:34] <student3102> how do I implement it in my code?
[12:17:08] <cheeser> there's a filter() on DistinctIterable. you'd pass in the Document form of that.
[12:22:13] <student3102> @cheeser: it works, thanks a lot, you probably saved me hours!
[12:57:43] <no-thing_> hello, is it possible to see the progress of syncing from primary to secondary ?
[12:58:26] <kali> no-thing_: the secondary logs will give you a hint. nothing close to a progress bar or an ETA, but at least you can see stuff moving around
[14:23:24] <sandstrom> When using mongoid, is it possible to use a criteria (selecting on properties) before the objects are saved? That would make the code easier to use across both tests and real code (where documents will be persisted)
[14:24:50] <revoohc> Does anyone know if the mongodump output is version safe? In other words, could I mongodump a database today, archive the results, and expect to be able to restore them 2, 5, 10 years in the future?
[14:26:47] <kali> revoohc: well, mongodump is just a bson dump. and so far bson, has being remarquably stable.
[14:27:24] <kali> revoohc: i can not test it, because i have no file from that time around, but i'm pretty sure a dump from 2009 would still load
[14:27:38] <kali> revoohc: as for the future... who knows ? :)
[15:10:24] <jordonbiondo> Hello, I'm having a strange issue with performance problems across mongoose / mongo. In my code, my query takes about 13 seconds, however, when I log the query mongoose is doing, and run it directly, the same query takes about .3 seconds. Has anyone had a problem like this?
[15:11:21] <StephenLynx> yeah, mongoose is slow as hell.
[15:11:28] <StephenLynx> it is expected to behave like that.
[15:11:44] <jordonbiondo> so: Something.find({simple: 'criteria'}).then(function() {... }) takes 13 seconds. But db.getCollection('Something').find({simple: 'criteria'}) takes .3 seconds
[16:17:44] <Doyle> The query is operating with database specific read lock, and the DB thundercats is globally locked?
[16:24:21] <jpfarias> anyone knows why mongo config server would go out of sync?
[16:24:51] <jpfarias> I am having to re sync one of my config servers once a day after I added a couple shard servers
[16:25:21] <jpfarias> it is pretty annoying and I dont know if I am losing consistency with this
[17:05:52] <aricg> Hi, the docs say that for remote auth I need to append the public ip to the confs bind_ip = however the public ip is not avaliable on the machine with ipr its all done with magic
[17:06:42] <aricg> how can I let developers in remotly? this is just for testing right now, only username password auth is required at this time.
[17:28:42] <StephenLynx> I don't remember mongo causing a fuss about authentication based on ip, but again, I have never messed too much with authentication
[17:30:41] <cheeser> i don't think mongo cares about the IP for auth at all.
[18:54:34] <doc_tuna> and can you do deferred writing to mysql, i.e. send a query and proceed to reading your next mongo document without waiting for the callback from sql?
[18:55:42] <terminal_echo> are you saying translate the sql query into a mongo query?
[18:55:42] <doc_tuna> you may not want to let more than x number of callbacks piled up, if things go into sql slower than they come out of mongo
[18:56:22] <doc_tuna> i'm just saying you can skip the mongo->file, file->sql by writing a scrip that reads from mongo and writes to your sql table
[18:58:50] <doc_tuna> yeah you have to map somehow and keep the map consistent
[19:00:57] <terminal_echo> i think we are going to use sqlalchemy to create exact model and then write to sql through it
[19:01:32] <StephenLynx> you could just have the _id be ignored an use the sql's auto increment.
[19:02:37] <geneous> gents, having mucho trouble with connection growth: http://stackoverflow.com/questions/32212027/mongodb-connections-number-growth-over-pools-limit-in-grails-app ... all wise counsel is mucho appreciated
[19:03:34] <terminal_echo> StephenLynx: yeah, what i mean is not maintaining the same id's but the foreign-key relationships that make SQL table reltionships faster
[19:50:32] <sewardrobert> We are using mongodb with wiredTiger, however mongo will not restart after a server reboot and software upgrade. The boot fails with a backtrace. Any advice?
[21:05:36] <sewardrobert> We are using mongodb with wiredTiger, however mongo will not restart after a server reboot and software upgrade. The boot fails with a backtrace. Any advice?
[21:08:17] <sewardrobert> Starting mongod with the following command, does not produce any standard out.
[21:08:37] <sewardrobert> I am at a loss of what to try next.
[21:30:47] <sewardrobert> We are using mongodb with wiredTiger, however mongo will not restart after a server reboot and software upgrade. The boot fails with a backtrace. Any advice?
[22:01:05] <INIT_6_> If I was to move the nmap files off the server as is. Is there a way to come back later and export the information to .json or other format?
[22:28:29] <joannac> sewardrobert: well, the exact error and backtrace would be useful
[22:30:02] <INIT_6_> mongodump docs say it can't read them anymore. Changed in version 3.0.0: mongodump removed the --dbpath as well as related --directoryperdb and --journal options. You must use mongodump while connected to a mongod instance.
[22:36:47] <sewardrobert> backtrace is not terribly informative to me.
[22:37:52] <joannac> sewardrobert: did you shut it down cleanly?
[22:38:05] <joannac> Line 3 indicates corruption of some kind
[22:38:29] <sewardrobert> The server is on a virtual machine. I believe the hosting provider bounced or migrated the VM.
[22:38:43] <sewardrobert> So the bounce or migration may have caused corruption.
[22:39:34] <sewardrobert> Before I noticed that Mongo was down, I also upgraded packages on the server including mongo. Combination of events may have caused the failure?
[22:55:39] <sewardrobert> It would appear that mongo was up for a long time. 7 months. The VM migration / restart made mongo shutdown (perhaps uncleanly?). Mongo has never successfully restarted as 3.0.4 or 3.0.6 (it's current version).
[22:55:55] <sewardrobert> joannac, It would appear that mongo was up for a long time. 7 months. The VM migration / restart made mongo shutdown (perhaps uncleanly?). Mongo has never successfully restarted as 3.0.4 or 3.0.6 (it's current version).
[23:05:39] <joannac> just an unclean shutdown would not corrupt files afaik
[23:06:51] <sewardrobert> And yet that backtrace is all I have to go one.
[23:07:08] <sewardrobert> joannac, And yet that backtrace is all I have to go one.
[23:09:04] <joannac> sewardrobert: so when you upgraded to 3.0.4, you cleanly shut down, and then when you started again with 3.0.4 you got that error?
[23:09:04] <sewardrobert> joannac, This sequence of events is likely. VM was shutdown by hosting provider. Mongo stayed down. We are starting it manually. Mongo was upgraded from 3.0.3 originally to 3.0.5 and then again 3.0.6. 3.0.5 and 3.0.6 versions were unable to reload the "corrupted" wiredTiger database.
[23:09:47] <sewardrobert> joannac, we skipped version 3.0.4.
[23:09:54] <joannac> oh, if the corruption started after the vm shutdown, then i got nothing
[23:10:06] <joannac> probably corruption moving data across