Log file Viewer

[00:48:10] <topwobble> Can anyone recommend software to mine & visualize data from mongo?

[01:26:38] <enjo528> In mongodb.conf what unit is the oplogsize in?

[01:26:41] <enjo528> bytes?

[01:28:41] <joannac> enjo528: http://docs.mongodb.org/manual/reference/configuration-options/#oplogSize

[01:29:09] <enjo528> ugh.. I managed to read right past the word "megabyte"

[01:29:12] <enjo528> thanks

[05:52:26] <dharmaturtle> I have a collection of names and a collection of text. I'm trying to count the occurances of the names in the text. What I have to do is run a script that prints the names to the console, copy that, and then literally paste it into the "map" function in my map reduce script. Is there a better way? http://pastie.org/private/9futpyyyfrom6733w6orhq#

[05:53:05] <dharmaturtle> I can't connect to another collection inside of map, and it doesn't recognize global variables. I don't know how else to send the Name array to the map function.

[06:17:51] <chovy> howdy

[06:18:34] <chovy> can someone tell me if its possible to search for proximity to a Gps coordinate using geoNear? Like if i have gps coordinates for a location, and I want to find all items that are within a 20 mile radius of it.

[06:20:32] <joannac> Um, yes.

[06:33:59] <chovy> joannac: i'm having trouble finding examples of how to do this

[06:43:30] <joannac> chovy: http://pastebin.com/x6wzzfgG

[06:45:10] <joannac> oops, wait.

[06:47:53] <joannac> you want maxDistance: 20, and potentially distanceMultiplier:X, and/or spherical:true

[06:48:01] <joannac> depending on how you have your coordinates

[07:11:05] <svm_invictvs> Is db.dropDatabase() a particulary time-consuming call?

[07:14:59] <dweeb> I just restored my server from a snapshot and now all my files in the dbpath is 4kb. Is all my data lost?

[07:18:36] <joannac> svm_invictvs: depends how big the db is

[07:19:09] <joannac> dweeb: weren't you here earlier today?

[07:19:19] <joannac> dweeb: step by step, what did you do?

[07:20:37] <dweeb> joannac: yeah but I waited for my server provider to restore my server from a snapshot and they just did that. And I check the dbpath folder and all the files are 4kb. So I donno what to do

[07:25:00] <chovy> joannac: is "loc" the gps coordinates? for the seed data in your example?

[07:25:10] <joannac> chovy: yes

[07:25:46] <joannac> dweeb: how was the snapshot taken?

[07:25:54] <chovy> what units db.runCommand( { geoNear : "chovy", near: [10,20], num: 3})

[07:26:08] <chovy> where is the distance?

[07:26:52] <dweeb> joannac: Im not sure, but it takes a copy of the filesystem

[07:28:17] <joannac> chovy: the distance is in the results. To specify a radius you want to add maxDistance:20 to the command

[07:28:29] <dweeb> joannac: My server has been running for 300 days. Now they restored it from a snapshot and all data is lost. Is that even possible? Mongodb must have saved data to the file system from time to time?

[07:29:32] <joannac> dweeb: when was the snapshot taken?

[07:29:43] <joannac> did you ahve journalling on?

[07:30:29] <dweeb> joannac: 1 day from now. I had nojournal=true

[07:31:05] <joannac> are there no mongodb files in the snapshot?

[07:31:47] <dweeb> joannac: all the db files in dbpath is still there but all files are 4kb.

[07:32:38] <joannac> that sounds wrong

[07:38:10] <dweeb> joannac: Can I ask my server provider anything to debug this? There must have been files stored in the filesystem during these 300 days that must have been copied by there automated snapshot?

[07:38:15] <joannac> In any case, yes, mongodb flushes to disk.

[07:39:01] <joannac> 4kb files seem wrong.

[07:39:22] <joannac> I'm not sure how I can help here; you need to talk to your service provider.

[07:40:13] <joannac> do you have your own backups, or were you relying on the server's snapshots

[07:44:24] <dweeb> joannac: Yeah it seems like I have a weekly backup of my own.

[07:44:34] <dweeb> joannac: How often do mongodb flush to disk?

[07:45:20] <joannac> 60seconds max

[07:45:29] <joannac> http://docs.mongodb.org/manual/faq/developers/#when-does-mongodb-write-updates-to-disk

[07:48:17] <chovy> joannac: the maxDistance, what units are those?

[07:48:56] <joannac> chovy: whatever units you're using.

[07:50:23] <joannac> chovy: "The optional $maxDistance operator limits a $nearSphere query to return only those documents that fall within a maximum distance of a point. If you use $maxDistance on GeoJSON points, the distance is measured in meters. If you use $maxDistance on legacy coordinate pairs, the distance is measured in radians."

[07:55:12] <chovy> thanks

[12:46:52] <yati> Hi. I am using mongoengine with Django. Is there anyway I can enable caching with redis/memcache and favourably, with johnny-cache?

[12:47:05] <yati> i.e., for my database reads

[12:53:49] <cheeser> 1

[13:43:39] <Guno> hey guys i installed mongodb and played around with it

[13:43:55] <Guno> then i turn off my coputer and i don't know how to open it up again

[13:45:56] <Guno> nvm got it :)

[13:47:35] <Guno> now it says /data/db does not exist

[13:47:38] <Guno> exiting

[13:50:27] <Guno> seriously is it just me or are all these people either unhelpful or bots

[15:10:44] <harenson> hehehe

[15:28:23] <Tinwor> I cannot download mongodb from mongodb.org why?

[15:29:49] <harenson> Tinwor: how are you doing it?

[15:34:52] <Tinwor> Nothing. I'm tryng to download the latest file but I must wait 1 hour or more and when it's 99% the download it s interrupt

[15:38:06] <harenson> Tinwor: maybe it is your connection

[15:38:36] <Tinwor> harenson: I try to download the source and then compile

[15:39:37] <harenson> Tinwor: which version are you trying to download?

[15:40:35] <Tinwor> harenson: 2.4.7 64bit for windows server 2008R2

[15:41:39] <tkeith> Is it safe to store an unvalidated JSON object in MongoDB?

[15:46:34] <harenson> Tinwor: it works for me

[15:47:29] <harenson> Tinwor: and it takes just ~ 2 minutes

[15:47:54] <Tinwor> harenson so probably it's my connection now I'm in Italy and the connection is too bad -.-

[15:48:43] <harenson> Tinwor: let try something

[15:48:55] <harenson> may I can share the file from my dropbox for you

[15:49:36] <Tinwor> harenson: if you can, thanks

[15:49:56] <harenson> Tinwor: of course, it is uploading xD

[15:50:16] <Tinwor> thank you again handerson

[17:29:23] <deepy> I have a list I'm iterating over, I want to insert these into mongodb, should I create a DBObject list and pass that to my DBCollection's .insert() or should I .insert() them immediately?

[17:48:02] <Pinkamena_D> does anyone know how to insert a date into pymongo from tuple format?

[17:53:32] <level09> using pymongo ?

[18:23:41] <synesp> hey

[18:24:03] <synesp> I'm noticing a lot of entries in mongodb log from update queries looking like this: ntoreturn:0 ntoskip:0 nscanned:42 keyUpdates:0 locks(micros) r:165 nreturned:1 reslen:85 121ms

[18:24:26] <synesp> maybe every 3,000 updates or so, ill get one of these

[18:51:13] <jyee> anyone know if there are issues with osx mavericks and the 2.4.7 build from mongodb.org/downloads?

[18:57:35] <_sri> jyee: use homebrew, they have workarounds

[19:34:47] <hno> Hi. Need tu run a sanity check on two collections with manual cross-references, to check if there is any dangling references etc. is there any tutorial somewhere that covers such operations?

[19:35:36] <hno> using the mongo shell.

[20:53:15] <hno> got the job done with some forEach()..

[21:17:59] <dharmaturtle> Hi all, when I try to .update() a subdocument, I overwrite instead of appending to it. How can I append to it? http://pastie.org/private/nybtthgj3cyp7qj7xkm4q

[22:22:41] <arch_> hey, i'm trying to learn mongodb and pymongo. I have a bunch of lists of dictionaries like this http://pastie.org/8433377 ... I want to be able to fetch the events according to the datetime, but I have no idea how I should save these to mongo.

[22:23:06] <arch_> can anyone point me to the right direction?

[22:27:47] <ginhinio> arch_: people here don't reply too much i think you should check the docs sadly i don't know python

[22:30:26] <arch_> alright, thanks.

[22:35:30] <tripflex> education.mongodb.com

[22:35:31] <tripflex> :P

[22:50:45] <flatr0ze> could please someone give me advices/links/other references on how to enable https with meteor? All I managed to find so far is this: "If you are talking about installing certificates for publicly facing applications it is probably best to use a reverse proxy server such as nginx and install the certificates for that server. http://wiki.nginx.org/HttpProxyModule"

[23:04:55] <hno> flatr0ze, that's pretty much a statement... don't enable https in meteor, instead wrap meteor in https by using a proxy.

[23:05:36] <flatr0ze> wouldn't it slow down the thing?

[23:09:15] <hno> flatr0ze, might even speed up the thing..

[23:12:47] <flatr0ze> thanks, hno, I'll try Ü

[23:31:30] <ginhinio> do you guys know how i can connect mongo.exe to my database instead of test

[23:32:27] <tripflex> not on windows :P

[23:32:56] <ginhinio> how do you do it on mac?

[23:33:16] <ginhinio> tripflex:

[23:36:15] <tripflex> what are you trying to do?

[23:36:36] <ginhinio> i am trying to connect the mongo.exe to my database

[23:36:55] <ginhinio> so i can see what is in it with a few lines

[23:38:32] <tripflex> yeah that makes no sense

[23:38:54] <tripflex> http://docs.mongodb.org/ecosystem/tools/administration-interfaces/

[23:38:57] <ginhinio> what about it doesnt make sense

[23:39:02] <tripflex> i'm assuming you want to visually see what's in your db

[23:39:16] <ginhinio> mongo has that?

[23:39:21] <tripflex> your saying your trying to connect mongo.exe to your db

[23:39:26] <tripflex> but... mongo is the db

[23:39:37] <ginhinio> mongod.exe is the db

[23:39:47] <ginhinio> mongo.exe is the client

[23:39:56] <tripflex> yeah don't use windows

[23:39:59] <tripflex> but i assume it's the same

[23:40:04] <tripflex> and if that's what you're asking

[23:40:10] <tripflex> yo uneed to read a getting started guide

[23:40:47] <tripflex> http://docs.mongodb.org/manual/tutorial/install-mongodb-on-windows/

[23:41:11] <tripflex> http://docs.mongodb.org/manual/tutorial/getting-started/

[23:41:18] <tripflex> simple as using google to find the answer

[23:47:06] <ginhinio> okay thanks

[23:47:10] <ginhinio> ill check the links