PMXBOT Log file Viewer

Help | Karma | Search:

#mongodb logs for Saturday the 25th of July, 2015

(Back to #mongodb overview) (Back to channel listing) (Animate logs)
[00:59:43] <Doyle> Hey, will a mongo instance of 2.6.7 be able to join an RS with 2.6.8 members?
[00:59:50] <Doyle> or vice versa
[01:01:04] <Boomtime> Doyle: yes
[01:01:46] <Doyle> Boomtime, To do an upgrade you just install 3.x.x an join to an RS with existing 2.6 hosts, then stepdown the old ones when the initsync is done?
[01:02:31] <Boomtime> http://docs.mongodb.org/manual/release-notes/3.0-upgrade/
[01:02:53] <Boomtime> please follow the tutorial, depending on what you are running there may be extra things to check
[01:02:55] <Doyle> Cool
[01:03:03] <Doyle> Thanks Boomtime
[01:42:32] <Doyle> Boomtime, smallfiles, what if you have a lot of DBs that hold a lot fo small files?
[01:42:44] <Doyle> lots of big DBs I guess holding lots of small files?
[01:45:47] <Boomtime> then you have more files than you would otherwise.. i guess?
[01:45:56] <Boomtime> like, 4 times more
[01:46:56] <Boomtime> do you expect a problem with that? there is nothing wrong with running smallfiles, you just get lots of files which burns through file handles faster too
[01:47:34] <cheeser> document moves might suffer some performance issues.
[01:50:28] <Boomtime> why? the list of extents remains the same doesn't it?
[01:59:07] <cheeser> i'm not 100% but i'm wondering about moving bits between two files rather than within just the one.
[01:59:15] <cheeser> but i might be over worrying about it.
[01:59:28] <cheeser> i don't think smallfiles is recommended in production, though.
[02:00:03] <cheeser> hrm. maybe it's ok: http://docs.mongodb.org/manual/reference/configuration-options/#storage.mmapv1.smallFiles
[02:00:07] <Boomtime> no, it isn't, but i thought in large part that's because it eats into ulimits faster, which on it's own also has some heap overhead
[02:00:16] <cheeser> indeed
[02:08:40] <Doyle> Thanks Boomtime that makes sense.
[02:08:43] <Doyle> io
[02:24:31] <Doyle> On centos, would you want to set fork: true? Why wouldn't you want daemon behavior by default?
[02:55:17] <Doyle> Boomtime, is fork=true recommended for centos setups?
[02:55:46] <Doyle> Not 100%, but it seems to be there only for RHEL based os's
[03:15:05] <Doyle> Yep, service gave me hassle without fork
[03:31:40] <jigax> hi, i was wondering if someone could give me a hand with the following question? http://stackoverflow.com/questions/31622597/please-help-get-grand-total-of-count-field
[03:32:06] <Boomtime> Doyle: i imagine fork is always required unless you want to run the server as a test in screen session or something
[03:33:20] <Boomtime> jigax: you appear to want two seperate outputs
[03:33:52] <Boomtime> the aggregation pipeline provides a single stream of output documents that have the same form - your 'example' clearly shows two different formats
[03:34:24] <jigax> Boomtime, no the first output is my current. the one below is my desired result
[03:34:46] <Boomtime> the key added at the bottom : "total": 7
[03:34:52] <jigax> yes
[03:35:03] <Boomtime> oh, that's all one document?
[03:35:09] <jigax> yes
[03:35:27] <jigax> "count": 1 + "count": 1 + "count": 5 = "total": 7
[03:35:44] <jigax> its pretty much the total for all counts on looking for
[03:35:49] <Boomtime> the result i meant, it's all contained in a single document output?
[03:36:07] <jigax> yes i would like all in one document
[03:36:27] <Boomtime> ok.. you can do it but i don't have the time to look more closely for your case
[03:36:35] <Boomtime> i can say the last stage should be a group
[03:36:38] <jigax> lol ok
[03:36:52] <Boomtime> that group should create both the values array and the total at the same time
[03:37:12] <Boomtime> i.e a single $group must perform both actions at the same time
[03:37:29] <jigax> let me give that a try
[03:37:43] <Boomtime> also, you have two $match in a row, any reason those aren't merged?
[03:38:19] <Boomtime> the $project can't be last, whatever it is doing, the $group that creates the values array and the total count must be last
[03:38:49] <Boomtime> perhaps you need to project earlier to get those items in the right form
[03:38:54] <Boomtime> then collate
[03:39:13] <Doyle> Thanks again Boomtime. Just wrapping up the limits and logrotate and I'll be done. Do you know offhand if centos has a virtual memory limit, or memory size that can be set? I'm not seeing it in limits.conf
[03:39:17] <jigax> Boomtime, figured it out. had a brain fart. thanks for your suggestion
[03:39:47] <jigax> boomtime, added this to the group total:{$sum:"$count"}
[03:52:49] <Doyle> got it, old stuff.
[04:08:58] <jigax> is there a better way than having a bunch of nested if statements handling if the user selected "All" or a specific user from a dropdown in the front end?
[05:07:42] <acidjazz> hey all
[05:07:48] <acidjazz> man mongochef is pretty sweet
[05:07:57] <acidjazz> whats everyones favorite mongodb admin tool?
[05:51:37] <acidjazz> one at a time people please
[05:57:12] <Boomtime> heh
[06:00:57] <Doyle> What disk setup has the best performacne in AWS? LVM 4 stripes on 4 disks x2 segments? (Raid 11?)
[08:15:35] <hypermist> my mongodb fails to start
[08:15:44] <hypermist> [FAIL] Starting database: mongod failed!
[08:15:44] <hypermist> invoke-rc.d: initscript mongod, action "start" failed.
[08:15:44] <hypermist> dpkg: error processing mongodb-org-server (--configure):
[08:15:44] <hypermist> subprocess installed post-installation script returned error exit status 1
[08:17:07] <hypermist> need help urgently as possible this is for something importantn haha
[08:38:07] <hypermist> Still nothing im trying is working
[08:38:09] <hypermist> ._.
[09:17:57] <hypermist> fixecd
[09:17:59] <hypermist> fianlly
[10:08:01] <Doyle> how does mongoperf know which drive to test ? I'm running it, but it's only hitting one device, xvda
[10:08:21] <Doyle> There data dir is on a striped lvm
[10:51:24] <vramana> Hi, This is my first time using mongodb. I am working on this project https://github.com/yasp-dota/yasp. I have downloaded a mongodb dump. I want to serve it locally. I unerstood that I need to use mongorestore. I don't know what to do after that.
[10:52:04] <vramana> I have to multiples .bson files all of which have to served under a database named dota.
[10:52:26] <vramana> I have tried reading the official docs.
[10:54:06] <vramana> but I dont understand what should be the host and port in my case, how should I start mongod service Everytime I do service mongod start I get mongod: unrecognized service
[11:04:43] <Doyle> vramana, you root or using sudo? if so and you still get that message, it's time to revisit the install instructions. Something was missed.
[11:05:57] <vramana> Doyle: No. I didn't use sudo. I found some stack exchange answer specifying sudo. It worked out.
[11:06:47] <Doyle> cool
[11:11:24] <vramana> Doyle: I am using mongorestore --db dota . now. But I am getting root directory must be a dump of a single database when specifying a db name with --db what does this mean?
[11:46:57] <aps> A secondary member of my replica set is in RECOVERING mode. It seems it's unable to catch-up. What do I do now?
[16:09:24] <hypermist> Unable to connect to database: mongodb://coincoin:passwashere@localhost:27017/explorerdb
[16:09:28] <hypermist> i need halp
[16:13:50] <flok420> halp? do you mean http://childrensnational.org/departments/hyperactivity-attention-and-learning-problems-clinic-halp ?
[16:13:56] <hypermist> lol flok420
[16:14:05] <hypermist> sorry im in a rush. cause i have no idea why this isnt working
[16:14:16] <hypermist> cause user password and all is there
[16:14:22] <hypermist> mongod is started
[16:44:08] <hypermist> hur dur i solved it
[19:41:25] <blizzow> I have three shards and each member of the replica set has been allocated 48GB RAM. Each mongod instance has ~40GB of indexes. Top reports that only 7GB of RAM are being used. and 6GB of data in cache. free and htop report similar stats.
[19:41:59] <blizzow> mongotstat however reports mapped = ~600GB vsize=~1200GB and non-mapped=~600GB.
[19:42:57] <blizzow> This is using mongostat --discover -u myuser -p mypassword --all --authenticationDatabase admin
[19:43:20] <blizzow> I am seeing page faults too.
[19:44:12] <blizzow> I read up a little and the touch command is supposed to force a lot of data into memory. Is there a different/better way to get mongo to eat more of the RAM that's been allocated to it?
[19:57:23] <blizzow> Also, why the disparity between what the OS reports and what mongostat reports?
[22:48:57] <Doyle> Hi guys. When running mongoperf, What drive should it be hitting??? The dbpath?
[22:49:07] <Doyle> It only ever hits the root device.
[22:55:26] <Doyle> I can't believe this is the expected behavior.