Log file Viewer
#mongodb logs for Friday the 12th of February, 2016
[06:52:39] <sabrehagen> how do i restructure this logic using a query to reduce my number of database accesses? i have a query that returns documents in a certain time range. each document has a device id. for each of those documents i want to see if there is a document matching
[06:53:10] <sabrehagen> that device id in the 10 seconds prior. the initial number of documents can be 40,000+. my logic then sends 40,000 database queries to check the second piece of criteria.
[06:53:28] <sabrehagen> without the aggregation framework, how would i minimise the number of queries?
[06:59:36] <Waheedi> i have added a 4th mongodb node to a replicateset. I'm not sure why i see two primaries in the replicaset
[07:02:24] <Waheedi> joannac: the .nl.dakwak.com servers are located in the Netherlands and the other two servers are in the US
[07:18:35] <Waheedi> Its the most recent node and there is no communication issues between all nodes for sure 100%
[07:23:18] <Waheedi> joannac: I think its dakwak-mongo6 not being able to reach any of the .nl servers
[08:02:33] <Waheedi> the other thing was, Im not sure why nearest read preference on the query level does not apply the primary as an option to read from
[08:19:58] <Keksike> how can I figure out why this kind of query is taking such a long time https://gist.github.com/Keksike/517341c5cd1c861ed0bd
[08:20:10] <Keksike> that is output from db.system.profile.find() after setting a 100ms profiling time
[08:36:41] <Keksike> Ceunincksken: I tried running the same exact query with runCommand (you cant use explain with distinct) and it gave me https://gist.github.com/Keksike/517341c5cd1c861ed0bd the upper file
[08:39:45] <Ceunincksken> Keksike: But you're saying that on the database it runs fine but from within your application it's slow, is that correct?
[09:43:31] <pchoo> Morning all, I have a question about matching on an array of sub documents - if we take the example here: https://docs.mongodb.org/v3.0/tutorial/query-documents/#specify-multiple-criteria-for-array-elements - how can I find all documents which have a memo from shipping, but not from billing?
[09:47:13] <pchoo> This is for use in an aggregation pipeline, would I be better off unwinding the array of documents, then grouping the information I need, and using $match to find those where billing doesn't exist?
[10:11:20] <Zelest> https://www.reddit.com/r/jailbreak/comments/458ao3/discussion_changing_time_date_settings_to_jan_1/ :)
[10:18:21] <kurteknikk> Question: I made a stupid mistake of converting a 90GB collection to capped (30GB) in mongodb 2.4, and the query has been running for over an hour with the mongo completely blocked. Is it safe to kill this operation ?
[10:56:28] <alezz> Hi all. Is there a way to $project the _id hex string value in a new field? I need it because I need to $lookup the _id with a foreign field which contains the hex value.
[11:01:21] <pchoo> I'm struggling with obtaining the data I want right now :| I have a collection with data like this: {name: 'whatever', states: [{type: 'a'}, {type: 'b'}]} and I want to find all records which have type:a, but NOT type:b in their statues array
[11:03:18] <Derick> db.col.aggregate( [ { $match : { states.type : 'a' } }, { $match: { states.type: { $ne: 'b' } } } ] );
[11:21:25] <alezz> Yes Derick, it was something like "$project _id.str in my_id_str; $lookup on my_id_str = foreign_id", but I've already searched a lot and I felt the presentiment there's no operator that does that... Thanks for your reply anyway! :)
[11:29:51] <Ange7> Someone can explain me why when i make "show collections" in mongo shell i have my list of collection but when i try with PHP driver $db->getCollectionNames() i have a empty array ? :/
[11:30:18] <Derick> alezz: yeah, but then again, you can argue that your lookup table should just have used an objectid...
[11:30:27] <Ange7> (my connection work cause if i try in PHP $collection->findOne() i have one document from my collection
[12:07:44] <lipiec> Hi, I have multiple MongoDB standalone instances. I would like to run some mongodb command on each of it at the same time. What is the best tool to use?
[13:00:10] <Ange7> Someone can explain me why when i make "show collections" in mongo shell i have my list of collection but when i try with PHP driver $db->getCollectionNames() i have a empty array ? :/
[13:02:53] <Ange7> (my connection work cause if i try in PHP $collection->findOne() i have one document from my collection
[13:52:08] <alezz> Derick: today I'm very unlucked. I changed the model with a DBRef but... https://jira.mongodb.org/browse/SERVER-14466 shows that looking up through .$id is not currently supported... Yeah!
[14:27:32] <Ange7> How can i get the max value in collection ? i have 1000 documents with date column, i want the max date
[14:59:20] <Ceunincksken> You can do it with the aggregation framework aswell but that would be an overkill.
[15:53:14] <Ange7> is it possible to create an empty collection and define that future documents has index on column «x»
[16:00:53] <jami> Hi. I'm doing a stress test with ab against a simple node-mongoose-mongodb application. This application just make a single mongoose.connect with default options. After the stress test, all functionality with db logic inside hangs. After the test none of the model. ... .exec(func() { /* never reached */}) callbacks are reached. The application itself is running but mongoose does not work anymore
[16:11:09] <jami> StephenLynx: *hehe great answer no i meant if the load is too heavy and the connection pool is full
[16:12:24] <jami> StephenLynx: Would it block or does it gave a clearly error with 'Too many connections' or something
[16:13:08] <jami> because the mongoose behaviour is not acceptable. It just hang and didn't create another connection
[16:30:49] <Waheedi> So it seems the only way to get out of this, is to make my clients understand they have two primaries somehow :)
[16:37:42] <hugealt> Is it possible to have a new collection's documents split across shards while the balancer disabled?
[16:39:25] <hugealt> Is it possible to run the balancer on an 'insert' only mode? Where it only runs on inserts, not on document updates?
[16:43:19] <Waheedi> I must say my issue is a network related issue and has nothing to do with mongodb :)
[18:00:04] <Lachezar> Hey all. N008-ie here. If I have an Customer[name]->* Order [description] (*line) ->1 Product [description]. How do I find all orders that have description that contains some text or their customer's name contains the text, or the name of any of the products in the lines contain the text?
[18:04:56] <Lachezar> daidoji: Notation? None. Just made it up db.customer, db.order, db.product . Order has DBRef to customer, and lines that have DBRef to product.
[18:07:11] <daidoji> Lachezar: yeah, its a philosophy of Mongo to explicitly not do joins in the database
[18:07:37] <daidoji> so you'd have to run three queries with the filters you've run, and then do more queries to get the other data you need from there
[18:08:25] <daidoji> Lachezar: Mongo documentation typically suggests denormalizing your data to achieve best results
[18:08:36] <Lachezar> daidoji: Well… That seems to be where I went to, but I was wondering if there aren't any server-side functions to handle that.
[18:09:20] <Lachezar> daidoji: denormalizing 1-* relations is a horror-show, and keeping denormalized data in sync is a nightmare.
[18:11:16] <Lachezar> daidoji: I'm currently doing it with multiple queries, but it seems really counter-productive to move big arrays of data from the server to the client, just to send them back again :)
[18:12:09] <Lachezar> daidoji: I also find the { 'field.$id' : { $in : ['....', '....] } } does not work :(
[18:13:04] <daidoji> I mean if your data needs joins, I'd suggest moving to an RDBMS or Graph Database if you have a NoSQL application
[18:14:26] <Lachezar> daidoji: Well… I'm a Java+JPA stooge, so it's relatively easy to move to PostgreSQL (say). But the customer 'heard', that MongoDB scales and is fault tolerant and all that stuff, and said we're using MongoDB.
[18:16:04] <Lachezar> Anyway. It gives me a 'quantum of solstice' that I'm not missing big on 'The MongoDB Way' to do complex searches.
[18:17:49] <Lachezar> StephenLynx: there is no array of objects here. All 1-* relations go to specific collections.
[18:19:43] <Lachezar> StephenLynx: I have to find all (a page of) all orders that: 1. Have description matching my search, or 2. Have customer whose name matches the search or 3. Have any lines that have products with names matching the search.
[18:21:10] <Lachezar> If I understand correctly you suggest adding a 'search' field to the Order that will contain all the text that can bea searched?
[18:21:58] <StephenLynx> I thought you had a complex array and suggested creating a new collection, but since that is not the case, I'm asking for your model.
[18:27:51] <StephenLynx> you seem to be just throwing stuff into this huge bin with no rhyme or reason
[18:28:50] <StephenLynx> mongo doesn't enforce that and if I screw up, I can insert data outside of those rules
[18:29:00] <Lachezar> StephenLynx: OK. I understand. Yes, I saw the link. I've got nothing like that.
[19:06:47] <csepulvedab> i see always is 1000, and i hace some querys that need return more than 5000
[20:35:36] <starfly> kyro_: store a JSON document in a collection, structure can change later, but of course, it depends upon how you will use the data as to whether you will need to make all of the documents consistent later
[20:51:03] <orriols> Hi. I'm using MongoDB 2.6. I need, using the aggregation framework, to project a field whose value is an array expressions. Is that possible?
[20:51:49] <orriols> the straightforward approach gives the error " failed: exception: disallowed field type Array in object expression"
[20:56:42] <kryo_> ty starfly, seems like it's not as simple as you say since i'm using mongoose, so i've come up with a different solution instead