Databases
StackOverflow2013
Postsdbo
PONetty HTTP + MongoDB: Unlimited Increment in connections
 

Note that there are some explanatory texts on larger screens.

plurals
  1. PONetty HTTP + MongoDB: Unlimited Increment in connections
    primarykey
    data
    text
    <p><br /> I'm now using Netty as my backend webservice and MongoDB as my database.<br /> At first, I'm very glad with the high performance of the combination of MongoDB and Netty.<br /> But recently I checked the MongoDB logs(and db.serverStatus() command) and found a very very serious issue: Every time Netty handles a RESTful HttpRequest with messageReceived, one available connection of MongoDB is taken and never release even if I close the Netty Channel.<br /> And since there're only 20,000 concurrent connections that MongoDB provide, every connection is very precious. If I can't solve this problem, my service will crash after receiving more than 20000 requests.<br /> I also did an test case on singleton MongoDB, I found that under the situation without Netty, everything works fine (A Timer program keeping to query MongoDB). There's only one connection taken even if I execute more than 5 queries at a time.<br /> <strong>How can I release the connection in MongoDB under Netty Framework? Seem like the problem come from Netty Framework. I've been seeking the solution to this issue for a long time.</strong><br /> <br /> I also added "connectTimeoutMS=10000&amp;socketTimeoutMS=10000" to the MongoDB connection string, but seem useless. The connection will never end until I close the whole program.</p> <p>Netty impl:<br /></p> <pre><code>public void messageReceived(ChannelHandlerContext ctx, MessageEvent e) throws Exception { HttpResponse httpResponse = null; HttpRequest request = (HttpRequest) e.getMessage(); (... Query "Singleton([the way I implement][1])" MongoDB ...) httpResponse.setContent(responseBuffer); httpResponse.addHeader(HttpHeaders.Names.CONTENT_LENGTH, responseBuffer.readableBytes()); ChannelFuture future = ctx.getChannel().write(httpResponse); future.addListener(ChannelFutureListener.CLOSE); } </code></pre> <p>Singleton MongoDB impl:<br /></p> <pre><code>public class MongoDbCore { private static MongoDbCore mINSTANCE = null; private static Logger logger = Logger .getLogger(MongoDbCore.class.getName()); private static DB db; private static MongoClient mongoClient; private MongoDbCore() { } public static MongoDbCore getInstance() { if (mINSTANCE == null) { mINSTANCE = new MongoDbCore(); try { String connString = "mongodb://" + Configs.MongoDB.DB_HOST + ":" + Configs.MongoDB.DB_PORT + "/?connectTimeoutMS=10000&amp;socketTimeoutMS=10000"; mongoClient = new MongoClient(new MongoClientURI(connString)); logger.info("ConnectionString=" + connString); db = mongoClient.getDB(Configs.MongoDB.MY_DB); } catch (UnknownHostException ex) { logger.info("Error while initialing the MongoDB."); } } return mINSTANCE; } public static DB getDb() { return db; } public boolean updateChannelStatusByChannelId(Integer tid, String status) { try { DBCollection coll = db.getCollection(Configs.MongoDB.DB.TABLE_REGS); BasicDBObject newDocument = new BasicDBObject(); newDocument.append("$set", new BasicDBObject().append("status", status)); BasicDBObject searchQuery = new BasicDBObject().append("tid", tid); coll.update(searchQuery, newDocument, false, false, WriteConcern.SAFE); return true; } catch (Exception ex) { return false; } } .... </code></pre> <p>}</p> <p><br /> The way I query/update MongoDB:<br /></p> <pre><code>MongoDbCore.getInstance().updateChannelStatusByChannelId(123, "abc"); </code></pre> <p>Thanks!!</p>
    singulars
    1. This table or related slice is empty.
    1. This table or related slice is empty.
    1. PTQuestion
    1. USCheng
    1. USCheng
    plurals
    1. This table or related slice is empty.
    1. This table or related slice is empty.
    1. This table or related slice is empty.
    1. PO
      singulars
      1. PTAnswer
    1. This table or related slice is empty.
    1. COIs the Mongo(Client) object within your Netty application actually treated as a singleton? You should not create more than one of those. Also note that the Java driver will actually consume all connections it is allowed to. If your max connections setting in MongoOptions is set to something relatively low (10-100) you should be able to see if the amount of connections is capped to that number (and therefore you indeed only use one MongoClient instance)
      singulars
      1. PONetty HTTP + MongoDB: Unlimited Increment in connections
      1. USRemon van Vliet
    2. COI've added the way I implement singleton MongoDB. I used to run MongoDB for maxConn=5 for experiment, and after opening more than 5 programs. It did crash. No newer connection is accepted.
      singulars
      1. PONetty HTTP + MongoDB: Unlimited Increment in connections
      1. USCheng
    3. COThanks for your help!! I do an experiment: reconfigure --maxConn to 10 and simulate a HTTP post every 2 seconds. I found after 15 HTTP posts. Come to 14 success, 1 fail (all of the connections are forced to reset). Is that because the imcompatible of Netty? I'm somehow regret using MongoDB.
      singulars
      1. PONetty HTTP + MongoDB: Unlimited Increment in connections
      1. USCheng
 

Querying!

 
Guidance
A row detail

Detail views are divided into sections. All the information in the data section comes from columns in the selected row. The other sections display data from other, related rows.

Related data can be related in a to-one or a to-many fashion. Captions of data related in a to-many fashion link to a list view showing a filtered view of the table.

Try moving around until you find a non-empty to-many entry and click on the label to get to one. You can move back to the root by clicking on the database name in the header.

SQuiL has stopped working due to an internal error.

If you are curious you may find further information in the browser console, which is accessible through the devtools (F12).

Reload