Hi All,
Don't you think it's better to have enqueued and dequeued message counts in the MB UI against queues and total messages delivered to subscribers? Thanks & regards, Nirmal Technical Lead, WSO2 Inc. Mobile: +94715779733 Blog: http://nirmalfdo.blogspot.com/ ![]() _______________________________________________ Architecture mailing list [hidden email] https://mail.wso2.org/cgi-bin/mailman/listinfo/architecture |
Hi Nirmal, We are planning to include these metrics in MB4.On Sun, Jan 21, 2018 at 11:04 PM, Nirmal Fernando <[hidden email]> wrote:
-- _______________________________________________ Architecture mailing list [hidden email] https://mail.wso2.org/cgi-bin/mailman/listinfo/architecture |
In reply to this post by Nirmal Fernando-3
Hi Nirmal, Definitely it is a very essential and long waited feature. But MB 3.2.0 has limitations when come to clustered environment. 1. If we use Hazelcast distributed data structure to keep the count, it is not reliable/cannot tolerate network splits and merge. 2. We have same experience with distributed message counting with Cassandra. It stores the count in quorum number of nodes but as increases and decreases happens per node very fast counts were wrong at EOD. 3. If we update count per message, number of messages to do between nodes to sync the count will be even higher, which does not work. So after moved to RDBMS, even there if we keep the count at DB field we need to update per message, which causes too many DB writes. If we update the count once per 1000 messages, 1. If two nodes needs to update the count, they need to coordinate and do it, otherwise there will be race conditions. 2. what if 999 messages were delivered and subscription was closed? We need to update using a timeout thread. 3. What if the node crashed all of a sudden before updating the db field? Counts will be wrong. Due to complications like above, we still did not do the implementation. For APIM throttling etc, some error margin or delay to update will be tolerable. But for a broker counts should be accurate and should reflect the current truth I think. This boils down to distributed counting problem (which is a research) Thanks On Sun, Jan 21, 2018 at 11:04 PM, Nirmal Fernando <[hidden email]> wrote:
_______________________________________________ Architecture mailing list [hidden email] https://mail.wso2.org/cgi-bin/mailman/listinfo/architecture |
In reply to this post by Asanka Abeyweera
Hi Asanka, Yes, for MB4 this is possible as it is all about Active/Passive rather Active/Active. Thanks On Sun, Jan 21, 2018 at 11:08 PM, Asanka Abeyweera <[hidden email]> wrote:
_______________________________________________ Architecture mailing list [hidden email] https://mail.wso2.org/cgi-bin/mailman/listinfo/architecture |
Yes. What we were also discussing was to further categorize the messages sent to subscriptions by channel id. So in a queue etc we will be able to co-relate the dispatched message counts against the channel id as well. On Sun, Jan 21, 2018 at 11:25 PM, Hasitha Hiranya <[hidden email]> wrote:
_______________________________________________ Architecture mailing list [hidden email] https://mail.wso2.org/cgi-bin/mailman/listinfo/architecture |
Free forum by Nabble | Edit this page |