replicatedLevelDB not replicating messages

Previous Topic Next Topic
 
classic Classic list List threaded Threaded
8 messages Options
Reply | Threaded
Open this post in threaded view
|

replicatedLevelDB not replicating messages

bpoppa
So I have the replicatedLevelDB configured and working using the example on the activeMQ site.  Zookeeper is running, when I take a broker down, it detects and fires up on one of the others in the cluster.  My issue is this....it's just not replicating.  When I send messages to the queue, I can see it on the master, but if I were then to fail the master, the new master has none of the previous data.   Also, looking in the activemq.log, I see nothing that shows any replication of messages.

I feel like I am missing a simple piece.  Any thoughts?

Thanks!

Jim
Reply | Threaded
Open this post in threaded view
|

Re: replicatedLevelDB not replicating messages

Noel OConnor
Have you set the hostname and bind addresses ?
Is there anything in the slave log files ?

This is config that I've used a while ago

<persistenceAdapter>
             <replicatedLevelDB directory="../data/leveldb/amq"
              replicas="4"
              zkAddress="10.64.132.40:2182,10.64.132.40:2183,
10.64.132.40:2184"
              zkPassword="admin"

zkPath="/fabric/registry/clusters/fusemq-replication-elections/default"
              securityToken="admin"
              sync="quorum_disk"
              weight="90"
              hostname="10.64.132.148"
              bind="tcp://10.64.132.148:61619"
              />

</persistenceAdapter>

hth


On Wed, Feb 5, 2014 at 1:42 PM, bpoppa <[hidden email]> wrote:

> So I have the replicatedLevelDB configured and working using the example on
> the activeMQ site.  Zookeeper is running, when I take a broker down, it
> detects and fires up on one of the others in the cluster.  My issue is
> this....it's just not replicating.  When I send messages to the queue, I
> can
> see it on the master, but if I were then to fail the master, the new master
> has none of the previous data.   Also, looking in the activemq.log, I see
> nothing that shows any replication of messages.
>
> I feel like I am missing a simple piece.  Any thoughts?
>
> Thanks!
>
> Jim
>
>
>
> --
> View this message in context:
> http://activemq.2283324.n4.nabble.com/replicatedLevelDB-not-replicating-messages-tp4677444.html
> Sent from the ActiveMQ - User mailing list archive at Nabble.com.
>
Reply | Threaded
Open this post in threaded view
|

Re: replicatedLevelDB not replicating messages

bpoppa
I do.  Here is my config:

        <persistenceAdapter>
            <replicatedLevelDB directory="activemq-data" replicas="3" bind="tcp://10.240.242.233:61619" hostname="10.240.242.233" zkAddress="10.240.142.24:2181,10.240.242.233:2181,10.240.211.220:2181" zkPath="/activemq/leveldb-stores" sync="quorum_disk" />
        </persistenceAdapter>


I see initial syncs, including old deleted queues, but thats it.  Nothing when anything is added to the queue:

2014-02-05 04:03:45,332 | INFO  | Slave requested: 0000000000001203.index/000018.sst | org.apache.activemq.leveldb.replicated.SlaveLevelDBStore | hawtdispatch-DEFAULT-1
2014-02-05 04:03:45,333 | INFO  | Slave requested: 0000000000001203.index/000019.log | org.apache.activemq.leveldb.replicated.SlaveLevelDBStore | hawtdispatch-DEFAULT-1
2014-02-05 04:03:45,333 | INFO  | Slave requested: 0000000000001203.index/MANIFEST-000017 | org.apache.activemq.leveldb.replicated.SlaveLevelDBStore | hawtdispatch-DEFAULT-1
2014-02-05 04:03:45,340 | INFO  | Attaching... Downloaded 0.00/4.66 kb and 1/6 files | org.apache.activemq.leveldb.replicated.SlaveLevelDBStore | hawtdispatch-DEFAULT-1
2014-02-05 04:03:45,342 | INFO  | Attaching... Downloaded 0.93/4.66 kb and 2/6 files | org.apache.activemq.leveldb.replicated.SlaveLevelDBStore | hawtdispatch-DEFAULT-1
2014-02-05 04:03:45,343 | INFO  | Attaching... Downloaded 0.94/4.66 kb and 3/6 files | org.apache.activemq.leveldb.replicated.SlaveLevelDBStore | hawtdispatch-DEFAULT-1
2014-02-05 04:03:45,343 | INFO  | Attaching... Downloaded 1.92/4.66 kb and 4/6 files | org.apache.activemq.leveldb.replicated.SlaveLevelDBStore | hawtdispatch-DEFAULT-1
2014-02-05 04:03:45,344 | INFO  | Attaching... Downloaded 4.52/4.66 kb and 5/6 files | org.apache.activemq.leveldb.replicated.SlaveLevelDBStore | hawtdispatch-DEFAULT-1
2014-02-05 04:03:45,345 | INFO  | Attaching... Downloaded 4.66/4.66 kb and 6/6 files | org.apache.activemq.leveldb.replicated.SlaveLevelDBStore | hawtdispatch-DEFAULT-1
2014-02-05 04:03:45,346 | INFO  | Attached | org.apache.activemq.leveldb.replicated.SlaveLevelDBStore | hawtdispatch-DEFAULT-1
Reply | Threaded
Open this post in threaded view
|

Re: replicatedLevelDB not replicating messages

Noel OConnor
hmmm can you check if the messages are being sent persistently ?


On Wed, Feb 5, 2014 at 3:13 PM, bpoppa <[hidden email]> wrote:

> I do.  Here is my config:
>
>         <persistenceAdapter>
>             <replicatedLevelDB directory="activemq-data" replicas="3"
> bind="tcp://10.240.242.233:61619" hostname="10.240.242.233"
> zkAddress="10.240.142.24:2181,10.240.242.233:2181,10.240.211.220:2181"
> zkPath="/activemq/leveldb-stores" sync="quorum_disk" />
>         </persistenceAdapter>
>
>
> I see initial syncs, including old deleted queues, but thats it.  Nothing
> when anything is added to the queue:
>
>
>
>
>
> --
> View this message in context:
> http://activemq.2283324.n4.nabble.com/replicatedLevelDB-not-replicating-messages-tp4677444p4677448.html
> Sent from the ActiveMQ - User mailing list archive at Nabble.com.
>
Reply | Threaded
Open this post in threaded view
|

Re: replicatedLevelDB not replicating messages

bpoppa
There were not before.  I submitted a persistent one and now it works.  Did not know that, thanks!
Reply | Threaded
Open this post in threaded view
|

Re: replicatedLevelDB not replicating messages

bpoppa
Actually its weird.  It worked from the admin ui but not from my client passing in the persistent flag.  

On top of that I am now having another issue.  Whenever I send a message to the queue, the master errors out.

2014-02-05 14:51:28,348 | INFO  | Stopped LevelDB[/opt/apache-activemq-5.9.0/activemq-data] | org.apache.activemq.leveldb.LevelDBStore | LevelDB IOException handler.
2014-02-05 14:51:28,380 | INFO  | Connector openwire stopped | org.apache.activemq.broker.TransportConnector | IOExceptionHandler: stopping BrokerService[localhost]
2014-02-05 14:51:28,384 | INFO  | Connector amqp stopped | org.apache.activemq.broker.TransportConnector | IOExceptionHandler: stopping BrokerService[localhost]
2014-02-05 14:51:28,434 | ERROR | org.apache.activemq.broker.region.cursors.QueueStorePrefetch@4d77bef7:/test_jim,batchResetNeeded=false,storeHasMessages=true,size=1,cacheEnabled=false,maxBatchSize:2 - Failed to fill batch | org.apache.activemq.broker.region.cursors.AbstractStoreCursor | ActiveMQ Broker[localhost] Scheduler
org.apache.activemq.broker.SuppressReplyException: ShutdownBrokerInitiated
	at org.apache.activemq.util.DefaultIOExceptionHandler.handle(DefaultIOExceptionHandler.java:134)
	at org.apache.activemq.broker.BrokerService.handleIOException(BrokerService.java:2526)
	at org.apache.activemq.leveldb.LevelDBClient$$anon$2.run(LevelDBClient.scala:521)
Caused by: java.io.IOException
	at org.apache.activemq.util.IOExceptionSupport.create(IOExceptionSupport.java:39)
	at org.apache.activemq.leveldb.LevelDBClient.might_fail(LevelDBClient.scala:543)
	at org.apache.activemq.leveldb.LevelDBClient.might_fail_using_index(LevelDBClient.scala:974)
	at org.apache.activemq.leveldb.LevelDBClient.collectionCursor(LevelDBClient.scala:1270)
	at org.apache.activemq.leveldb.LevelDBClient.queueCursor(LevelDBClient.scala:1194)
	at org.apache.activemq.leveldb.DBManager.cursorMessages(DBManager.scala:708)
	at org.apache.activemq.leveldb.LevelDBStore$LevelDBMessageStore.recoverNextMessages(LevelDBStore.scala:741)
	at org.apache.activemq.broker.region.cursors.QueueStorePrefetch.doFillBatch(QueueStorePrefetch.java:106)
	at org.apache.activemq.broker.region.cursors.AbstractStoreCursor.fillBatch(AbstractStoreCursor.java:258)
	at org.apache.activemq.broker.region.cursors.AbstractStoreCursor.reset(AbstractStoreCursor.java:108)
	at org.apache.activemq.broker.region.cursors.StoreQueueCursor.reset(StoreQueueCursor.java:157)
	at org.apache.activemq.broker.region.Queue.doPageInForDispatch(Queue.java:1875)
	at org.apache.activemq.broker.region.Queue.pageInMessages(Queue.java:2086)
	at org.apache.activemq.broker.region.Queue.doBrowse(Queue.java:1096)
	at org.apache.activemq.broker.region.Queue.expireMessages(Queue.java:905)
	at org.apache.activemq.broker.region.Queue.access$100(Queue.java:79)
	at org.apache.activemq.broker.region.Queue$2.run(Queue.java:120)
	at org.apache.activemq.thread.SchedulerTimerTask.run(SchedulerTimerTask.java:33)
	at java.util.TimerThread.mainLoop(Timer.java:555)
	at java.util.TimerThread.run(Timer.java:505)
Caused by: java.lang.NullPointerException
	at org.apache.activemq.leveldb.LevelDBClient$$anonfun$queueCursor$1.apply(LevelDBClient.scala:1198)
	at org.apache.activemq.leveldb.LevelDBClient$$anonfun$queueCursor$1.apply(LevelDBClient.scala:1194)
	at org.apache.activemq.leveldb.LevelDBClient$$anonfun$collectionCursor$1$$anonfun$apply$mcV$sp$12.apply(LevelDBClient.scala:1272)
	at org.apache.activemq.leveldb.LevelDBClient$$anonfun$collectionCursor$1$$anonfun$apply$mcV$sp$12.apply(LevelDBClient.scala:1271)
	at org.apache.activemq.leveldb.LevelDBClient$RichDB.check$4(LevelDBClient.scala:315)
	at org.apache.activemq.leveldb.LevelDBClient$RichDB.cursorRange(LevelDBClient.scala:317)
	at org.apache.activemq.leveldb.LevelDBClient$$anonfun$collectionCursor$1.apply$mcV$sp(LevelDBClient.scala:1271)
	at org.apache.activemq.leveldb.LevelDBClient$$anonfun$collectionCursor$1.apply(LevelDBClient.scala:1271)
	at org.apache.activemq.leveldb.LevelDBClient$$anonfun$collectionCursor$1.apply(LevelDBClient.scala:1271)
	at org.apache.activemq.leveldb.LevelDBClient.usingIndex(LevelDBClient.scala:968)
	at org.apache.activemq.leveldb.LevelDBClient$$anonfun$might_fail_using_index$1.apply(LevelDBClient.scala:974)
	at org.apache.activemq.leveldb.LevelDBClient.might_fail(LevelDBClient.scala:540)
	... 18 more
2014-02-05 14:51:28,437 | ERROR | org.apache.activemq.broker.region.cursors.QueueStorePrefetch@4d77bef7:/test_jim,batchResetNeeded=false,storeHasMessages=true,size=1,cacheEnabled=false,maxBatchSize:2 - Failed to fill batch | org.apache.activemq.broker.region.cursors.AbstractStoreCursor | ActiveMQ Broker[localhost] Scheduler
java.lang.RuntimeException: org.apache.activemq.broker.SuppressReplyException: ShutdownBrokerInitiated
	at org.apache.activemq.broker.region.cursors.AbstractStoreCursor.fillBatch(AbstractStoreCursor.java:261)
	at org.apache.activemq.broker.region.cursors.AbstractStoreCursor.reset(AbstractStoreCursor.java:108)
	at org.apache.activemq.broker.region.cursors.StoreQueueCursor.reset(StoreQueueCursor.java:157)
	at org.apache.activemq.broker.region.Queue.doPageInForDispatch(Queue.java:1875)
	at org.apache.activemq.broker.region.Queue.pageInMessages(Queue.java:2086)
	at org.apache.activemq.broker.region.Queue.doBrowse(Queue.java:1096)
	at org.apache.activemq.broker.region.Queue.expireMessages(Queue.java:905)
	at org.apache.activemq.broker.region.Queue.access$100(Queue.java:79)
	at org.apache.activemq.broker.region.Queue$2.run(Queue.java:120)
	at org.apache.activemq.thread.SchedulerTimerTask.run(SchedulerTimerTask.java:33)
	at java.util.TimerThread.mainLoop(Timer.java:555)
	at java.util.TimerThread.run(Timer.java:505)
Caused by: org.apache.activemq.broker.SuppressReplyException: ShutdownBrokerInitiated
	at org.apache.activemq.util.DefaultIOExceptionHandler.handle(DefaultIOExceptionHandler.java:134)
	at org.apache.activemq.broker.BrokerService.handleIOException(BrokerService.java:2526)
	at org.apache.activemq.leveldb.LevelDBClient$$anon$2.run(LevelDBClient.scala:521)
Caused by: java.io.IOException
	at org.apache.activemq.util.IOExceptionSupport.create(IOExceptionSupport.java:39)
	at org.apache.activemq.leveldb.LevelDBClient.might_fail(LevelDBClient.scala:543)
	at org.apache.activemq.leveldb.LevelDBClient.might_fail_using_index(LevelDBClient.scala:974)
	at org.apache.activemq.leveldb.LevelDBClient.collectionCursor(LevelDBClient.scala:1270)
	at org.apache.activemq.leveldb.LevelDBClient.queueCursor(LevelDBClient.scala:1194)
	at org.apache.activemq.leveldb.DBManager.cursorMessages(DBManager.scala:708)
	at org.apache.activemq.leveldb.LevelDBStore$LevelDBMessageStore.recoverNextMessages(LevelDBStore.scala:741)
	at org.apache.activemq.broker.region.cursors.QueueStorePrefetch.doFillBatch(QueueStorePrefetch.java:106)
	at org.apache.activemq.broker.region.cursors.AbstractStoreCursor.fillBatch(AbstractStoreCursor.java:258)
	at org.apache.activemq.broker.region.cursors.AbstractStoreCursor.reset(AbstractStoreCursor.java:108)
	at org.apache.activemq.broker.region.cursors.StoreQueueCursor.reset(StoreQueueCursor.java:157)
	at org.apache.activemq.broker.region.Queue.doPageInForDispatch(Queue.java:1875)
	at org.apache.activemq.broker.region.Queue.pageInMessages(Queue.java:2086)
	at org.apache.activemq.broker.region.Queue.doBrowse(Queue.java:1096)
	at org.apache.activemq.broker.region.Queue.expireMessages(Queue.java:905)
	at org.apache.activemq.broker.region.Queue.access$100(Queue.java:79)
	at org.apache.activemq.broker.region.Queue$2.run(Queue.java:120)
	at org.apache.activemq.thread.SchedulerTimerTask.run(SchedulerTimerTask.java:33)
	at java.util.TimerThread.mainLoop(Timer.java:555)
	at java.util.TimerThread.run(Timer.java:505)
Caused by: java.lang.NullPointerException
	at org.apache.activemq.leveldb.LevelDBClient$$anonfun$queueCursor$1.apply(LevelDBClient.scala:1198)
	at org.apache.activemq.leveldb.LevelDBClient$$anonfun$queueCursor$1.apply(LevelDBClient.scala:1194)
	at org.apache.activemq.leveldb.LevelDBClient$$anonfun$collectionCursor$1$$anonfun$apply$mcV$sp$12.apply(LevelDBClient.scala:1272)
	at org.apache.activemq.leveldb.LevelDBClient$$anonfun$collectionCursor$1$$anonfun$apply$mcV$sp$12.apply(LevelDBClient.scala:1271)
	at org.apache.activemq.leveldb.LevelDBClient$RichDB.check$4(LevelDBClient.scala:315)
	at org.apache.activemq.leveldb.LevelDBClient$RichDB.cursorRange(LevelDBClient.scala:317)
	at org.apache.activemq.leveldb.LevelDBClient$$anonfun$collectionCursor$1.apply$mcV$sp(LevelDBClient.scala:1271)
	at org.apache.activemq.leveldb.LevelDBClient$$anonfun$collectionCursor$1.apply(LevelDBClient.scala:1271)
	at org.apache.activemq.leveldb.LevelDBClient$$anonfun$collectionCursor$1.apply(LevelDBClient.scala:1271)
	at org.apache.activemq.leveldb.LevelDBClient.usingIndex(LevelDBClient.scala:968)
	at org.apache.activemq.leveldb.LevelDBClient$$anonfun$might_fail_using_index$1.apply(LevelDBClient.scala:974)
	at org.apache.activemq.leveldb.LevelDBClient.might_fail(LevelDBClient.scala:540)
	... 18 more
2014-02-05 14:51:28,439 | ERROR | Problem retrieving message for browse | org.apache.activemq.broker.region.Queue | ActiveMQ Broker[localhost] Scheduler
java.lang.RuntimeException: java.lang.RuntimeException: org.apache.activemq.broker.SuppressReplyException: ShutdownBrokerInitiated
	at org.apache.activemq.broker.region.cursors.AbstractStoreCursor.reset(AbstractStoreCursor.java:111)
	at org.apache.activemq.broker.region.cursors.StoreQueueCursor.reset(StoreQueueCursor.java:157)
	at org.apache.activemq.broker.region.Queue.doPageInForDispatch(Queue.java:1875)
	at org.apache.activemq.broker.region.Queue.pageInMessages(Queue.java:2086)
	at org.apache.activemq.broker.region.Queue.doBrowse(Queue.java:1096)
	at org.apache.activemq.broker.region.Queue.expireMessages(Queue.java:905)
	at org.apache.activemq.broker.region.Queue.access$100(Queue.java:79)
	at org.apache.activemq.broker.region.Queue$2.run(Queue.java:120)
	at org.apache.activemq.thread.SchedulerTimerTask.run(SchedulerTimerTask.java:33)
	at java.util.TimerThread.mainLoop(Timer.java:555)
	at java.util.TimerThread.run(Timer.java:505)
Caused by: java.lang.RuntimeException: org.apache.activemq.broker.SuppressReplyException: ShutdownBrokerInitiated
	at org.apache.activemq.broker.region.cursors.AbstractStoreCursor.fillBatch(AbstractStoreCursor.java:261)
	at org.apache.activemq.broker.region.cursors.AbstractStoreCursor.reset(AbstractStoreCursor.java:108)
	... 10 more
Caused by: org.apache.activemq.broker.SuppressReplyException: ShutdownBrokerInitiated
	at org.apache.activemq.util.DefaultIOExceptionHandler.handle(DefaultIOExceptionHandler.java:134)
	at org.apache.activemq.broker.BrokerService.handleIOException(BrokerService.java:2526)
	at org.apache.activemq.leveldb.LevelDBClient$$anon$2.run(LevelDBClient.scala:521)
Caused by: java.io.IOException
	at org.apache.activemq.util.IOExceptionSupport.create(IOExceptionSupport.java:39)
	at org.apache.activemq.leveldb.LevelDBClient.might_fail(LevelDBClient.scala:543)
	at org.apache.activemq.leveldb.LevelDBClient.might_fail_using_index(LevelDBClient.scala:974)
	at org.apache.activemq.leveldb.LevelDBClient.collectionCursor(LevelDBClient.scala:1270)
	at org.apache.activemq.leveldb.LevelDBClient.queueCursor(LevelDBClient.scala:1194)
	at org.apache.activemq.leveldb.DBManager.cursorMessages(DBManager.scala:708)
	at org.apache.activemq.leveldb.LevelDBStore$LevelDBMessageStore.recoverNextMessages(LevelDBStore.scala:741)
	at org.apache.activemq.broker.region.cursors.QueueStorePrefetch.doFillBatch(QueueStorePrefetch.java:106)
	at org.apache.activemq.broker.region.cursors.AbstractStoreCursor.fillBatch(AbstractStoreCursor.java:258)
	at org.apache.activemq.broker.region.cursors.AbstractStoreCursor.reset(AbstractStoreCursor.java:108)
	at org.apache.activemq.broker.region.cursors.StoreQueueCursor.reset(StoreQueueCursor.java:157)
	at org.apache.activemq.broker.region.Queue.doPageInForDispatch(Queue.java:1875)
	at org.apache.activemq.broker.region.Queue.pageInMessages(Queue.java:2086)
	at org.apache.activemq.broker.region.Queue.doBrowse(Queue.java:1096)
	at org.apache.activemq.broker.region.Queue.expireMessages(Queue.java:905)
	at org.apache.activemq.broker.region.Queue.access$100(Queue.java:79)
	at org.apache.activemq.broker.region.Queue$2.run(Queue.java:120)
	at org.apache.activemq.thread.SchedulerTimerTask.run(SchedulerTimerTask.java:33)
	at java.util.TimerThread.mainLoop(Timer.java:555)
	at java.util.TimerThread.run(Timer.java:505)
Caused by: java.lang.NullPointerException
	at org.apache.activemq.leveldb.LevelDBClient$$anonfun$queueCursor$1.apply(LevelDBClient.scala:1198)
	at org.apache.activemq.leveldb.LevelDBClient$$anonfun$queueCursor$1.apply(LevelDBClient.scala:1194)
	at org.apache.activemq.leveldb.LevelDBClient$$anonfun$collectionCursor$1$$anonfun$apply$mcV$sp$12.apply(LevelDBClient.scala:1272)
	at org.apache.activemq.leveldb.LevelDBClient$$anonfun$collectionCursor$1$$anonfun$apply$mcV$sp$12.apply(LevelDBClient.scala:1271)
	at org.apache.activemq.leveldb.LevelDBClient$RichDB.check$4(LevelDBClient.scala:315)
	at org.apache.activemq.leveldb.LevelDBClient$RichDB.cursorRange(LevelDBClient.scala:317)
	at org.apache.activemq.leveldb.LevelDBClient$$anonfun$collectionCursor$1.apply$mcV$sp(LevelDBClient.scala:1271)
	at org.apache.activemq.leveldb.LevelDBClient$$anonfun$collectionCursor$1.apply(LevelDBClient.scala:1271)
	at org.apache.activemq.leveldb.LevelDBClient$$anonfun$collectionCursor$1.apply(LevelDBClient.scala:1271)
	at org.apache.activemq.leveldb.LevelDBClient.usingIndex(LevelDBClient.scala:968)
	at org.apache.activemq.leveldb.LevelDBClient$$anonfun$might_fail_using_index$1.apply(LevelDBClient.scala:974)
	at org.apache.activemq.leveldb.LevelDBClient.might_fail(LevelDBClient.scala:540)
	... 18 more
2014-02-05 14:51:29,260 | INFO  | Connector stomp stopped | org.apache.activemq.broker.TransportConnector | IOExceptionHandler: stopping BrokerService[localhost]
2014-02-05 14:51:30,396 | INFO  | Connector mqtt stopped | org.apache.activemq.broker.TransportConnector | IOExceptionHandler: stopping BrokerService[localhost]
2014-02-05 14:51:30,465 | INFO  | Connector ws stopped | org.apache.activemq.broker.TransportConnector | IOExceptionHandler: stopping BrokerService[localhost]
2014-02-05 14:51:30,474 | INFO  | StateChangeDispatcher terminated. | org.apache.activemq.leveldb.replicated.groups.ZKClient | ZooKeeper state change dispatcher thread
2014-02-05 14:51:30,475 | WARN  | Unexpected session error: java.io.IOException: Connection reset by peer | org.apache.activemq.leveldb.replicated.MasterLevelDBStore | hawtdispatch-DEFAULT-2
2014-02-05 14:51:30,477 | INFO  | Slave has disconnected: 3a4a91f3-e0af-4ba6-b53a-2ceb9511c7fc | org.apache.activemq.leveldb.replicated.MasterLevelDBStore | hawtdispatch-DEFAULT-2
2014-02-05 14:51:30,478 | INFO  | EventThread shut down | org.apache.zookeeper.ClientCnxn | main-EventThread
2014-02-05 14:51:30,478 | INFO  | Session: 0x14400461eb50012 closed | org.apache.zookeeper.ZooKeeper | IOExceptionHandler: stopping BrokerService[localhost]
2014-02-05 14:51:30,480 | WARN  | Unexpected session error: java.io.IOException: Connection reset by peer | org.apache.activemq.leveldb.replicated.MasterLevelDBStore | hawtdispatch-DEFAULT-1
Reply | Threaded
Open this post in threaded view
|

Re: replicatedLevelDB not replicating messages

kal123
which version you are using? getting error after failover?  I saw some exception during testing with 5.9 most of them are fixed in 5.10 snapshot.  Any other exception or stack trace prior to this?  

Reply | Threaded
Open this post in threaded view
|

Re: replicatedLevelDB not replicating messages

kal123
This post was updated on .
this is similar error I saw after failovers.. you can try the latest snapshots seems much better except for one issue.. see http://activemq.2283324.n4.nabble.com/Replicated-LevelDB-Store-getting-EOF-exception-td4676541.html

I made local changes in leveldb code to skip over msg   it can't read, so able keep the broker up after failover when leveldb data files are corrupted. There is loss of msg (hopefully someone can fix this), but at least my broker stays up for my dev. testing.