Artemis leaks file descriptors

classic Classic list List threaded Threaded
7 messages Options
Reply | Threaded
Open this post in threaded view
|

Artemis leaks file descriptors

rakesh
This post was updated on .
Hello Folks,

We are using Apache Artemis 2.6.4 and experiencing a spike in the number of
open file descriptors in case of large messages. When analysed,
It has the reference to deleted large message, after the large messages are consumed. Below, you can see the the
partial list.

java    38082 root 9486u   REG                8,4      909757   19146486
/xxx/data/large-messages/31297137237.msg (deleted)
java    38082 root 9489u   REG                8,4      605189   19146488
/xxx/data/large-messages/31297137344.msg (deleted)

The problem we are facing looks something similar to the already fixed bug
in 2.6.0: https://issues.apache.org/jira/browse/ARTEMIS-1754

Is it a known problem or anyone faced the same problem? It would be great if
you can share any experience with handling this problem.  

Thanks in advance



--
Sent from: http://activemq.2283324.n4.nabble.com/ActiveMQ-User-f2341805.html
Reply | Threaded
Open this post in threaded view
|

Re: Artemis leaks file descriptors

Bummer
I too have experienced this issue with a large amount of "large messages".
I'm talking several GiBs of data. Suddenly, the amount of opened FDs went so
high the broker stopped working.



--
Sent from: http://activemq.2283324.n4.nabble.com/ActiveMQ-User-f2341805.html
Reply | Threaded
Open this post in threaded view
|

Re: Artemis leaks file descriptors

nigro_franz
Hi! DId you have checked against the latest version of Artemis on master?



--
Sent from: http://activemq.2283324.n4.nabble.com/ActiveMQ-User-f2341805.html
Reply | Threaded
Open this post in threaded view
|

Re: Artemis leaks file descriptors

rakesh
This post was updated on .
@nigro_franz I'm upgrading to 2.9.0 now. I'll test with this one and update
the results here.



--
Sent from: http://activemq.2283324.n4.nabble.com/ActiveMQ-User-f2341805.html
Reply | Threaded
Open this post in threaded view
|

Re: Artemis leaks file descriptors

rakesh
@nigro_franz, I still face the problem with 2.9.0. I'm using stomp protocol
and have set the min-large-message-size to 430080 and journal-buffer-size
remain default (490 KiB). The messages are published to a topic having large
backlog and there also exists a route or a divert from this topic to
another.




--
Sent from: http://activemq.2283324.n4.nabble.com/ActiveMQ-User-f2341805.html
Reply | Threaded
Open this post in threaded view
|

Re: Artemis leaks file descriptors

jbertram
Can you provide steps to reproduce this behavior?


Justin

On Thu, Jul 11, 2019 at 10:55 AM rakesh <[hidden email]> wrote:

> @nigro_franz, I still face the problem with 2.9.0. I'm using stomp protocol
> and have set the min-large-message-size to 430080 and journal-buffer-size
> remain default (490 KiB). The messages are published to a topic having
> large
> backlog and there also exists a route or a divert from this topic to
> another.
>
>
>
>
> --
> Sent from:
> http://activemq.2283324.n4.nabble.com/ActiveMQ-User-f2341805.html
>
Reply | Threaded
Open this post in threaded view
|

Re: Artemis leaks file descriptors

rakesh
Hi Justin, I don't know the exact way to reproduce this problem. But I've the
following trace, where it can be clearly noted that the file doesn't get
closed.

2019-07-22 00:55:46 TRACE
[org.apache.activemq.artemis.core.persistence.impl.journal.JournalStorageManager]
Opening large message file with message-id=88,781,015,028
2019-07-22 00:55:46 TRACE
[org.apache.activemq.artemis.core.persistence.impl.journal.JournalStorageManager]
Closing large message file with message-id=88,781,015,028
2019-07-22 01:02:22 TRACE
[org.apache.activemq.artemis.core.persistence.impl.journal.JournalStorageManager]
Opening large message file with message-id=88,781,015,028
2019-07-22 01:02:22 TRACE
[org.apache.activemq.artemis.core.persistence.impl.journal.JournalStorageManager]
Opening decoding context file for large message with
message-id=88,781,015,028
2019-07-22 01:02:22 TRACE
[org.apache.activemq.artemis.core.persistence.impl.journal.JournalStorageManager]
Closing decoding context file for large message with
message-id=88,781,015,028
2019-07-22 01:02:23 TRACE
[org.apache.activemq.artemis.core.persistence.impl.journal.JournalStorageManager]
Opening large message file with message-id=88,781,015,028
2019-07-22 01:02:23 TRACE
[org.apache.activemq.artemis.core.persistence.impl.journal.JournalStorageManager]
Closing large message file with message-id=88,781,015,028

Hope this helps.





--
Sent from: http://activemq.2283324.n4.nabble.com/ActiveMQ-User-f2341805.html