Quantcast

[jira] [Created] (AMQ-3290) Wire format negotiation timeout: peer did not send his wire format

classic Classic list List threaded Threaded
10 messages Options
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

[jira] [Created] (AMQ-3290) Wire format negotiation timeout: peer did not send his wire format

JIRA jira@apache.org
Wire format negotiation timeout: peer did not send his wire format
------------------------------------------------------------------

                 Key: AMQ-3290
                 URL: https://issues.apache.org/jira/browse/AMQ-3290
             Project: ActiveMQ
          Issue Type: Bug
          Components: Broker
    Affects Versions: 5.3.2
         Environment: MS Windows 7 Home Premium x64 Intel Core i5 M 460 RAM 6GB
            Reporter: Maxim Novikov
            Priority: Critical


I have two client application written on Java. Each of them has consumers to ActiveMQ (maven dependancy 'activemq-core' version 5.3.2).
Also there are three applications written on C# (two windows services and one ASP.NET application) which use Apache.NMS 1.5 to connect to ActiveMQ server.

During some time everything's fine (e.g. today this period has been about 4 hours). But since some moment .NET started throw the following exception:

Wire format negotiation timeout: peer did not send his wire format.
Apache.NMS.ActiveMQ.IOException: Wire format negotiation timeout: peer did not send his wire format.
   at Apache.NMS.ActiveMQ.Connection.SyncRequest(Command command) in c:\dev\NMS.ActiveMQ\src\main\csharp\Connection.cs:line 628
   at Apache.NMS.ActiveMQ.Connection.CheckConnected() in c:\dev\NMS.ActiveMQ\src\main\csharp\Connection.cs:line 712
   at Apache.NMS.ActiveMQ.Connection.CreateAtiveMQSession(AcknowledgementMode ackMode) in c:\dev\NMS.ActiveMQ\src\main\csharp\Connection.cs:line 467
   at Apache.NMS.ActiveMQ.Connection.CreateSession() in c:\dev\NMS.ActiveMQ\src\main\csharp\Connection.cs:line 454

Actually Java consumers also don't work though there are no errors in their part. But I can see via ActiveMQ web console that no one Query has consumers (for each Query column 'Number Of Consumers' value equals 0).
So actually nothing works (not Java, not C#) since some moment. I can see the error in .NET but can't see in Java.

Also this problem appears after restarting operation system. Not always but it happens occasionally.

PS For Java application I use org.apache.activemq.ActiveMQConnectionFactory and Mule ESB jms:activemq-connector. And this part doesn't show error when it happens.
For C# applications I use Apache.NMS.ActiveMQ.ConnectionFactory and every time when I think we can face to problem I'm trying to get new connection with the following code lines:

if ((connection == null) || !connection.IsStarted)
{
        connection = factory.CreateConnection();
        ISession session = connection.CreateSession();
        IDestination dest = session.GetDestination(Queue);
        producer = session.CreateProducer(dest);
}

but unfortunately it doesn't help.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

[jira] [Updated] (AMQ-3290) Wire format negotiation timeout: peer did not send his wire format

JIRA jira@apache.org

     [ https://issues.apache.org/jira/browse/AMQ-3290?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Maxim Novikov updated AMQ-3290:
-------------------------------

    Attachment: hs_err_pid24632.log

JVM crash log

> Wire format negotiation timeout: peer did not send his wire format
> ------------------------------------------------------------------
>
>                 Key: AMQ-3290
>                 URL: https://issues.apache.org/jira/browse/AMQ-3290
>             Project: ActiveMQ
>          Issue Type: Bug
>          Components: Broker
>    Affects Versions: 5.3.2
>         Environment: MS Windows 7 Home Premium x64 Intel Core i5 M 460 RAM 6GB
>            Reporter: Maxim Novikov
>            Priority: Critical
>              Labels: connection, did, failed, format, negotiation, not, peer, send, timeout, wire
>         Attachments: hs_err_pid24632.log
>
>   Original Estimate: 24h
>  Remaining Estimate: 24h
>
> I have two client application written on Java. Each of them has consumers to ActiveMQ (maven dependancy 'activemq-core' version 5.3.2).
> Also there are three applications written on C# (two windows services and one ASP.NET application) which use Apache.NMS 1.5 to connect to ActiveMQ server.
> During some time everything's fine (e.g. today this period has been about 4 hours). But since some moment .NET started throw the following exception:
> Wire format negotiation timeout: peer did not send his wire format.
> Apache.NMS.ActiveMQ.IOException: Wire format negotiation timeout: peer did not send his wire format.
>    at Apache.NMS.ActiveMQ.Connection.SyncRequest(Command command) in c:\dev\NMS.ActiveMQ\src\main\csharp\Connection.cs:line 628
>    at Apache.NMS.ActiveMQ.Connection.CheckConnected() in c:\dev\NMS.ActiveMQ\src\main\csharp\Connection.cs:line 712
>    at Apache.NMS.ActiveMQ.Connection.CreateAtiveMQSession(AcknowledgementMode ackMode) in c:\dev\NMS.ActiveMQ\src\main\csharp\Connection.cs:line 467
>    at Apache.NMS.ActiveMQ.Connection.CreateSession() in c:\dev\NMS.ActiveMQ\src\main\csharp\Connection.cs:line 454
> Actually Java consumers also don't work though there are no errors in their part. But I can see via ActiveMQ web console that no one Query has consumers (for each Query column 'Number Of Consumers' value equals 0).
> So actually nothing works (not Java, not C#) since some moment. I can see the error in .NET but can't see in Java.
> Also this problem appears after restarting operation system. Not always but it happens occasionally.
> PS For Java application I use org.apache.activemq.ActiveMQConnectionFactory and Mule ESB jms:activemq-connector. And this part doesn't show error when it happens.
> For C# applications I use Apache.NMS.ActiveMQ.ConnectionFactory and every time when I think we can face to problem I'm trying to get new connection with the following code lines:
> if ((connection == null) || !connection.IsStarted)
> {
> connection = factory.CreateConnection();
> ISession session = connection.CreateSession();
> IDestination dest = session.GetDestination(Queue);
> producer = session.CreateProducer(dest);
> }
> but unfortunately it doesn't help.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

[jira] [Commented] (AMQ-3290) Wire format negotiation timeout: peer did not send his wire format

JIRA jira@apache.org
In reply to this post by JIRA jira@apache.org

    [ https://issues.apache.org/jira/browse/AMQ-3290?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13024660#comment-13024660 ]

Maxim Novikov commented on AMQ-3290:
------------------------------------

Also JVM crashed today, so I added its log file (hs_err_pid24632.log).

And quite often before problems occur I can see in wrapper.log the following error:

INFO   | jvm 1    | 2011/04/24 22:24:18 | Exception in thread "ActiveMQ Transport Server Thread Handler: tcp://0.0.0.0:61616" java.lang.OutOfMemoryError: unable to create new native thread
INFO   | jvm 1    | 2011/04/24 22:24:18 | at java.lang.Thread.start0(Native Method)
INFO   | jvm 1    | 2011/04/24 22:24:18 | at java.lang.Thread.start(Unknown Source)
INFO   | jvm 1    | 2011/04/24 22:24:18 | at org.apache.activemq.thread.TaskRunnerFactory.execute(TaskRunnerFactory.java:92)
INFO   | jvm 1    | 2011/04/24 22:24:18 | at org.apache.activemq.thread.TaskRunnerFactory.execute(TaskRunnerFactory.java:85)
INFO   | jvm 1    | 2011/04/24 22:24:18 | at org.apache.activemq.broker.TransportConnector$1.onAccept(TransportConnector.java:209)
INFO   | jvm 1    | 2011/04/24 22:24:18 | at org.apache.activemq.transport.tcp.TcpTransportServer.handleSocket(TcpTransportServer.java:428)
INFO   | jvm 1    | 2011/04/24 22:24:18 | at org.apache.activemq.transport.tcp.TcpTransportServer$1.run(TcpTransportServer.java:354)
INFO   | jvm 1    | 2011/04/24 22:24:18 | at java.lang.Thread.run(Unknown Source)

I run ActiveMQ as service.

Configuration of memory usage:

        <systemUsage>
            <systemUsage>
                <memoryUsage>
                    <memoryUsage limit="500 mb"/>
                </memoryUsage>
                <storeUsage>
                    <storeUsage limit="5 gb"/>
                </storeUsage>
                <tempUsage>
                    <tempUsage limit="1 gb"/>
                </tempUsage>
            </systemUsage>
        </systemUsage>

'memoryLimit' parameter for consumers and producers doesn't affect anything.

Maximum Java Heap size of Tanuki wrapper - wrapper.java.maxmemory=1024.




> Wire format negotiation timeout: peer did not send his wire format
> ------------------------------------------------------------------
>
>                 Key: AMQ-3290
>                 URL: https://issues.apache.org/jira/browse/AMQ-3290
>             Project: ActiveMQ
>          Issue Type: Bug
>          Components: Broker
>    Affects Versions: 5.3.2
>         Environment: MS Windows 7 Home Premium x64 Intel Core i5 M 460 RAM 6GB
>            Reporter: Maxim Novikov
>            Priority: Critical
>              Labels: connection, did, failed, format, negotiation, not, peer, send, timeout, wire
>         Attachments: hs_err_pid24632.log
>
>   Original Estimate: 24h
>  Remaining Estimate: 24h
>
> I have two client application written on Java. Each of them has consumers to ActiveMQ (maven dependancy 'activemq-core' version 5.3.2).
> Also there are three applications written on C# (two windows services and one ASP.NET application) which use Apache.NMS 1.5 to connect to ActiveMQ server.
> During some time everything's fine (e.g. today this period has been about 4 hours). But since some moment .NET started throw the following exception:
> Wire format negotiation timeout: peer did not send his wire format.
> Apache.NMS.ActiveMQ.IOException: Wire format negotiation timeout: peer did not send his wire format.
>    at Apache.NMS.ActiveMQ.Connection.SyncRequest(Command command) in c:\dev\NMS.ActiveMQ\src\main\csharp\Connection.cs:line 628
>    at Apache.NMS.ActiveMQ.Connection.CheckConnected() in c:\dev\NMS.ActiveMQ\src\main\csharp\Connection.cs:line 712
>    at Apache.NMS.ActiveMQ.Connection.CreateAtiveMQSession(AcknowledgementMode ackMode) in c:\dev\NMS.ActiveMQ\src\main\csharp\Connection.cs:line 467
>    at Apache.NMS.ActiveMQ.Connection.CreateSession() in c:\dev\NMS.ActiveMQ\src\main\csharp\Connection.cs:line 454
> Actually Java consumers also don't work though there are no errors in their part. But I can see via ActiveMQ web console that no one Query has consumers (for each Query column 'Number Of Consumers' value equals 0).
> So actually nothing works (not Java, not C#) since some moment. I can see the error in .NET but can't see in Java.
> Also this problem appears after restarting operation system. Not always but it happens occasionally.
> PS For Java application I use org.apache.activemq.ActiveMQConnectionFactory and Mule ESB jms:activemq-connector. And this part doesn't show error when it happens.
> For C# applications I use Apache.NMS.ActiveMQ.ConnectionFactory and every time when I think we can face to problem I'm trying to get new connection with the following code lines:
> if ((connection == null) || !connection.IsStarted)
> {
> connection = factory.CreateConnection();
> ISession session = connection.CreateSession();
> IDestination dest = session.GetDestination(Queue);
> producer = session.CreateProducer(dest);
> }
> but unfortunately it doesn't help.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

[jira] [Issue Comment Edited] (AMQ-3290) Wire format negotiation timeout: peer did not send his wire format

JIRA jira@apache.org
In reply to this post by JIRA jira@apache.org

    [ https://issues.apache.org/jira/browse/AMQ-3290?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13024659#comment-13024659 ]

Maxim Novikov edited comment on AMQ-3290 at 4/24/11 7:21 PM:
-------------------------------------------------------------

JVM crash log.

ActiveMQ creates more than 2000 (!!!) threads!..
It happens when producer (only one producer) sends about 60 messages per seconds.
It would appear that on each new incoming message ActiveMQ creates new thread and they continue to live forever.
Looks like great leaks take place...


      was (Author: csbubbles):
    JVM crash log
 

> Wire format negotiation timeout: peer did not send his wire format
> ------------------------------------------------------------------
>
>                 Key: AMQ-3290
>                 URL: https://issues.apache.org/jira/browse/AMQ-3290
>             Project: ActiveMQ
>          Issue Type: Bug
>          Components: Broker
>    Affects Versions: 5.3.2
>         Environment: MS Windows 7 Home Premium x64 Intel Core i5 M 460 RAM 6GB
>            Reporter: Maxim Novikov
>            Priority: Critical
>              Labels: connection, did, failed, format, negotiation, not, peer, send, timeout, wire
>         Attachments: hs_err_pid24632.log
>
>   Original Estimate: 24h
>  Remaining Estimate: 24h
>
> I have two client application written on Java. Each of them has consumers to ActiveMQ (maven dependancy 'activemq-core' version 5.3.2).
> Also there are three applications written on C# (two windows services and one ASP.NET application) which use Apache.NMS 1.5 to connect to ActiveMQ server.
> During some time everything's fine (e.g. today this period has been about 4 hours). But since some moment .NET started throw the following exception:
> Wire format negotiation timeout: peer did not send his wire format.
> Apache.NMS.ActiveMQ.IOException: Wire format negotiation timeout: peer did not send his wire format.
>    at Apache.NMS.ActiveMQ.Connection.SyncRequest(Command command) in c:\dev\NMS.ActiveMQ\src\main\csharp\Connection.cs:line 628
>    at Apache.NMS.ActiveMQ.Connection.CheckConnected() in c:\dev\NMS.ActiveMQ\src\main\csharp\Connection.cs:line 712
>    at Apache.NMS.ActiveMQ.Connection.CreateAtiveMQSession(AcknowledgementMode ackMode) in c:\dev\NMS.ActiveMQ\src\main\csharp\Connection.cs:line 467
>    at Apache.NMS.ActiveMQ.Connection.CreateSession() in c:\dev\NMS.ActiveMQ\src\main\csharp\Connection.cs:line 454
> Actually Java consumers also don't work though there are no errors in their part. But I can see via ActiveMQ web console that no one Query has consumers (for each Query column 'Number Of Consumers' value equals 0).
> So actually nothing works (not Java, not C#) since some moment. I can see the error in .NET but can't see in Java.
> Also this problem appears after restarting operation system. Not always but it happens occasionally.
> PS For Java application I use org.apache.activemq.ActiveMQConnectionFactory and Mule ESB jms:activemq-connector. And this part doesn't show error when it happens.
> For C# applications I use Apache.NMS.ActiveMQ.ConnectionFactory and every time when I think we can face to problem I'm trying to get new connection with the following code lines:
> if ((connection == null) || !connection.IsStarted)
> {
> connection = factory.CreateConnection();
> ISession session = connection.CreateSession();
> IDestination dest = session.GetDestination(Queue);
> producer = session.CreateProducer(dest);
> }
> but unfortunately it doesn't help.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

[jira] [Issue Comment Edited] (AMQ-3290) Wire format negotiation timeout: peer did not send his wire format

JIRA jira@apache.org
In reply to this post by JIRA jira@apache.org

    [ https://issues.apache.org/jira/browse/AMQ-3290?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13024660#comment-13024660 ]

Maxim Novikov edited comment on AMQ-3290 at 4/24/11 7:22 PM:
-------------------------------------------------------------

JVM crashed today, so I added its log file (hs_err_pid24632.log).

And quite often before problems occur I can see in wrapper.log the following error:

INFO   | jvm 1    | 2011/04/24 22:24:18 | Exception in thread "ActiveMQ Transport Server Thread Handler: tcp://0.0.0.0:61616" java.lang.OutOfMemoryError: unable to create new native thread
INFO   | jvm 1    | 2011/04/24 22:24:18 | at java.lang.Thread.start0(Native Method)
INFO   | jvm 1    | 2011/04/24 22:24:18 | at java.lang.Thread.start(Unknown Source)
INFO   | jvm 1    | 2011/04/24 22:24:18 | at org.apache.activemq.thread.TaskRunnerFactory.execute(TaskRunnerFactory.java:92)
INFO   | jvm 1    | 2011/04/24 22:24:18 | at org.apache.activemq.thread.TaskRunnerFactory.execute(TaskRunnerFactory.java:85)
INFO   | jvm 1    | 2011/04/24 22:24:18 | at org.apache.activemq.broker.TransportConnector$1.onAccept(TransportConnector.java:209)
INFO   | jvm 1    | 2011/04/24 22:24:18 | at org.apache.activemq.transport.tcp.TcpTransportServer.handleSocket(TcpTransportServer.java:428)
INFO   | jvm 1    | 2011/04/24 22:24:18 | at org.apache.activemq.transport.tcp.TcpTransportServer$1.run(TcpTransportServer.java:354)
INFO   | jvm 1    | 2011/04/24 22:24:18 | at java.lang.Thread.run(Unknown Source)

I run ActiveMQ as service.

Configuration of memory usage:

        <systemUsage>
            <systemUsage>
                <memoryUsage>
                    <memoryUsage limit="500 mb"/>
                </memoryUsage>
                <storeUsage>
                    <storeUsage limit="5 gb"/>
                </storeUsage>
                <tempUsage>
                    <tempUsage limit="1 gb"/>
                </tempUsage>
            </systemUsage>
        </systemUsage>

'memoryLimit' parameter for consumers and producers doesn't affect anything.

Maximum Java Heap size of Tanuki wrapper - wrapper.java.maxmemory=1024.




      was (Author: csbubbles):
    Also JVM crashed today, so I added its log file (hs_err_pid24632.log).

And quite often before problems occur I can see in wrapper.log the following error:

INFO   | jvm 1    | 2011/04/24 22:24:18 | Exception in thread "ActiveMQ Transport Server Thread Handler: tcp://0.0.0.0:61616" java.lang.OutOfMemoryError: unable to create new native thread
INFO   | jvm 1    | 2011/04/24 22:24:18 | at java.lang.Thread.start0(Native Method)
INFO   | jvm 1    | 2011/04/24 22:24:18 | at java.lang.Thread.start(Unknown Source)
INFO   | jvm 1    | 2011/04/24 22:24:18 | at org.apache.activemq.thread.TaskRunnerFactory.execute(TaskRunnerFactory.java:92)
INFO   | jvm 1    | 2011/04/24 22:24:18 | at org.apache.activemq.thread.TaskRunnerFactory.execute(TaskRunnerFactory.java:85)
INFO   | jvm 1    | 2011/04/24 22:24:18 | at org.apache.activemq.broker.TransportConnector$1.onAccept(TransportConnector.java:209)
INFO   | jvm 1    | 2011/04/24 22:24:18 | at org.apache.activemq.transport.tcp.TcpTransportServer.handleSocket(TcpTransportServer.java:428)
INFO   | jvm 1    | 2011/04/24 22:24:18 | at org.apache.activemq.transport.tcp.TcpTransportServer$1.run(TcpTransportServer.java:354)
INFO   | jvm 1    | 2011/04/24 22:24:18 | at java.lang.Thread.run(Unknown Source)

I run ActiveMQ as service.

Configuration of memory usage:

        <systemUsage>
            <systemUsage>
                <memoryUsage>
                    <memoryUsage limit="500 mb"/>
                </memoryUsage>
                <storeUsage>
                    <storeUsage limit="5 gb"/>
                </storeUsage>
                <tempUsage>
                    <tempUsage limit="1 gb"/>
                </tempUsage>
            </systemUsage>
        </systemUsage>

'memoryLimit' parameter for consumers and producers doesn't affect anything.

Maximum Java Heap size of Tanuki wrapper - wrapper.java.maxmemory=1024.



 

> Wire format negotiation timeout: peer did not send his wire format
> ------------------------------------------------------------------
>
>                 Key: AMQ-3290
>                 URL: https://issues.apache.org/jira/browse/AMQ-3290
>             Project: ActiveMQ
>          Issue Type: Bug
>          Components: Broker
>    Affects Versions: 5.3.2
>         Environment: MS Windows 7 Home Premium x64 Intel Core i5 M 460 RAM 6GB
>            Reporter: Maxim Novikov
>            Priority: Critical
>              Labels: connection, did, failed, format, negotiation, not, peer, send, timeout, wire
>         Attachments: hs_err_pid24632.log
>
>   Original Estimate: 24h
>  Remaining Estimate: 24h
>
> I have two client application written on Java. Each of them has consumers to ActiveMQ (maven dependancy 'activemq-core' version 5.3.2).
> Also there are three applications written on C# (two windows services and one ASP.NET application) which use Apache.NMS 1.5 to connect to ActiveMQ server.
> During some time everything's fine (e.g. today this period has been about 4 hours). But since some moment .NET started throw the following exception:
> Wire format negotiation timeout: peer did not send his wire format.
> Apache.NMS.ActiveMQ.IOException: Wire format negotiation timeout: peer did not send his wire format.
>    at Apache.NMS.ActiveMQ.Connection.SyncRequest(Command command) in c:\dev\NMS.ActiveMQ\src\main\csharp\Connection.cs:line 628
>    at Apache.NMS.ActiveMQ.Connection.CheckConnected() in c:\dev\NMS.ActiveMQ\src\main\csharp\Connection.cs:line 712
>    at Apache.NMS.ActiveMQ.Connection.CreateAtiveMQSession(AcknowledgementMode ackMode) in c:\dev\NMS.ActiveMQ\src\main\csharp\Connection.cs:line 467
>    at Apache.NMS.ActiveMQ.Connection.CreateSession() in c:\dev\NMS.ActiveMQ\src\main\csharp\Connection.cs:line 454
> Actually Java consumers also don't work though there are no errors in their part. But I can see via ActiveMQ web console that no one Query has consumers (for each Query column 'Number Of Consumers' value equals 0).
> So actually nothing works (not Java, not C#) since some moment. I can see the error in .NET but can't see in Java.
> Also this problem appears after restarting operation system. Not always but it happens occasionally.
> PS For Java application I use org.apache.activemq.ActiveMQConnectionFactory and Mule ESB jms:activemq-connector. And this part doesn't show error when it happens.
> For C# applications I use Apache.NMS.ActiveMQ.ConnectionFactory and every time when I think we can face to problem I'm trying to get new connection with the following code lines:
> if ((connection == null) || !connection.IsStarted)
> {
> connection = factory.CreateConnection();
> ISession session = connection.CreateSession();
> IDestination dest = session.GetDestination(Queue);
> producer = session.CreateProducer(dest);
> }
> but unfortunately it doesn't help.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

[jira] [Issue Comment Edited] (AMQ-3290) Wire format negotiation timeout: peer did not send his wire format

JIRA jira@apache.org
In reply to this post by JIRA jira@apache.org

    [ https://issues.apache.org/jira/browse/AMQ-3290?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13024659#comment-13024659 ]

Maxim Novikov edited comment on AMQ-3290 at 4/24/11 8:04 PM:
-------------------------------------------------------------

JVM crash log.

ActiveMQ creates more than 2000 (!!!) threads!..
It happens when producer (one (?) producer) sends about 60 messages per seconds. And it took about 5 seconds to kill ActiveMQ.
It would appear that on each new incoming message ActiveMQ creates new thread and they continue to live forever.
Looks like great leaks take place (?)...


      was (Author: csbubbles):
    JVM crash log.

ActiveMQ creates more than 2000 (!!!) threads!..
It happens when producer (only one producer) sends about 60 messages per seconds.
It would appear that on each new incoming message ActiveMQ creates new thread and they continue to live forever.
Looks like great leaks take place...

 

> Wire format negotiation timeout: peer did not send his wire format
> ------------------------------------------------------------------
>
>                 Key: AMQ-3290
>                 URL: https://issues.apache.org/jira/browse/AMQ-3290
>             Project: ActiveMQ
>          Issue Type: Bug
>          Components: Broker
>    Affects Versions: 5.3.2
>         Environment: MS Windows 7 Home Premium x64 Intel Core i5 M 460 RAM 6GB
>            Reporter: Maxim Novikov
>            Priority: Critical
>              Labels: connection, did, failed, format, negotiation, not, peer, send, timeout, wire
>         Attachments: hs_err_pid24632.log
>
>   Original Estimate: 24h
>  Remaining Estimate: 24h
>
> I have two client application written on Java. Each of them has consumers to ActiveMQ (maven dependancy 'activemq-core' version 5.3.2).
> Also there are three applications written on C# (two windows services and one ASP.NET application) which use Apache.NMS 1.5 to connect to ActiveMQ server.
> During some time everything's fine (e.g. today this period has been about 4 hours). But since some moment .NET started throw the following exception:
> Wire format negotiation timeout: peer did not send his wire format.
> Apache.NMS.ActiveMQ.IOException: Wire format negotiation timeout: peer did not send his wire format.
>    at Apache.NMS.ActiveMQ.Connection.SyncRequest(Command command) in c:\dev\NMS.ActiveMQ\src\main\csharp\Connection.cs:line 628
>    at Apache.NMS.ActiveMQ.Connection.CheckConnected() in c:\dev\NMS.ActiveMQ\src\main\csharp\Connection.cs:line 712
>    at Apache.NMS.ActiveMQ.Connection.CreateAtiveMQSession(AcknowledgementMode ackMode) in c:\dev\NMS.ActiveMQ\src\main\csharp\Connection.cs:line 467
>    at Apache.NMS.ActiveMQ.Connection.CreateSession() in c:\dev\NMS.ActiveMQ\src\main\csharp\Connection.cs:line 454
> Actually Java consumers also don't work though there are no errors in their part. But I can see via ActiveMQ web console that no one Query has consumers (for each Query column 'Number Of Consumers' value equals 0).
> So actually nothing works (not Java, not C#) since some moment. I can see the error in .NET but can't see in Java.
> Also this problem appears after restarting operation system. Not always but it happens occasionally.
> PS For Java application I use org.apache.activemq.ActiveMQConnectionFactory and Mule ESB jms:activemq-connector. And this part doesn't show error when it happens.
> For C# applications I use Apache.NMS.ActiveMQ.ConnectionFactory and every time when I think we can face to problem I'm trying to get new connection with the following code lines:
> if ((connection == null) || !connection.IsStarted)
> {
> connection = factory.CreateConnection();
> ISession session = connection.CreateSession();
> IDestination dest = session.GetDestination(Queue);
> producer = session.CreateProducer(dest);
> }
> but unfortunately it doesn't help.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

[jira] [Commented] (AMQ-3290) Wire format negotiation timeout: peer did not send his wire format

JIRA jira@apache.org
In reply to this post by JIRA jira@apache.org

    [ https://issues.apache.org/jira/browse/AMQ-3290?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13057397#comment-13057397 ]

Timothy Bish commented on AMQ-3290:
-----------------------------------

You should attempt to create a test case to demonstrate the issue.  Problems like this usually appear when the number of connections to the broker exceeds the number of open file descriptors that the OS allows.  It would be helpful to see what your code is doing.

> Wire format negotiation timeout: peer did not send his wire format
> ------------------------------------------------------------------
>
>                 Key: AMQ-3290
>                 URL: https://issues.apache.org/jira/browse/AMQ-3290
>             Project: ActiveMQ
>          Issue Type: Bug
>          Components: Broker
>    Affects Versions: 5.3.2
>         Environment: MS Windows 7 Home Premium x64 Intel Core i5 M 460 RAM 6GB
>            Reporter: Maxim Novikov
>            Priority: Critical
>              Labels: connection, did, failed, format, negotiation, not, peer, send, timeout, wire
>         Attachments: hs_err_pid24632.log
>
>   Original Estimate: 24h
>  Remaining Estimate: 24h
>
> I have two client application written on Java. Each of them has consumers to ActiveMQ (maven dependancy 'activemq-core' version 5.3.2).
> Also there are three applications written on C# (two windows services and one ASP.NET application) which use Apache.NMS 1.5 to connect to ActiveMQ server.
> During some time everything's fine (e.g. today this period has been about 4 hours). But since some moment .NET started throw the following exception:
> Wire format negotiation timeout: peer did not send his wire format.
> Apache.NMS.ActiveMQ.IOException: Wire format negotiation timeout: peer did not send his wire format.
>    at Apache.NMS.ActiveMQ.Connection.SyncRequest(Command command) in c:\dev\NMS.ActiveMQ\src\main\csharp\Connection.cs:line 628
>    at Apache.NMS.ActiveMQ.Connection.CheckConnected() in c:\dev\NMS.ActiveMQ\src\main\csharp\Connection.cs:line 712
>    at Apache.NMS.ActiveMQ.Connection.CreateAtiveMQSession(AcknowledgementMode ackMode) in c:\dev\NMS.ActiveMQ\src\main\csharp\Connection.cs:line 467
>    at Apache.NMS.ActiveMQ.Connection.CreateSession() in c:\dev\NMS.ActiveMQ\src\main\csharp\Connection.cs:line 454
> Actually Java consumers also don't work though there are no errors in their part. But I can see via ActiveMQ web console that no one Query has consumers (for each Query column 'Number Of Consumers' value equals 0).
> So actually nothing works (not Java, not C#) since some moment. I can see the error in .NET but can't see in Java.
> Also this problem appears after restarting operation system. Not always but it happens occasionally.
> PS For Java application I use org.apache.activemq.ActiveMQConnectionFactory and Mule ESB jms:activemq-connector. And this part doesn't show error when it happens.
> For C# applications I use Apache.NMS.ActiveMQ.ConnectionFactory and every time when I think we can face to problem I'm trying to get new connection with the following code lines:
> if ((connection == null) || !connection.IsStarted)
> {
> connection = factory.CreateConnection();
> ISession session = connection.CreateSession();
> IDestination dest = session.GetDestination(Queue);
> producer = session.CreateProducer(dest);
> }
> but unfortunately it doesn't help.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

       
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

[jira] [Closed] (AMQ-3290) Wire format negotiation timeout: peer did not send his wire format

JIRA jira@apache.org
In reply to this post by JIRA jira@apache.org

     [ https://issues.apache.org/jira/browse/AMQ-3290?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Timothy Bish closed AMQ-3290.
-----------------------------

    Resolution: Cannot Reproduce

From the logs it appears that the client is opening a connection for each send and eventually the broker exhausts all available heap space and cannot allocate more resources which is what would be expected in this scenario.

> Wire format negotiation timeout: peer did not send his wire format
> ------------------------------------------------------------------
>
>                 Key: AMQ-3290
>                 URL: https://issues.apache.org/jira/browse/AMQ-3290
>             Project: ActiveMQ
>          Issue Type: Bug
>          Components: Broker
>    Affects Versions: 5.3.2
>         Environment: MS Windows 7 Home Premium x64 Intel Core i5 M 460 RAM 6GB
>            Reporter: Maxim Novikov
>            Priority: Critical
>              Labels: connection, did, failed, format, negotiation, not, peer, send, timeout, wire
>         Attachments: hs_err_pid24632.log
>
>   Original Estimate: 24h
>  Remaining Estimate: 24h
>
> I have two client application written on Java. Each of them has consumers to ActiveMQ (maven dependancy 'activemq-core' version 5.3.2).
> Also there are three applications written on C# (two windows services and one ASP.NET application) which use Apache.NMS 1.5 to connect to ActiveMQ server.
> During some time everything's fine (e.g. today this period has been about 4 hours). But since some moment .NET started throw the following exception:
> Wire format negotiation timeout: peer did not send his wire format.
> Apache.NMS.ActiveMQ.IOException: Wire format negotiation timeout: peer did not send his wire format.
>    at Apache.NMS.ActiveMQ.Connection.SyncRequest(Command command) in c:\dev\NMS.ActiveMQ\src\main\csharp\Connection.cs:line 628
>    at Apache.NMS.ActiveMQ.Connection.CheckConnected() in c:\dev\NMS.ActiveMQ\src\main\csharp\Connection.cs:line 712
>    at Apache.NMS.ActiveMQ.Connection.CreateAtiveMQSession(AcknowledgementMode ackMode) in c:\dev\NMS.ActiveMQ\src\main\csharp\Connection.cs:line 467
>    at Apache.NMS.ActiveMQ.Connection.CreateSession() in c:\dev\NMS.ActiveMQ\src\main\csharp\Connection.cs:line 454
> Actually Java consumers also don't work though there are no errors in their part. But I can see via ActiveMQ web console that no one Query has consumers (for each Query column 'Number Of Consumers' value equals 0).
> So actually nothing works (not Java, not C#) since some moment. I can see the error in .NET but can't see in Java.
> Also this problem appears after restarting operation system. Not always but it happens occasionally.
> PS For Java application I use org.apache.activemq.ActiveMQConnectionFactory and Mule ESB jms:activemq-connector. And this part doesn't show error when it happens.
> For C# applications I use Apache.NMS.ActiveMQ.ConnectionFactory and every time when I think we can face to problem I'm trying to get new connection with the following code lines:
> if ((connection == null) || !connection.IsStarted)
> {
> connection = factory.CreateConnection();
> ISession session = connection.CreateSession();
> IDestination dest = session.GetDestination(Queue);
> producer = session.CreateProducer(dest);
> }
> but unfortunately it doesn't help.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

       
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

[jira] [Commented] (AMQ-3290) Wire format negotiation timeout: peer did not send his wire format

JIRA jira@apache.org
In reply to this post by JIRA jira@apache.org

    [ https://issues.apache.org/jira/browse/AMQ-3290?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13122244#comment-13122244 ]

Ryan Smith commented on AMQ-3290:
---------------------------------

"java.lang.OutOfMemoryError: unable to create new native thread" does not occur from a lack of heap. It occurs from not enough memory left when you take all of the server's RAM and subtract the heap. The system is probably 32-bit as well. I have never seen the error on 64-bit. The error indicates you have too many threads and no more can be created. This error will kill the thread that pulls new sockets off the queue and will prevent any new connections from working. You will eventually get a true heap memory error if client continue to connect as the unbounded socket queue will pile up. Either the process needs to be restarted or you may be able to restart the broker using a TransportAcceptListener that is notified by onAcceptError.
               

> Wire format negotiation timeout: peer did not send his wire format
> ------------------------------------------------------------------
>
>                 Key: AMQ-3290
>                 URL: https://issues.apache.org/jira/browse/AMQ-3290
>             Project: ActiveMQ
>          Issue Type: Bug
>          Components: Broker
>    Affects Versions: 5.3.2
>         Environment: MS Windows 7 Home Premium x64 Intel Core i5 M 460 RAM 6GB
>            Reporter: Maxim Novikov
>            Priority: Critical
>              Labels: connection, did, failed, format, negotiation, not, peer, send, timeout, wire
>         Attachments: hs_err_pid24632.log
>
>   Original Estimate: 24h
>  Remaining Estimate: 24h
>
> I have two client application written on Java. Each of them has consumers to ActiveMQ (maven dependancy 'activemq-core' version 5.3.2).
> Also there are three applications written on C# (two windows services and one ASP.NET application) which use Apache.NMS 1.5 to connect to ActiveMQ server.
> During some time everything's fine (e.g. today this period has been about 4 hours). But since some moment .NET started throw the following exception:
> Wire format negotiation timeout: peer did not send his wire format.
> Apache.NMS.ActiveMQ.IOException: Wire format negotiation timeout: peer did not send his wire format.
>    at Apache.NMS.ActiveMQ.Connection.SyncRequest(Command command) in c:\dev\NMS.ActiveMQ\src\main\csharp\Connection.cs:line 628
>    at Apache.NMS.ActiveMQ.Connection.CheckConnected() in c:\dev\NMS.ActiveMQ\src\main\csharp\Connection.cs:line 712
>    at Apache.NMS.ActiveMQ.Connection.CreateAtiveMQSession(AcknowledgementMode ackMode) in c:\dev\NMS.ActiveMQ\src\main\csharp\Connection.cs:line 467
>    at Apache.NMS.ActiveMQ.Connection.CreateSession() in c:\dev\NMS.ActiveMQ\src\main\csharp\Connection.cs:line 454
> Actually Java consumers also don't work though there are no errors in their part. But I can see via ActiveMQ web console that no one Query has consumers (for each Query column 'Number Of Consumers' value equals 0).
> So actually nothing works (not Java, not C#) since some moment. I can see the error in .NET but can't see in Java.
> Also this problem appears after restarting operation system. Not always but it happens occasionally.
> PS For Java application I use org.apache.activemq.ActiveMQConnectionFactory and Mule ESB jms:activemq-connector. And this part doesn't show error when it happens.
> For C# applications I use Apache.NMS.ActiveMQ.ConnectionFactory and every time when I think we can face to problem I'm trying to get new connection with the following code lines:
> if ((connection == null) || !connection.IsStarted)
> {
> connection = factory.CreateConnection();
> ISession session = connection.CreateSession();
> IDestination dest = session.GetDestination(Queue);
> producer = session.CreateProducer(dest);
> }
> but unfortunately it doesn't help.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

       
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

[jira] [Commented] (AMQ-3290) Wire format negotiation timeout: peer did not send his wire format

JIRA jira@apache.org
In reply to this post by JIRA jira@apache.org

    [ https://issues.apache.org/jira/browse/AMQ-3290?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13141975#comment-13141975 ]

Michael Hayes commented on AMQ-3290:
------------------------------------

JVM memory, not server RAM.
Heap + Non-Heap + Native is less than 2^^32 with e.g. hotspot 32-bit jvm.
-Xss controls the Stack Space (this is Native space) per new thread.
               

> Wire format negotiation timeout: peer did not send his wire format
> ------------------------------------------------------------------
>
>                 Key: AMQ-3290
>                 URL: https://issues.apache.org/jira/browse/AMQ-3290
>             Project: ActiveMQ
>          Issue Type: Bug
>          Components: Broker
>    Affects Versions: 5.3.2
>         Environment: MS Windows 7 Home Premium x64 Intel Core i5 M 460 RAM 6GB
>            Reporter: Maxim Novikov
>            Priority: Critical
>              Labels: connection, did, failed, format, negotiation, not, peer, send, timeout, wire
>         Attachments: hs_err_pid24632.log
>
>   Original Estimate: 24h
>  Remaining Estimate: 24h
>
> I have two client application written on Java. Each of them has consumers to ActiveMQ (maven dependancy 'activemq-core' version 5.3.2).
> Also there are three applications written on C# (two windows services and one ASP.NET application) which use Apache.NMS 1.5 to connect to ActiveMQ server.
> During some time everything's fine (e.g. today this period has been about 4 hours). But since some moment .NET started throw the following exception:
> Wire format negotiation timeout: peer did not send his wire format.
> Apache.NMS.ActiveMQ.IOException: Wire format negotiation timeout: peer did not send his wire format.
>    at Apache.NMS.ActiveMQ.Connection.SyncRequest(Command command) in c:\dev\NMS.ActiveMQ\src\main\csharp\Connection.cs:line 628
>    at Apache.NMS.ActiveMQ.Connection.CheckConnected() in c:\dev\NMS.ActiveMQ\src\main\csharp\Connection.cs:line 712
>    at Apache.NMS.ActiveMQ.Connection.CreateAtiveMQSession(AcknowledgementMode ackMode) in c:\dev\NMS.ActiveMQ\src\main\csharp\Connection.cs:line 467
>    at Apache.NMS.ActiveMQ.Connection.CreateSession() in c:\dev\NMS.ActiveMQ\src\main\csharp\Connection.cs:line 454
> Actually Java consumers also don't work though there are no errors in their part. But I can see via ActiveMQ web console that no one Query has consumers (for each Query column 'Number Of Consumers' value equals 0).
> So actually nothing works (not Java, not C#) since some moment. I can see the error in .NET but can't see in Java.
> Also this problem appears after restarting operation system. Not always but it happens occasionally.
> PS For Java application I use org.apache.activemq.ActiveMQConnectionFactory and Mule ESB jms:activemq-connector. And this part doesn't show error when it happens.
> For C# applications I use Apache.NMS.ActiveMQ.ConnectionFactory and every time when I think we can face to problem I'm trying to get new connection with the following code lines:
> if ((connection == null) || !connection.IsStarted)
> {
> connection = factory.CreateConnection();
> ISession session = connection.CreateSession();
> IDestination dest = session.GetDestination(Queue);
> producer = session.CreateProducer(dest);
> }
> but unfortunately it doesn't help.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

       
Loading...