Artemis cannot find LIBAIO, although it is installed

Previous Topic Next Topic
 
classic Classic list List threaded Threaded
18 messages Options
Reply | Threaded
Open this post in threaded view
|

Artemis cannot find LIBAIO, although it is installed

ipolevoy
My environment:

Linux version 3.13.0-74-generic (buildd@lcy01-07) (gcc version 4.8.2 (Ubuntu 4.8.2-19ubuntu1) ) #118-Ubuntu SMP Thu Dec 17 22:52:10 UTC 2015

No LSB modules are available.
Distributor ID: Ubuntu
Description: Ubuntu 14.04.3 LTS
Release: 14.04
Codename: trusty

I have the libaio1 package installed:

    $ sudo apt-get install libaio1
    Reading package lists... Done
    Building dependency tree      
    Reading state information... Done
    libaio1 is already the newest version.
    The following packages were automatically installed and are no longer required:
      account-plugin-windows-live kde-config-pimactivity libbabl-0.0-0 libgcr-3-1
      libgegl-0.0-0 libkactivities-models1 libmng1 libmpdec2 libnepomukcleaner4
      libpimactivity4 libupstart1 linux-image-3.13.0-61-generic
      linux-image-extra-3.13.0-61-generic nepomuk-core-runtime python-pexpect
      shared-desktop-ontologies xviewg
    Use 'apt-get autoremove' to remove them.
    0 upgraded, 0 newly installed, 0 to remove and 82 not upgraded.


I configured to use ASYNCIO, eEmbedded server configured:

    config.setJournalType(JournalType.ASYNCIO );

When I start the process, I see this in the log:

    2016-02-02 15:02:54,360 INFO [main]: server - AMQ221045: libaio is not available, switching the configuration into NIO
    2016-02-02 15:02:54,386 INFO [main]: server - AMQ221013: Using NIO Journal

Any help is appreciated.

tx
Reply | Threaded
Open this post in threaded view
|

Re: Artemis cannot find LIBAIO, although it is installed

Justin Bertram-2
Are you setting the library path as discussed on the documentation [1]?


Justin

[1] http://activemq.apache.org/artemis/docs/1.2.0/libaio.html

----- Original Message -----
From: "ipolevoy" <[hidden email]>
To: [hidden email]
Sent: Tuesday, February 2, 2016 2:44:29 PM
Subject: Artemis cannot find LIBAIO, although it is installed

My environment:

Linux version 3.13.0-74-generic (buildd@lcy01-07) (gcc version 4.8.2 (Ubuntu
4.8.2-19ubuntu1) ) #118-Ubuntu SMP Thu Dec 17 22:52:10 UTC 2015

No LSB modules are available.
Distributor ID: Ubuntu
Description: Ubuntu 14.04.3 LTS
Release: 14.04
Codename: trusty

I have the libaio1 package installed:

    $ sudo apt-get install libaio1
    Reading package lists... Done
    Building dependency tree      
    Reading state information... Done
    libaio1 is already the newest version.
    The following packages were automatically installed and are no longer
required:
      account-plugin-windows-live kde-config-pimactivity libbabl-0.0-0
libgcr-3-1
      libgegl-0.0-0 libkactivities-models1 libmng1 libmpdec2
libnepomukcleaner4
      libpimactivity4 libupstart1 linux-image-3.13.0-61-generic
      linux-image-extra-3.13.0-61-generic nepomuk-core-runtime
python-pexpect
      shared-desktop-ontologies xviewg
    Use 'apt-get autoremove' to remove them.
    0 upgraded, 0 newly installed, 0 to remove and 82 not upgraded.


I configured to use ASYNCIO, eEmbedded server configured:

    config.setJournalType(JournalType.ASYNCIO );

When I start the process, I see this in the log:

    2016-02-02 15:02:54,360 INFO [main]: server - AMQ221045: libaio is not
available, switching the configuration into NIO
    2016-02-02 15:02:54,386 INFO [main]: server - AMQ221013: Using NIO
Journal

Any help is appreciated.

tx




--
View this message in context: http://activemq.2283324.n4.nabble.com/Artemis-cannot-find-LIBAIO-although-it-is-installed-tp4706815.html
Sent from the ActiveMQ - User mailing list archive at Nabble.com.
Reply | Threaded
Open this post in threaded view
|

Re: Artemis cannot find LIBAIO, although it is installed

clebertsuconic
As u are using embedded.  The .so must be on your library path.

Look at the Artemis script for how we do it.

> On Feb 2, 2016, at 4:23 PM, Justin Bertram <[hidden email]> wrote:
>
> Are you setting the library path as discussed on the documentation [1]?
>
>
> Justin
>
> [1] http://activemq.apache.org/artemis/docs/1.2.0/libaio.html
>
> ----- Original Message -----
> From: "ipolevoy" <[hidden email]>
> To: [hidden email]
> Sent: Tuesday, February 2, 2016 2:44:29 PM
> Subject: Artemis cannot find LIBAIO, although it is installed
>
> My environment:
>
> Linux version 3.13.0-74-generic (buildd@lcy01-07) (gcc version 4.8.2 (Ubuntu
> 4.8.2-19ubuntu1) ) #118-Ubuntu SMP Thu Dec 17 22:52:10 UTC 2015
>
> No LSB modules are available.
> Distributor ID:    Ubuntu
> Description:    Ubuntu 14.04.3 LTS
> Release:    14.04
> Codename:    trusty
>
> I have the libaio1 package installed:
>
>    $ sudo apt-get install libaio1
>    Reading package lists... Done
>    Building dependency tree      
>    Reading state information... Done
>    libaio1 is already the newest version.
>    The following packages were automatically installed and are no longer
> required:
>      account-plugin-windows-live kde-config-pimactivity libbabl-0.0-0
> libgcr-3-1
>      libgegl-0.0-0 libkactivities-models1 libmng1 libmpdec2
> libnepomukcleaner4
>      libpimactivity4 libupstart1 linux-image-3.13.0-61-generic
>      linux-image-extra-3.13.0-61-generic nepomuk-core-runtime
> python-pexpect
>      shared-desktop-ontologies xviewg
>    Use 'apt-get autoremove' to remove them.
>    0 upgraded, 0 newly installed, 0 to remove and 82 not upgraded.
>
>
> I configured to use ASYNCIO, eEmbedded server configured:
>
>    config.setJournalType(JournalType.ASYNCIO );
>
> When I start the process, I see this in the log:
>
>    2016-02-02 15:02:54,360 INFO [main]: server - AMQ221045: libaio is not
> available, switching the configuration into NIO
>    2016-02-02 15:02:54,386 INFO [main]: server - AMQ221013: Using NIO
> Journal
>
> Any help is appreciated.
>
> tx
>
>
>
>
> --
> View this message in context: http://activemq.2283324.n4.nabble.com/Artemis-cannot-find-LIBAIO-although-it-is-installed-tp4706815.html
> Sent from the ActiveMQ - User mailing list archive at Nabble.com.
Reply | Threaded
Open this post in threaded view
|

Re: Artemis cannot find LIBAIO, although it is installed

ipolevoy
Justin, and Clebert, thanks for suggestion, I found references to the lib in the script!

Will do.
Reply | Threaded
Open this post in threaded view
|

Re: Artemis cannot find LIBAIO, although it is installed

ipolevoy
Hey,  guys.

We were unable to configure libaio and are still using NIO. I did everything
as recommended, but still no luck.

My env: Linux Ubuntu 16

Libaio  is installed.

dpkg --search libaio
libaio1:amd64: /usr/share/doc/libaio1
libaio1:amd64: /usr/share/doc/libaio1/TODO
libaio1:amd64: /lib/x86_64-linux-gnu/libaio.so.1
libaio1:amd64: /usr/share/doc/libaio1/copyright
libaio1:amd64: /usr/share/doc/libaio1/changelog.Debian.gz
libaio1:amd64: /lib/x86_64-linux-gnu/libaio.so.1.0.1
libaio1:amd64: /usr/share/lintian/overrides/libaio1

The page here:
https://activemq.apache.org/artemis/docs/1.3.0/libaio.html#runtime-dependencies
mentions two libs:
* libActiveMQAIO32.so - x86 32 bits
* libActiveMQAIO64.so - x86 64 bits

However,  when I downloaded apache-artemis-2.3.0.zip, there were no such
files in it. Instead, I found this:

apache-artemis-2.3.0/bin/lib/linux-x86_64 ll
total 32
-rw-r--r-- 1 igor igor 28687 Nov  1 05:42 libartemis-native-64.so


I assumed that documentation is lagging behind, and the file called
libActiveMQAIO64.so is now called libartemis-native-64.so. I used this file
and pointed the system property -Djava.library.path=artemis-lib directory,
where I copied the file libartemis-native-64.so

Nonetheless, when I run the broker, I get this:

{"level":"INFO","timestamp":"Thu Nov 09 16:43:05 CST
2017","thread":"main","logger":"org.apache.activemq.artemis.core.server","message":"AMQ221045:
libaio is not available, switching the configuration into NIO"}
{"level":"INFO","timestamp":"Thu Nov 09 16:43:05 CST
2017","thread":"main","logger":"org.apache.activemq.artemis.core.server","message":"AMQ221013:
Using NIO Journal"}

I'd appreciate any help, but the main question is: where do I get the file:
libActiveMQAIO64.so ?

Thanks



--
Sent from: http://activemq.2283324.n4.nabble.com/ActiveMQ-User-f2341805.html
Reply | Threaded
Open this post in threaded view
|

Re: Artemis cannot find LIBAIO, although it is installed

gaohoward
I'm using ubuntu 16.04 and I have no problem like that (although I build
artemis from master).
I can only guess that your java.library.path didn't get passed to JVM
correctly.

On Fri, Nov 10, 2017 at 7:01 AM, ipolevoy <[hidden email]> wrote:

> Hey,  guys.
>
> We were unable to configure libaio and are still using NIO. I did
> everything
> as recommended, but still no luck.
>
> My env: Linux Ubuntu 16
>
> Libaio  is installed.
>
> dpkg --search libaio
> libaio1:amd64: /usr/share/doc/libaio1
> libaio1:amd64: /usr/share/doc/libaio1/TODO
> libaio1:amd64: /lib/x86_64-linux-gnu/libaio.so.1
> libaio1:amd64: /usr/share/doc/libaio1/copyright
> libaio1:amd64: /usr/share/doc/libaio1/changelog.Debian.gz
> libaio1:amd64: /lib/x86_64-linux-gnu/libaio.so.1.0.1
> libaio1:amd64: /usr/share/lintian/overrides/libaio1
>
> The page here:
> https://activemq.apache.org/artemis/docs/1.3.0/libaio.
> html#runtime-dependencies
> mentions two libs:
> * libActiveMQAIO32.so - x86 32 bits
> * libActiveMQAIO64.so - x86 64 bits
>
> However,  when I downloaded apache-artemis-2.3.0.zip, there were no such
> files in it. Instead, I found this:
>
> apache-artemis-2.3.0/bin/lib/linux-x86_64 ll
> total 32
> -rw-r--r-- 1 igor igor 28687 Nov  1 05:42 libartemis-native-64.so
>
>
> I assumed that documentation is lagging behind, and the file called
> libActiveMQAIO64.so is now called libartemis-native-64.so. I used this file
> and pointed the system property -Djava.library.path=artemis-lib directory,
> where I copied the file libartemis-native-64.so
>
> Nonetheless, when I run the broker, I get this:
>
> {"level":"INFO","timestamp":"Thu Nov 09 16:43:05 CST
> 2017","thread":"main","logger":"org.apache.activemq.artemis.
> core.server","message":"AMQ221045:
> libaio is not available, switching the configuration into NIO"}
> {"level":"INFO","timestamp":"Thu Nov 09 16:43:05 CST
> 2017","thread":"main","logger":"org.apache.activemq.artemis.
> core.server","message":"AMQ221013:
> Using NIO Journal"}
>
> I'd appreciate any help, but the main question is: where do I get the file:
> libActiveMQAIO64.so ?
>
> Thanks
>
>
>
> --
> Sent from: http://activemq.2283324.n4.nabble.com/ActiveMQ-User-
> f2341805.html
>
Reply | Threaded
Open this post in threaded view
|

Re: Artemis cannot find LIBAIO, although it is installed

clebertsuconic
If you are using an older kernel you may need to recompile it for Libc
compar. Just use cmake. Quite easy.

If you have problems let me know.

On Fri, Nov 10, 2017 at 2:16 AM Howard Gao <[hidden email]> wrote:

> I'm using ubuntu 16.04 and I have no problem like that (although I build
> artemis from master).
> I can only guess that your java.library.path didn't get passed to JVM
> correctly.
>
> On Fri, Nov 10, 2017 at 7:01 AM, ipolevoy <[hidden email]> wrote:
>
> > Hey,  guys.
> >
> > We were unable to configure libaio and are still using NIO. I did
> > everything
> > as recommended, but still no luck.
> >
> > My env: Linux Ubuntu 16
> >
> > Libaio  is installed.
> >
> > dpkg --search libaio
> > libaio1:amd64: /usr/share/doc/libaio1
> > libaio1:amd64: /usr/share/doc/libaio1/TODO
> > libaio1:amd64: /lib/x86_64-linux-gnu/libaio.so.1
> > libaio1:amd64: /usr/share/doc/libaio1/copyright
> > libaio1:amd64: /usr/share/doc/libaio1/changelog.Debian.gz
> > libaio1:amd64: /lib/x86_64-linux-gnu/libaio.so.1.0.1
> > libaio1:amd64: /usr/share/lintian/overrides/libaio1
> >
> > The page here:
> > https://activemq.apache.org/artemis/docs/1.3.0/libaio.
> > html#runtime-dependencies
> > mentions two libs:
> > * libActiveMQAIO32.so - x86 32 bits
> > * libActiveMQAIO64.so - x86 64 bits
> >
> > However,  when I downloaded apache-artemis-2.3.0.zip, there were no such
> > files in it. Instead, I found this:
> >
> > apache-artemis-2.3.0/bin/lib/linux-x86_64 ll
> > total 32
> > -rw-r--r-- 1 igor igor 28687 Nov  1 05:42 libartemis-native-64.so
> >
> >
> > I assumed that documentation is lagging behind, and the file called
> > libActiveMQAIO64.so is now called libartemis-native-64.so. I used this
> file
> > and pointed the system property -Djava.library.path=artemis-lib
> directory,
> > where I copied the file libartemis-native-64.so
> >
> > Nonetheless, when I run the broker, I get this:
> >
> > {"level":"INFO","timestamp":"Thu Nov 09 16:43:05 CST
> > 2017","thread":"main","logger":"org.apache.activemq.artemis.
> > core.server","message":"AMQ221045:
> > libaio is not available, switching the configuration into NIO"}
> > {"level":"INFO","timestamp":"Thu Nov 09 16:43:05 CST
> > 2017","thread":"main","logger":"org.apache.activemq.artemis.
> > core.server","message":"AMQ221013:
> > Using NIO Journal"}
> >
> > I'd appreciate any help, but the main question is: where do I get the
> file:
> > libActiveMQAIO64.so ?
> >
> > Thanks
> >
> >
> >
> > --
> > Sent from: http://activemq.2283324.n4.nabble.com/ActiveMQ-User-
> > f2341805.html
> >
>
--
Clebert Suconic
Reply | Threaded
Open this post in threaded view
|

Re: Artemis cannot find LIBAIO, although it is installed

ipolevoy
Here is more info: Script  I use:
#!/usr/bin/env bashexport CP=worker-classes/for file in  `ls lib`;do
CP=$CP:lib/$file; donefor file in  `ls worker-libs`;do
CP=$CP:worker-libs/$file; doneecho $CPgroovy
-Djava.library.path=./artemis-lib -cp $CP $1 $2 $3 $4 $5
The content of my directory:
ll artemis-lib/total 40drwxrwxr-x 2 igor igor  4096 Nov 13 01:02
./drwxrwxr-x 7 igor igor  4096 Nov 13 00:55 ../-rw-r--r-- 1 igor igor 28687
Nov 13 01:02 libartemis-native-64.so
The version of Linux kernel:
$ uname -aLinux expresspigeontest 4.4.0-98-lowlatency #121~14.04.1-Ubuntu
SMP PREEMPT Wed Oct 11 12:42:21 UTC 2017 x86_64 x86_64 x86_64 GNU/Linux
When I run the program, Artemis puts out this:
{"level":"INFO","timestamp":"Mon Nov 13 01:02:41 CST
2017","thread":"main","logger":"org.apache.activemq.artemis.core.server","message":"AMQ221045:
libaio is not available, switching the configuration into NIO"}
I just cannot get it to work. Please, note that the docs state that the file
name is libActiveMQAIO64.so according to:   libaio.html
<https://activemq.apache.org/artemis/docs/2.3.0/libaio.html>  , but I was
only able to find libartemis-native-64.so. I'm not even sure if this is the
right file



--
Sent from: http://activemq.2283324.n4.nabble.com/ActiveMQ-User-f2341805.html
Reply | Threaded
Open this post in threaded view
|

Re: Artemis cannot find LIBAIO, although it is installed

clebertsuconic
What is this script? Why you don’t use the one from the distribution ?



On Mon, Nov 13, 2017 at 3:03 AM ipolevoy <[hidden email]> wrote:

> Here is more info: Script  I use:
> #!/usr/bin/env bashexport CP=worker-classes/for file in  `ls lib`;do
> CP=$CP:lib/$file; donefor file in  `ls worker-libs`;do
> CP=$CP:worker-libs/$file; doneecho $CPgroovy
> -Djava.library.path=./artemis-lib -cp $CP $1 $2 $3 $4 $5
> The content of my directory:
> ll artemis-lib/total 40drwxrwxr-x 2 igor igor  4096 Nov 13 01:02
> ./drwxrwxr-x 7 igor igor  4096 Nov 13 00:55 ../-rw-r--r-- 1 igor igor 28687
> Nov 13 01:02 libartemis-native-64.so
> The version of Linux kernel:
> $ uname -aLinux expresspigeontest 4.4.0-98-lowlatency #121~14.04.1-Ubuntu
> SMP PREEMPT Wed Oct 11 12:42:21 UTC 2017 x86_64 x86_64 x86_64 GNU/Linux
> When I run the program, Artemis puts out this:
> {"level":"INFO","timestamp":"Mon Nov 13 01:02:41 CST
>
> 2017","thread":"main","logger":"org.apache.activemq.artemis.core.server","message":"AMQ221045:
> libaio is not available, switching the configuration into NIO"}
> I just cannot get it to work. Please, note that the docs state that the
> file
> name is libActiveMQAIO64.so according to:   libaio.html
> <https://activemq.apache.org/artemis/docs/2.3.0/libaio.html>  , but I was
> only able to find libartemis-native-64.so. I'm not even sure if this is the
> right file
>
>
>
> --
> Sent from:
> http://activemq.2283324.n4.nabble.com/ActiveMQ-User-f2341805.html

--
Clebert Suconic
Reply | Threaded
Open this post in threaded view
|

Re: Artemis cannot find LIBAIO, although it is installed

ipolevoy
This script is only used to test libaio integration. I cannot use the script
from the distribution because we use  Artemis embedded into our app.




--
Sent from: http://activemq.2283324.n4.nabble.com/ActiveMQ-User-f2341805.html
Reply | Threaded
Open this post in threaded view
|

Re: Artemis cannot find LIBAIO, although it is installed

ipolevoy
IN addition, I also tried to set  the system property from inside Java using
Syste.setProperty(..), but did that did not work either.

Can you tell me if I'm using the right SO file? The name of this file is
different from your Artemis documentation




--
Sent from: http://activemq.2283324.n4.nabble.com/ActiveMQ-User-f2341805.html
Reply | Threaded
Open this post in threaded view
|

Re: Artemis cannot find LIBAIO, although it is installed

clebertsuconic
Can you tell me if the distribution finds libaio in the same env? then
I can help you out.

On Mon, Nov 13, 2017 at 10:17 AM, ipolevoy <[hidden email]> wrote:

> IN addition, I also tried to set  the system property from inside Java using
> Syste.setProperty(..), but did that did not work either.
>
> Can you tell me if I'm using the right SO file? The name of this file is
> different from your Artemis documentation
>
>
>
>
> --
> Sent from: http://activemq.2283324.n4.nabble.com/ActiveMQ-User-f2341805.html



--
Clebert Suconic
Reply | Threaded
Open this post in threaded view
|

Re: Artemis cannot find LIBAIO, although it is installed

ipolevoy
are you asking to install the distribution and start a broker on our
production env?
Is there any other method?

Thanks,



--
Sent from: http://activemq.2283324.n4.nabble.com/ActiveMQ-User-f2341805.html
Reply | Threaded
Open this post in threaded view
|

Re: Artemis cannot find LIBAIO, although it is installed

clebertsuconic
I'm just trying to figure out if the problem is at your script... or
on the compilation of the library.


on the same box... create a broker.. and run it.. see if libaio loads.

Depending on the result we will decide if it's a path or a recompilation issue.

On Mon, Nov 13, 2017 at 3:53 PM, ipolevoy <[hidden email]> wrote:

> are you asking to install the distribution and start a broker on our
> production env?
> Is there any other method?
>
> Thanks,
>
>
>
> --
> Sent from: http://activemq.2283324.n4.nabble.com/ActiveMQ-User-f2341805.html



--
Clebert Suconic
Reply | Threaded
Open this post in threaded view
|

Re: Artemis cannot find LIBAIO, although it is installed

ipolevoy
Hi, Clebert.

This is exactly what I did. However, my admin has doubts in a way he
compiled and installed the lib.
Let us poke around a bit. Is there a sure way to determine that the system
library is properly installed and functioning without running a broker?

Thanks,




--
Sent from: http://activemq.2283324.n4.nabble.com/ActiveMQ-User-f2341805.html
Reply | Threaded
Open this post in threaded view
|

Re: Artemis cannot find LIBAIO, although it is installed

clebertsuconic
Running the testcases maybe.

Something has to load the library.


I would run the cmake. And copy it from where the .sos are located within
the build.


I am having a vacation day today. But you could maybe ping me tomorrow on
the IRC?


I will look at my email during the day also.

On Tue, Nov 14, 2017 at 12:33 AM ipolevoy <[hidden email]> wrote:

> Hi, Clebert.
>
> This is exactly what I did. However, my admin has doubts in a way he
> compiled and installed the lib.
> Let us poke around a bit. Is there a sure way to determine that the system
> library is properly installed and functioning without running a broker?
>
> Thanks,
>
>
>
>
> --
> Sent from:
> http://activemq.2283324.n4.nabble.com/ActiveMQ-User-f2341805.html
>
--
Clebert Suconic
Reply | Threaded
Open this post in threaded view
|

Re: Artemis cannot find LIBAIO, although it is installed

ipolevoy
Clebert, thank you for your help. Enjoy your vacation, we will be looking
closer, and if cannot resolve I will ping you in a few days.

Thank you,




--
Sent from: http://activemq.2283324.n4.nabble.com/ActiveMQ-User-f2341805.html
Reply | Threaded
Open this post in threaded view
|

Re: Artemis cannot find LIBAIO, although it is installed

clebertsuconic
any progress?

On Tue, Nov 14, 2017 at 11:15 AM, ipolevoy <[hidden email]> wrote:

> Clebert, thank you for your help. Enjoy your vacation, we will be looking
> closer, and if cannot resolve I will ping you in a few days.
>
> Thank you,
>
>
>
>
> --
> Sent from: http://activemq.2283324.n4.nabble.com/ActiveMQ-User-f2341805.html



--
Clebert Suconic