Crc32cIntChecksum - Failed to load Circe JNI library

[colinbes]

I am using the jackson dependency in my sbt file

name := "pulsarc"
version := "0.1"
scalaVersion := "2.13.4"
libraryDependencies += "com.sksamuel.pulsar4s" %% "pulsar4s-jackson" % "2.7.0"
libraryDependencies += "ch.qos.logback" % "logback-classic" % "1.2.3"

and am using intellij idea ide. On running (settings use java 8 to run app) my simple test app I get the following error message which is confusing as I am not using Circe library. Is Circe used somewhere behind the scenes?

[pulsar-client-io-1-1] Crc32cIntChecksum - Failed to load Circe JNI library. Falling back to Java based CRC32c provider 

[sksamuel]

I assume you're not adding pulsar4s-circe to your build?

…

On Mon, 14 Dec 2020 at 12:13, Colin Bester ***@***.***> wrote: I am using the jackson dependency in my sbt file name := "pulsarc" version := "0.1" scalaVersion := "2.13.4" libraryDependencies += "com.sksamuel.pulsar4s" %% "pulsar4s-jackson" % "2.7.0" libraryDependencies += "ch.qos.logback" % "logback-classic" % "1.2.3" and am using intellij idea ide. On running (settings use java 8 to run app) my simple test app I get the following error message which is confusing as I am not using Circe library. Is Circe used somewhere behind the scenes? [pulsar-client-io-1-1] Crc32cIntChecksum - Failed to load Circe JNI library. Falling back to Java based CRC32c provider — You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHub <#256>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/AAFVSGQQDWVN55ZJZMKBE43SUZITJANCNFSM4U3EE7VQ> .

[sksamuel]

I can't see anything in the jackson module that would pull it down.

…

On Mon, 14 Dec 2020 at 12:16, Stephen Samuel (Sam) ***@***.***> wrote: I assume you're not adding pulsar4s-circe to your build? On Mon, 14 Dec 2020 at 12:13, Colin Bester ***@***.***> wrote: > I am using the jackson dependency in my sbt file > > name := "pulsarc" > version := "0.1" > scalaVersion := "2.13.4" > libraryDependencies += "com.sksamuel.pulsar4s" %% "pulsar4s-jackson" % "2.7.0" > libraryDependencies += "ch.qos.logback" % "logback-classic" % "1.2.3" > > and am using intellij idea ide. On running (settings use java 8 to run > app) my simple test app I get the following error message which is > confusing as I am not using Circe library. Is Circe used somewhere behind > the scenes? > > [pulsar-client-io-1-1] Crc32cIntChecksum - Failed to load Circe JNI library. Falling back to Java based CRC32c provider > > — > You are receiving this because you are subscribed to this thread. > Reply to this email directly, view it on GitHub > <#256>, or unsubscribe > <https://github.com/notifications/unsubscribe-auth/AAFVSGQQDWVN55ZJZMKBE43SUZITJANCNFSM4U3EE7VQ> > . >

[sksamuel]

Ok here we are, it's nothing to do with the Scala Circe json library, but this https://github.com/trevorr/circe Which I assume pulsar itself is using.

…

On Mon, 14 Dec 2020 at 12:17, Stephen Samuel (Sam) ***@***.***> wrote: I can't see anything in the jackson module that would pull it down. On Mon, 14 Dec 2020 at 12:16, Stephen Samuel (Sam) ***@***.***> wrote: > I assume you're not adding pulsar4s-circe to your build? > > On Mon, 14 Dec 2020 at 12:13, Colin Bester ***@***.***> > wrote: > >> I am using the jackson dependency in my sbt file >> >> name := "pulsarc" >> version := "0.1" >> scalaVersion := "2.13.4" >> libraryDependencies += "com.sksamuel.pulsar4s" %% "pulsar4s-jackson" % "2.7.0" >> libraryDependencies += "ch.qos.logback" % "logback-classic" % "1.2.3" >> >> and am using intellij idea ide. On running (settings use java 8 to run >> app) my simple test app I get the following error message which is >> confusing as I am not using Circe library. Is Circe used somewhere behind >> the scenes? >> >> [pulsar-client-io-1-1] Crc32cIntChecksum - Failed to load Circe JNI library. Falling back to Java based CRC32c provider >> >> — >> You are receiving this because you are subscribed to this thread. >> Reply to this email directly, view it on GitHub >> <#256>, or unsubscribe >> <https://github.com/notifications/unsubscribe-auth/AAFVSGQQDWVN55ZJZMKBE43SUZITJANCNFSM4U3EE7VQ> >> . >> >

[colinbes]

No, I have not included circe.

Here's my simple code:

import com.sksamuel.pulsar4s.{Consumer, ConsumerConfig, ProducerConfig, PulsarClient, Subscription, Topic}
import com.sksamuel.pulsar4s.jackson._
import scala.util.{Failure, Success}
case class TestMessage(name: String, value: Int)


object MyApp extends App {

  val pulsarHost = System.getProperty("org.bdesigns.pulsar", "pulsar://localhost:6650")
  val client = PulsarClient(pulsarHost)

  def receive(consumer: Consumer[TestMessage], label: String): Unit = {
    val msg = consumer.receive

    msg match {
      case Success(value) =>
        println(s"${consumer.subscription} Success, $label ${value.value}")
        consumer.acknowledge(value)
      case Failure(exception) =>
        println(s"Failed: ${exception.getMessage}")
    }
  }

  val topic = Topic("persistent://sample/standalone/ns2/b1")

  val producer = client.producer[TestMessage](ProducerConfig(topic))
  val consumerFn = client.consumer[TestMessage](ConsumerConfig(subscriptionName=Subscription("mysub"), topics=Seq(topic)))
//  consumerFn.seek(MessageId.earliest)

  producer.send(TestMessage("msg1", 100))
  receive(consumerFn, "1: received1")

  producer.close()
  consumerFn.close()
  client.close()
}

Looking at link you sent now.

[colinbes]

Which I assume pulsar itself is using.

You thinking the pulsar java library?

[sksamuel]

Yep. I'd imagine it's looking for the JNI version and falling back. Hadoop and Avro do similar things for other JNI libraries.

…

On Mon, 14 Dec 2020 at 12:23, Colin Bester ***@***.***> wrote: Which I assume pulsar itself is using. You thinking the pulsar java library? — You are receiving this because you commented. Reply to this email directly, view it on GitHub <#256 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/AAFVSGTSHUDDDJWGRLC5NYLSUZJ3ZANCNFSM4U3EE7VQ> .