Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Sporadic analysis errors with UnweightedTransducer (hfst-ol-java) #8

Open
hfst-importer opened this issue Aug 12, 2015 · 1 comment

Comments

@hfst-importer
Copy link

I'm seeing strange exceptions being thrown, seemingly undeterministically by HFST optimized lookup java code.
I suspect this may be a thread-safety issue with HFST optimized lookup.

For example the following exception gets thrown by HFST when I run our application:

java.lang.ArrayIndexOutOfBoundsException: Array index out of range: 1
java.lang.ArrayIndexOutOfBoundsException: Array index out of range: 1
at java.util.Vector.get(Vector.java:748) ~[na:1.8.0_45]
at net.sf.hfst.UnweightedTransducer.findIndex(Unknown Source) ~[meta-assembly-0.1-SNAPSHOT.jar:0.1-SNAPSHOT]
at net.sf.hfst.UnweightedTransducer.getAnalyses(Unknown Source) ~[meta-assembly-0.1-SNAPSHOT.jar:0.1-SNAPSHOT]
at net.sf.hfst.UnweightedTransducer.tryEpsilonTransitions(Unknown Source) ~[meta-assembly-0.1-SNAPSHOT.jar:0.1-SNAPSHOT]
at net.sf.hfst.UnweightedTransducer.tryEpsilonIndices(Unknown Source) ~[meta-assembly-0.1-SNAPSHOT.jar:0.1-SNAPSHOT]
at net.sf.hfst.UnweightedTransducer.getAnalyses(Unknown Source) ~[meta-assembly-0.1-SNAPSHOT.jar:0.1-SNAPSHOT]
at net.sf.hfst.UnweightedTransducer.findTransitions(Unknown Source) ~[meta-assembly-0.1-SNAPSHOT.jar:0.1-SNAPSHOT]
at net.sf.hfst.UnweightedTransducer.findIndex(Unknown Source) ~[meta-assembly-0.1-SNAPSHOT.jar:0.1-SNAPSHOT]
at net.sf.hfst.UnweightedTransducer.getAnalyses(Unknown Source) ~[meta-assembly-0.1-SNAPSHOT.jar:0.1-SNAPSHOT]
at net.sf.hfst.UnweightedTransducer.analyze(Unknown Source) ~[meta-assembly-0.1-SNAPSHOT.jar:0.1-SNAPSHOT]
...

Reported by: aspa

@hfst-importer
Copy link
Author

please note that a HFST OL Java fork that claims to be thread-safe already exists: https://github.com/jiemakel/seco-hfst

perhaps, license permitting, this code could be merged with the HFST code base.

Original comment by: aspa

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

2 participants