Add use_tokenizer to JsonlDataset #2264
alanakbikAnnotations
2 errors and 1 warning
|
test:
flair/datasets/sequence_labeling.py#L1
Black format check
--- /home/runner/work/flair/flair/flair/datasets/sequence_labeling.py 2024-07-08 05:37:35.305330+00:00
+++ /home/runner/work/flair/flair/flair/datasets/sequence_labeling.py 2024-07-08 05:40:04.783377+00:00
@@ -80,11 +80,11 @@
text_column_name=text_column_name,
label_column_name=label_column_name,
metadata_column_name=metadata_column_name,
label_type=label_type,
encoding=encoding,
- use_tokenizer=use_tokenizer
+ use_tokenizer=use_tokenizer,
)
for train_file in train_files
]
)
if train_files and train_files[0]
@@ -100,11 +100,11 @@
text_column_name=text_column_name,
label_column_name=label_column_name,
metadata_column_name=metadata_column_name,
label_type=label_type,
encoding=encoding,
- use_tokenizer=use_tokenizer
+ use_tokenizer=use_tokenizer,
)
for test_file in test_files
]
)
if test_files and test_files[0]
@@ -120,11 +120,11 @@
text_column_name=text_column_name,
label_column_name=label_column_name,
metadata_column_name=metadata_column_name,
label_type=label_type,
encoding=encoding,
- use_tokenizer=use_tokenizer
+ use_tokenizer=use_tokenizer,
)
for dev_file in dev_files
]
)
if dev_files and dev_files[0]
|
|
test
Process completed with exit code 1.
|
|
test
The following actions uses Node.js version which is deprecated and will be forced to run on node20: actions/checkout@v3, actions/setup-python@v4, actions/cache@v3. For more info: https://github.blog/changelog/2024-03-07-github-actions-all-actions-will-run-on-node20-instead-of-node16-by-default/
|