Pinned Loading

1. jax-llm jax-llm Public

   JAX implementation of Large Language Models. You can train GPT-2-like model with 青空文庫 (aozora bunko-clean dataset) or any other text dataset.

   Python 11 2

2. fast-near-duplicate-matching fast-near-duplicate-matching Public

   Fast near-duplicate matching is a method for quickly finding near-duplicate spans in a document by utilizing the Rabin-Karp algorithm.

   Rust 1

3. llava-mnist llava-mnist Public

   llava-mnist is a simple example of Vision and Language model using LLaVA architecture trained on MNIST dataset.

   Python

4. llm-jp/text2dataset llm-jp/text2dataset Public

   Easily turn large English text datasets into Japanese text datasets using open LLMs.

   Python 19 1

5. llm-jp/llm-jp-eval-mm llm-jp/llm-jp-eval-mm Public

   This tool automatically evaluates Japanese multi-modal large language models across multiple datasets.

   Python 11

6. llm-jp/clip-eval llm-jp/clip-eval Public

   clip-eval is a tool for evaluating CLIP models on various image classification and image-text retrieval tasks in Japanese.

   Python