Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
58 commits
Select commit Hold shift + click to select a range
a9f7d83
Add dash mantine components for job management
taxe10 Sep 10, 2024
b71b8b0
Add dash bootstrap components for job management
taxe10 Sep 10, 2024
bcd0ddb
Adding job manager component according to UI style
taxe10 Sep 10, 2024
a8950fc
Add example scripts
taxe10 Sep 10, 2024
4bdbe01
Place deployment inside test harness
taxe10 Sep 10, 2024
4271ef9
Add package description
taxe10 Sep 10, 2024
460bb93
Added delete flow_run
taxe10 Sep 10, 2024
281f0b0
Make delete test less restrictive
taxe10 Sep 10, 2024
b6a6064
Add cancel flow_run and update get_flow_run_name with is_complete option
taxe10 Sep 11, 2024
6023a4e
Add staticmethod decorator to callback
taxe10 Sep 11, 2024
de02d53
Add dash testing and pin griffe as newest version is not compatible w…
taxe10 Sep 11, 2024
678ce65
Add dash unit tests
taxe10 Sep 11, 2024
fe7d70b
Add left margin drawer covering the modal
taxe10 Sep 11, 2024
b9ca9fc
Added optional modal props
taxe10 Sep 11, 2024
2d2abf4
Rename get_flow_runs_by_name to query
taxe10 Sep 20, 2024
3fb6757
Add generation of ML parameters
taxe10 Sep 20, 2024
8e8346b
Assign unique naming convention per ui style
taxe10 Sep 20, 2024
a162cfd
Refactor MLEx dash components
taxe10 Sep 20, 2024
13779a1
Update unitest for refactor and add ML parameters generation
taxe10 Sep 20, 2024
3bf74e3
Update examples for refactor and add model.json files with gui parame…
taxe10 Sep 20, 2024
802f403
Parse job_manager to layout
taxe10 Sep 20, 2024
bc2de11
Add callback to retrieve lists of jobs
taxe10 Sep 21, 2024
045ae10
Replace dcc.Dropdown for dbc.Select to allow overflow of text
taxe10 Sep 21, 2024
9ed5318
Rename dash_utils to components_<ui_style>
taxe10 Sep 21, 2024
886028e
Remove Columns
taxe10 Oct 16, 2024
ee64e47
Minor refactor mlex_components and add get params values
taxe10 Oct 16, 2024
fd8c595
Add test to retrieve params values
taxe10 Oct 16, 2024
1e68489
Add get params values to examples
taxe10 Oct 16, 2024
53aa5af
Add get logs, and cancel/delete jobs
taxe10 Oct 17, 2024
1da0aee
Add get logs with flow_run_id
taxe10 Oct 17, 2024
d12aef5
Update component name and add warning modals
taxe10 Oct 17, 2024
7fcc4bd
Add display logs, cancel/delete jobs, and disable advanced options wh…
taxe10 Oct 17, 2024
0d8cfbd
Expand toggle tests
taxe10 Oct 17, 2024
17c23dc
Add get flow run logs test
taxe10 Oct 17, 2024
c325c0d
Update dbc version to clear dbc.Select when value is None
taxe10 Oct 17, 2024
c161280
Add warning modals
taxe10 Oct 17, 2024
7059080
Add get logs, cancel/delete jobs
taxe10 Oct 17, 2024
3013d0f
Adapt warning toggle test for dmc
taxe10 Oct 17, 2024
765d522
Fix bug when canceling a flow_run that has finalized
taxe10 Oct 17, 2024
d31995f
Update test for bug fix
taxe10 Oct 17, 2024
d230bc4
Typo
taxe10 Oct 17, 2024
ea45227
Add dev dependencies
taxe10 Oct 17, 2024
c7ba3a7
Add profile
taxe10 Oct 17, 2024
a27e63c
Undoing previous sortin
taxe10 Oct 17, 2024
2638094
Remove profile
taxe10 Oct 17, 2024
1b5258d
Add isort profile
taxe10 Oct 17, 2024
c5db1b9
Add notifications, model params, and model list
taxe10 Nov 22, 2024
919fc62
Update dash components values
taxe10 Jan 3, 2025
cf0dd5a
Get flow run parameters
taxe10 Jan 3, 2025
7cd3ed8
Replace underscores for dashes for plotly components id
taxe10 Jan 3, 2025
1acff5c
Add training stats
taxe10 Jan 6, 2025
b6b4f13
Fix model dropdown bug
taxe10 Jan 7, 2025
600556c
Verify that the training job as completed before loading inference jobs
taxe10 Jan 9, 2025
b2fff18
Flexible definition of button props
taxe10 Jan 28, 2025
8741645
Add minimal version of job manager
taxe10 Jan 28, 2025
8018e08
Add option to register callbacks
taxe10 Jan 28, 2025
273d91e
Replace register_callbacks for aio_id definition
taxe10 Jan 28, 2025
726241f
Add job dependency option for minimal job manager
taxe10 Feb 1, 2025
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 1 addition & 1 deletion .github/workflows/test-lint.yml
Original file line number Diff line number Diff line change
Expand Up @@ -15,7 +15,7 @@ jobs:
python-version: '3.11'
- name: Install dependencies
run: |
python -m pip install ".[all]""
python -m pip install ".[all,dev]"
- name: Lint with flake8
run: |
# stop the build if there are Python syntax errors or undefined names
Expand Down
24 changes: 23 additions & 1 deletion README.md
Original file line number Diff line number Diff line change
@@ -1,4 +1,26 @@
# mlex_utils
# Utils for MLExchange Platform

**mlex_utils** is a utility package designed to support the MLExchange platform by providing convenient tools and extensions for Dash Plotly and Prefect. Currently, this package focuses on facilitating job launches and monitoring workflows with Prefect, making it easier to manage and track your machine learning tasks. As the platform evolves, mlex_utils will continue to expand, incorporating additional utilities to enhance the MLExchange experience and streamline data workflows.

## Features
- Utilities for integrating Dash Plotly components to orchestrate ML jobs using Dash Bootstrap Components and Dash Mantime Components
- Prefect job management tools for launching, scheduling, and monitoring ML jobs.

## Installation

To install `mlex_utils`, you can create a new Python environment and install all the dependencies:

```
conda create -n new_env python==3.11
conda activate new_env
pip install .
```

Alternatively, you can choose to install a set of utils according to your use case. For example, to install the Prefect-related dependencies and utils:

```
pip install ".[prefect]"
```

## Copyright
MLExchange Copyright (c) 2024, The Regents of the University of California,
Expand Down
Binary file added examples/assets/mlex.ico
Binary file not shown.
Binary file added examples/assets/mlex.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading