Load balancing across GPUs#1

Open

josephjohnjj wants to merge 216 commits intobosilca:masterfrom

josephjohnjj:inter_device_migration

Commits on Apr 1, 2022

added new profiling module task granularity
josephjohnjj
committed

Commits on Apr 5, 2022

added new profiling module task granularity

josephjohnjj
authored and
Joseph John
committed
task_characteristics_t structure updated

josephjohnjj
authored and
Joseph John
committed
resolved conflict merge
Joseph John
committed
find_data_size() updated to deal with corner cases
josephjohnjj
committed
Since new policy, setting the non-cache variable has no effect on the

abouteiller
authored and
Joseph John
committed
PRIVATE/PUBLIC_HEADER_H files may be in the build dir or the source dir,

abouteiller
authored and
Joseph John
committed

Commits on Apr 6, 2022

find_data_size() corrected
Joseph John
committed

Commits on Apr 12, 2022

Commits on Apr 18, 2022

Commits on Apr 22, 2022

Commits on Apr 26, 2022

NVML header file added
josephjohnjj
committed

Commits on Apr 27, 2022

Commits on May 2, 2022

Commits on May 8, 2022

Commits on May 9, 2022

change_task_features() moved from migrate_if_starving() to
josephjohnjj
committed

Commits on May 11, 2022

accounting information included
josephjohnjj
committed

Commits on May 20, 2022

Commits on May 23, 2022

Commits on May 25, 2022

Commits on May 26, 2022

When we are migrating of the data is already in the destination
josephjohnjj
committed

Commits on May 28, 2022

Commits on May 30, 2022

MPI_Wtime() added
josephjohnjj
committed

Commits on Jun 1, 2022

Commits on Jun 2, 2022

Commits on Jun 6, 2022

changes to parsec_data_copy_detach()
josephjohnjj
committed

Commits on Jun 8, 2022

Commits on Jun 9, 2022

New workflow based on candidate selection implemented.
josephjohnjj
committed

Commits on Jun 10, 2022

additional debug statements
Joseph John
committed

Commits on Jun 13, 2022

Commits on Jun 15, 2022

mca parameter parsec_cuda_migrate_tasks used to enable migration.
josephjohnjj
committed

Commits on Jun 28, 2022

Fix few issues with our use of spack.

bosilca
authored and
josephjohnjj
committed
flex: on some machines, flex cannot work if parsec/utils is not created

abouteiller
authored and
josephjohnjj
committed
Attempt to backport the revamp of the communication engine (#380)

authored and
josephjohnjj
committed
Respect DISTDIR is provided.

bosilca
authored and
josephjohnjj
committed
[RFC] profiling tools: more efficient cross-stream event matching (#372)

omor1
authored and
josephjohnjj
committed
Fix the event reader.

bosilca
authored and
josephjohnjj
committed
Hash table: count used buckets only when needed

devreal
authored and
josephjohnjj
committed
Print the debug rank from device_show_statistics if the rank cannot be

abouteiller
authored and
josephjohnjj
committed
Handle more gracefully cases of error in CUDA module init

therault
authored and
josephjohnjj
committed
Configurable max_streams, handle more error cases during cuda init

abouteiller
authored and
josephjohnjj
committed
Update to a newer spack compiler

bosilca
authored and
josephjohnjj
committed
Make the PUSHOUT and other DTD GPU concepts generic so that we can

abouteiller
authored and
josephjohnjj
committed
Fix current CUDA bug...

therault
authored and
josephjohnjj
committed
Typo in local queues utils that would make Inverse Priority Scheduler behave exactly as Absolute Priority

therault
authored and
josephjohnjj
committed
dtd_test_simple_gemm.c relies on non-standard cblas.h file

therault
authored and
josephjohnjj
committed
rebased with new master
josephjohnjj
committed
new dwbug statement added to verify parsec_data_copy_destruct
josephjohnjj
committed
new member original_data_in added to keep track of all original data_in.
josephjohnjj
committed
rebased with branch mca
josephjohnjj
committed

Commits on Jun 29, 2022

Commits on Jul 6, 2022

Commits on Jul 7, 2022

add task to device mapping for iterative application
josephjohnjj
committed

Commits on Jul 8, 2022

Commits on Jul 10, 2022

minor code changes
josephjohnjj
committed

Commits on Jul 11, 2022

Commits on Jul 12, 2022

Commits on Jul 14, 2022

Commits on Jul 15, 2022

Commits on Jul 19, 2022

Commits on Jul 20, 2022

For tasks migrated after stage_ in, during the first stage_in
josephjohnjj
committed

Commits on Jul 21, 2022

Commits on Jul 23, 2022

stage_in of migrated task simplified
josephjohnjj
committed

Commits on Jul 24, 2022

Commits on Jul 25, 2022

Commits on Jul 27, 2022

ensure that the coherency is changed before we push to a
josephjohnjj
committed

Commits on Aug 29, 2022

Commits on Sep 23, 2022

tracing extended
josephjohnjj
committed

Commits on Sep 26, 2022

Commits on Sep 27, 2022

single_pass_selection() implemented.
josephjohnjj
committed

Commits on Sep 28, 2022

implemented different task selection methods.
josephjohnjj
committed

Commits on Sep 29, 2022

code updated.
josephjohnjj
committed

Commits on Oct 2, 2022

Commits on Oct 4, 2022

tracing updated to count number of H2D and D2D transfer for each task.
josephjohnjj
committed

Commits on Oct 5, 2022

trace updated.
josephjohnjj
committed

Commits on Oct 11, 2022

Trace updated to collect time stamp in ns
josephjohnjj
committed

Commits on Oct 13, 2022

Commits on Oct 25, 2022

Commits on Oct 27, 2022

Commits on Oct 30, 2022

Commits on Nov 1, 2022

lock mechanism generalised for all selection policies.
josephjohnjj
committed

Commits on Nov 2, 2022

New mca parameter for an unfair task mapping.
josephjohnjj
committed

Commits on Nov 25, 2022

Commits on Nov 28, 2022

Commits on Dec 5, 2022

parsec_cuda_co_manager corrected
josephjohnjj
committed

Commits on Dec 7, 2022

Minor code changes
josephjohnjj
committed

Commits on Dec 16, 2022

When tasks completion was delegated we were releasing data
josephjohnjj
committed

Commits on Dec 20, 2022

Commits on Jan 3, 2023

1. Check if zone is allocated before it is freed
josephjohnjj
committed

Commits on Jan 4, 2023

single_try updated
josephjohnjj
committed

Commits on Jan 8, 2023

Commits on Jan 9, 2023

Commits on Jan 25, 2023

Signed-off-by: Joseph John <[email protected]>
josephjohnjj
committed

Commits on Jan 29, 2023

patch https://github.com/ICLDisco/parsec/pull/479/files implemented
josephjohnjj
committed

Commits on Feb 8, 2023

change_task_features() simplified
josephjohnjj
committed