Skip to content

Zero Collision Hash Benchmark Framework #3127

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
wants to merge 2 commits into
base: main
Choose a base branch
from

Conversation

lizhouyu
Copy link
Contributor

Differential Revision: D77033290

@facebook-github-bot facebook-github-bot added the CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. label Jun 23, 2025
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D77033290

@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D77033290

lizhouyu added a commit to lizhouyu/torchrec that referenced this pull request Jul 6, 2025
Summary: Pull Request resolved: pytorch#3127

Differential Revision: D77033290
@lizhouyu lizhouyu force-pushed the export-D77033290 branch from 729264d to f95b8fa Compare July 6, 2025 01:34
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D77033290

lizhouyu added a commit to lizhouyu/torchrec that referenced this pull request Jul 6, 2025
Summary: Pull Request resolved: pytorch#3127

Differential Revision: D77033290
@lizhouyu lizhouyu force-pushed the export-D77033290 branch from f95b8fa to c44d954 Compare July 6, 2025 04:35
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D77033290

lizhouyu added a commit to lizhouyu/torchrec that referenced this pull request Jul 6, 2025
Summary: Pull Request resolved: pytorch#3127

Differential Revision: D77033290
@lizhouyu lizhouyu force-pushed the export-D77033290 branch from c44d954 to 1a691d5 Compare July 6, 2025 04:59
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D77033290

@lizhouyu lizhouyu force-pushed the export-D77033290 branch from 1a691d5 to 61b76e8 Compare July 6, 2025 05:33
lizhouyu added a commit to lizhouyu/torchrec that referenced this pull request Jul 6, 2025
Summary: Pull Request resolved: pytorch#3127

Differential Revision: D77033290
lizhouyu added a commit to lizhouyu/torchrec that referenced this pull request Jul 6, 2025
Summary: Pull Request resolved: pytorch#3127

Differential Revision: D77033290
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D77033290

lizhouyu added a commit to lizhouyu/torchrec that referenced this pull request Jul 8, 2025
Summary: Pull Request resolved: pytorch#3127

Differential Revision: D77033290
@lizhouyu lizhouyu force-pushed the export-D77033290 branch from 61b76e8 to 115412b Compare July 8, 2025 00:09
lizhouyu added a commit to lizhouyu/torchrec that referenced this pull request Jul 8, 2025
Summary: Pull Request resolved: pytorch#3127

Differential Revision: D77033290
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D77033290

@lizhouyu lizhouyu force-pushed the export-D77033290 branch from 115412b to c3663f5 Compare July 9, 2025 17:56
lizhouyu added a commit to lizhouyu/torchrec that referenced this pull request Jul 9, 2025
Summary: Pull Request resolved: pytorch#3127

Differential Revision: D77033290
lizhouyu added a commit to lizhouyu/torchrec that referenced this pull request Jul 9, 2025
Summary: Pull Request resolved: pytorch#3127

Differential Revision: D77033290
lizhouyu added a commit to lizhouyu/torchrec that referenced this pull request Jul 14, 2025
Summary: Pull Request resolved: pytorch#3127

Differential Revision: D77033290
lizhouyu added 2 commits July 14, 2025 13:18
Summary:
### Major changes
- Create a `mpzch` folder under the `torchrec/github/examples` folder
- Implement a simple SparseArch module with a flag to switch between original and MPZCH managed collision modules
- Profile the running time and QPS for model training(GPU)/inference(CPU)
- Create a notebook tutorial for ZCH basics and the use of ZCH modules in TorchRec

### ToDos for OSS
- When the internal torchrec MPZCH module is OSS
  - Remove the `BUCK` file
  - Replace all the `from torchrec.fb.modules` in `sparse_arch.py` to `from torchrec.modules`

### Potential improvement
- Add hash collision counter
- Show profiling results in the Readme file
- Add multi-batch profiling

Differential Revision: D75570684

Reviewed By: aporialiao
Summary: Pull Request resolved: pytorch#3127

Differential Revision: D77033290
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D77033290

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. fb-exported
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants