New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

DeepSeek on AWS #2632

Merged

pagezyhf merged 9 commits into main from deepseek-aws

Jan 30, 2025

Contributor

pagezyhf commented Jan 30, 2025

WIP document on how to deploy and fine tune DeepSeek R1 models on AWS

Outstanding items:

EC2 deployment on inferentia end up in timeout before succeeding cc @dacorvo
I need to do a thumbnail
IE deployment on Inferentia
Add a link to a notebook for fine tuning deepseek models in sagemaker cc @fgbelidji ? Or maybe wait for an official HF container?

cc @jeffboudier for viz and review


          add blog

8d0807b

dacorvo reviewed

View reviewed changes

deepseek-aws.md Outdated Show resolved Hide resolved

Contributor

dacorvo commented Jan 30, 2025

For the time-out of the 70B model, it may be related to a temporary slowdown of the hub: several CI jobs failed approximately at the same time because the models could not be fetched from the hub.

dacorvo approved these changes

View reviewed changes

Contributor

dacorvo left a comment

Apart from my small comment, this looks good to me, thanks !

jeffboudier reviewed

View reviewed changes

_blog.yml Outdated Show resolved Hide resolved

jeffboudier reviewed

View reviewed changes

deepseek-aws.md Outdated Show resolved Hide resolved

jeffboudier reviewed

View reviewed changes

deepseek-aws.md Outdated Show resolved Hide resolved

jeffboudier reviewed

View reviewed changes

deepseek-aws.md Outdated Show resolved Hide resolved

jeffboudier reviewed

View reviewed changes

deepseek-aws.md Outdated Show resolved Hide resolved

jeffboudier approved these changes

View reviewed changes

Member

jeffboudier left a comment

Love it, excited about this blog post!

pagezyhf and others added 8 commits

January 30, 2025 18:13


          Update deepseek-aws.md

374655f

Co-authored-by: Jeff Boudier <[email protected]>


          Update deepseek-aws.md

0e06abe

Co-authored-by: Jeff Boudier <[email protected]>


          Update deepseek-aws.md

ec4eb7d

Co-authored-by: Jeff Boudier <[email protected]>


          Update deepseek-aws.md

285b70f

Co-authored-by: Jeff Boudier <[email protected]>


          changes

51128cc


          zdazd

42e0e6f

fix

d549aa4

fix

07511ad

pagezyhf merged commit 7d85fdd into main

1 check passed

pagezyhf deleted the deepseek-aws branch

January 30, 2025 17:25

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet