Merge branch 'master' into sam

implement skip connections for sam vit encoder

implement skip connections for sam vit encoder

rm changes from pan model

use vit_depth to control sam vit depth

Merge branch 'master' into sam

minor changes from PR review

remove sam decoder as it's not stable yet

Integrate SAM's image encoder with Unet

Integrate SAM's image encoder with Unet

update segment-anything package source in reqs

rm segment-anything from reqs

ensure sam encoder weights loading

integrate sam encoder to Unet model

add segment-anything to reqs

Merge pull request #1 from Rusteam/sam-ddp

remove prompt encoder from sam

set unused sam modules to None

set unused sam modules to require grad False

set unused sam modules to require grad False

use iou scaling to avoid errors with torch ddp

update readme with sam model and encoders

load pretrained sam state dict for a model

wip weights

remove sam encoders from test_models