Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[IGNORE] DUMMY PR (testing somethings) #1638

Open
wants to merge 90 commits into
base: main
Choose a base branch
from
Open
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
90 commits
Select commit Hold shift + click to select a range
323dcb5
Pipeline changes to CI
syeleti-msft Feb 13, 2025
6539d05
Check if CI is working
syeleti-msft Feb 13, 2025
3e26c72
Shift bfusemon checks from nightly to CI
syeleti-msft Feb 13, 2025
1e75540
Shift bfusemon checks from nightly to CI
syeleti-msft Feb 13, 2025
9a24db1
* Update github pull request template
syeleti-msft Feb 13, 2025
d32b156
* Update Licence so that it can be recognised by github/
syeleti-msft Feb 13, 2025
7c919f7
Fix typo
syeleti-msft Feb 13, 2025
0630770
Fix typo
syeleti-msft Feb 13, 2025
25ce164
Fix typo
syeleti-msft Feb 13, 2025
01062f0
check something
syeleti-msft Feb 13, 2025
e4a57b5
check something
syeleti-msft Feb 13, 2025
6c4ab57
change datalake cred
syeleti-msft Feb 13, 2025
023ae30
Add comments to the scripts
syeleti-msft Feb 13, 2025
678d14e
Add comments to the scripts
syeleti-msft Feb 13, 2025
f08ea68
Add comments to the scripts
syeleti-msft Feb 13, 2025
f7d2722
Add comments to the scripts
syeleti-msft Feb 13, 2025
d3d5537
Cleanup correctly
syeleti-msft Feb 13, 2025
efe92fd
Rely on global variables
syeleti-msft Feb 13, 2025
7b72b10
Call the variable correctly
syeleti-msft Feb 13, 2025
76f7cff
Modify CI to not work on all the branches
syeleti-msft Feb 13, 2025
d6d498e
Print Type of containers when they were getting created/deleted
syeleti-msft Feb 14, 2025
22b3679
Remove stuff before passing
syeleti-msft Feb 14, 2025
3813b78
Remove variables in codecoverage
syeleti-msft Feb 14, 2025
165dd50
Remove Unnecessary variables from build.yml
syeleti-msft Feb 14, 2025
4904cd8
Modifications start for nytly
syeleti-msft Feb 14, 2025
e828b97
Cleanup nytly pipeline
syeleti-msft Feb 14, 2025
4dc09a2
Change parameter for proxy setup
syeleti-msft Feb 14, 2025
1504fea
Change parameter for proxy setup
syeleti-msft Feb 14, 2025
9067298
typo
syeleti-msft Feb 14, 2025
7d88a0f
Change package installation
syeleti-msft Feb 14, 2025
abd3c0f
Change package installation
syeleti-msft Feb 14, 2025
324f6ee
Change package installation
syeleti-msft Feb 14, 2025
e6000c1
Change package installation
syeleti-msft Feb 14, 2025
5e10d68
Modify package install
syeleti-msft Feb 16, 2025
f0e9367
Modify package install
syeleti-msft Feb 16, 2025
7d03920
Modify package install
syeleti-msft Feb 16, 2025
1c5bcd2
Modify package install
syeleti-msft Feb 16, 2025
c3044f5
Modify package install
syeleti-msft Feb 16, 2025
80e44cd
Modify package install
syeleti-msft Feb 16, 2025
da91264
Modify package install
syeleti-msft Feb 16, 2025
0c11064
Modify package install
syeleti-msft Feb 16, 2025
bc055c9
Modify package install
syeleti-msft Feb 16, 2025
8195e21
Modify package install
syeleti-msft Feb 16, 2025
540c91c
Modify package install
syeleti-msft Feb 16, 2025
03defa6
Modify package install
syeleti-msft Feb 16, 2025
7ea5b25
Modify package install
syeleti-msft Feb 16, 2025
2ff2436
Modify package install
syeleti-msft Feb 16, 2025
7c25d2a
Modify package install
syeleti-msft Feb 16, 2025
4287277
Changes for nightly pipeline
syeleti-msft Feb 17, 2025
5b0e9d5
Changes for nightly pipeline
syeleti-msft Feb 17, 2025
66c612d
Changes for nightly pipeline
syeleti-msft Feb 17, 2025
a8b28e8
Changes for nightly pipeline
syeleti-msft Feb 17, 2025
54b0a94
Changes for nightly pipeline
syeleti-msft Feb 17, 2025
5a6a472
Changes for nightly pipeline
syeleti-msft Feb 17, 2025
fccb031
Changes for nightly pipeline
syeleti-msft Feb 17, 2025
dbc3a9d
Add data consistency checks
syeleti-msft Feb 17, 2025
50eeff5
Fix typo
syeleti-msft Feb 17, 2025
0a05dcd
New staget is not getting recognised by pipeline
syeleti-msft Feb 17, 2025
5ca5264
fix typo
syeleti-msft Feb 17, 2025
697b012
fix typo
syeleti-msft Feb 17, 2025
ac80793
fix typo
syeleti-msft Feb 17, 2025
3ef004a
Remove using generic terms
syeleti-msft Feb 17, 2025
436cebb
Remove using generic terms
syeleti-msft Feb 18, 2025
26263bf
Merge branch 'main' into cleanpipeline
syeleti-msft Feb 18, 2025
4e31fd2
revert some files to main
syeleti-msft Feb 18, 2025
0de28e9
modify comments
syeleti-msft Feb 18, 2025
a87132a
* Add static container names for distros other than ubuntu coz instal…
syeleti-msft Feb 18, 2025
bb90db4
Stop Checking out the code automatically, lets do it manually always
syeleti-msft Feb 18, 2025
0f2e1b3
Use Azcli for only ubuntu
syeleti-msft Feb 18, 2025
a1b7f14
Remove Azcli tests for other distros
syeleti-msft Feb 18, 2025
54112da
Create sas for ADLS container which we create as the account SAS is n…
syeleti-msft Feb 18, 2025
9106814
typo fix
syeleti-msft Feb 18, 2025
0e12d30
tmp path not getting cleared in block cache
syeleti-msft Feb 19, 2025
d7cbcbe
Update lvalues
syeleti-msft Feb 19, 2025
1a0df1c
* Use only 2 storage accounts, 1 for block and other for adls
syeleti-msft Feb 19, 2025
c2366c5
Fix typo
syeleti-msft Feb 19, 2025
86b26f2
Merge branch 'main' into syeleti/cleanpl
syeleti-msft Feb 19, 2025
0ec6bae
Check trigger is working or not
syeleti-msft Feb 19, 2025
5a1746e
Move containers for listing huge number of files
syeleti-msft Mar 4, 2025
5787911
Move generation of ADLS SAS to the setup of pipeline
syeleti-msft Mar 4, 2025
83eddeb
Move generation of ADLS SAS to the setup of pipeline
syeleti-msft Mar 4, 2025
13a5523
Disable tests for checking auth using http as new storage accounts ar…
syeleti-msft Mar 4, 2025
57e1592
make ADLS SAS getting created only when ubuntu distros
syeleti-msft Mar 4, 2025
5e8a3f0
update code coverage
syeleti-msft Mar 4, 2025
b70ac01
Refactor
syeleti-msft Mar 4, 2025
39d8c5d
refactor
syeleti-msft Mar 4, 2025
487d494
Finalise changes
syeleti-msft Mar 5, 2025
5ea3b6a
Merge branch 'main' into cleanpipeline
syeleti-msft Mar 5, 2025
4870ccb
typo
syeleti-msft Mar 5, 2025
efa3758
refactor
syeleti-msft Mar 5, 2025
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
52 changes: 0 additions & 52 deletions STREAMING.md

This file was deleted.

64 changes: 64 additions & 0 deletions azure-pipeline-templates/bfusemon.yml
Original file line number Diff line number Diff line change
@@ -0,0 +1,64 @@
steps:
- script: |
cd $(WORK_DIR)
$(WORK_DIR)/blobfuse2 gen-test-config --config-file=azure_key_hmon.yaml --container-name=$(containerName) --temp-path=$(TEMP_DIR) --output-file=$(BLOBFUSE2_CFG)
displayName: Create Key Config File
env:
STO_ACC_TYPE: 'block'
STO_ACC_NAME: $(BF2_BLK_ACC_NAME)
STO_ACC_KEY: $(BF2_BLK_ACC_KEY)
STO_ACC_ENDPOINT: 'https://$(BF2_BLK_ACC_NAME).blob.core.windows.net'
VERBOSE_LOG: false
USE_HTTP: false
HMON_OUTPUT: $(WORK_DIR)
continueOnError: false

- script: cat $(BLOBFUSE2_CFG)
displayName: Print config file

- script:
mkdir -p $(MOUNT_DIR)
mkdir -p $(TEMP_DIR)
displayName: "Create directory structure"

- template: 'mount.yml'
parameters:
prefix: "Mount"
mountStep:
script: |
sudo ln -s `pwd`/bfusemon /usr/local/bin/bfusemon
ls -l /usr/local/bin/bfusemon*
$(WORK_DIR)/blobfuse2 mount $(MOUNT_DIR) --config-file=$(BLOBFUSE2_CFG)
displayName: 'Mount Blobfuse2'
workingDirectory: $(WORK_DIR)
timeoutInMinutes: 3
continueOnError: false

- script: |
sudo ps -aux | grep bfusemon
displayName: 'Print bfusemon Process info'
env:
mount_dir: $(MOUNT_DIR)

- script: |
touch $(MOUNT_DIR)/h1.txt
echo "123456" > $(MOUNT_DIR)/h2.txt
cp *.md $(MOUNT_DIR)/
mkdir $(MOUNT_DIR)/A
mv $(MOUNT_DIR)/h1.txt $(MOUNT_DIR)/h5.txt
mv $(MOUNT_DIR)/h*.* $(MOUNT_DIR)/A
rm -rf $(MOUNT_DIR)/*.md
rm -rf $(MOUNT_DIR)/A
displayName: "Test for health monitor"
workingDirectory: $(WORK_DIR)

- script: |
sleep 20s
cat $(WORK_DIR)/monitor_*.json
displayName: "Print bfusemon output"
workingDirectory: $(WORK_DIR)

- template: 'cleanup.yml'
parameters:
unmount: true
delete_containers: false
158 changes: 0 additions & 158 deletions azure-pipeline-templates/blobfuse2-ci-template.yml

This file was deleted.

67 changes: 0 additions & 67 deletions azure-pipeline-templates/blobfuse2-data-validation.yml

This file was deleted.

12 changes: 6 additions & 6 deletions azure-pipeline-templates/build-release.yml
Original file line number Diff line number Diff line change
Expand Up @@ -67,16 +67,16 @@ steps:
echo $cnfFile
touch $cnfFile
echo "{" > $cnfFile
echo "\"block-acct\"": "\"$(AZTEST_BLOCK_ACC_NAME)\"", >> $cnfFile
echo "\"adls-acct\"": "\"$(AZTEST_ADLS_ACC_NAME)\"", >> $cnfFile
echo "\"block-acct\"": "\"$(BF2_BLK_ACC_NAME)\"", >> $cnfFile
echo "\"adls-acct\"": "\"$(BF2_ADLS_ACC_NAME)\"", >> $cnfFile
echo "\"block-cont\"": "\"${{ parameters.container }}\"", >> $cnfFile
echo "\"adls-cont\"": "\"${{ parameters.container }}\"", >> $cnfFile
echo "\"block-key\"": "\"$(AZTEST_BLOCK_KEY)\"", >> $cnfFile
echo "\"adls-key\"": "\"$(AZTEST_ADLS_KEY)\"", >> $cnfFile
echo "\"block-sas\"": "\"$(AZTEST_BLOCK_SAS)\"", >> $cnfFile
echo "\"block-key\"": "\"$(BF2_BLK_ACC_KEY)\"", >> $cnfFile
echo "\"adls-key\"": "\"$(BF2_ADLS_ACC_KEY)\"", >> $cnfFile
echo "\"block-sas\"": "\"$(BF2_BLK_ACC_SAS)\"", >> $cnfFile
echo "\"block-cont-sas-ubn-18\"": "\"$(AZTEST_BLOCK_CONT_SAS_UBN_18)\"", >> $cnfFile
echo "\"block-cont-sas-ubn-20\"": "\"$(AZTEST_BLOCK_CONT_SAS_UBN_20)\"", >> $cnfFile
echo "\"adls-sas\"": "\"$(AZTEST_ADLS_SAS)\"", >> $cnfFile
echo "\"adls-sas\"": "\"$(BF2_ADLS_ACC_SAS)\"", >> $cnfFile
echo "\"msi-appid\"": "\"$(AZTEST_APP_ID)\"", >> $cnfFile
echo "\"msi-resid\"": "\"$(AZTEST_RES_ID)\"", >> $cnfFile
echo "\"msi-objid\"": "\"$(AZTEST_OBJ_ID)\"", >> $cnfFile
Expand Down
Loading
Loading