Skip to content

Commit dbaa18d

Browse files
VuBacktrackingVuBacktracking
committed
initial commit
0 parents  commit dbaa18d

File tree

3 files changed

+21
-0
lines changed

3 files changed

+21
-0
lines changed

‎.gitignore

Lines changed: 9 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,9 @@
1+
.venv/
2+
data/
3+
.env
4+
jars/
5+
*.log
6+
*/logs/
7+
**/.DS_Store
8+
**/__pycache__/
9+
asset/

‎README.md

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1 @@
1+
# DATA STREAM PROCESSING

‎requirements.txt

Lines changed: 11 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,11 @@
1+
kafka-python==2.0.2
2+
avro-python3==1.10.2
3+
pandas==2.2.2
4+
pyarrow==16.1.0
5+
python-schema-registry-client==2.5.6
6+
pyspark==3.5.1
7+
pymongo==4.7.2
8+
delta-spark==3.1.0
9+
sqlalchemy==2.0.20
10+
python-dotenv==1.0.0
11+
psycopg2-binary==2.9.7

0 commit comments

Comments
 (0)