From 07f638d69190ae6c58179f58f76316788f415b96 Mon Sep 17 00:00:00 2001 From: ryan scherbarth Date: Sun, 9 Jun 2024 01:11:07 -0600 Subject: [PATCH] create new images dir, update spark --- apache_spark_logo.jpeg => Images/spark-img1.jpeg | Bin spark-image1.jpg => Images/spark-img2.jpg | Bin spark-image2.jpg => Images/spark-img3.jpg | Bin spark.md | 7 +++---- 4 files changed, 3 insertions(+), 4 deletions(-) rename apache_spark_logo.jpeg => Images/spark-img1.jpeg (100%) rename spark-image1.jpg => Images/spark-img2.jpg (100%) rename spark-image2.jpg => Images/spark-img3.jpg (100%) diff --git a/apache_spark_logo.jpeg b/Images/spark-img1.jpeg similarity index 100% rename from apache_spark_logo.jpeg rename to Images/spark-img1.jpeg diff --git a/spark-image1.jpg b/Images/spark-img2.jpg similarity index 100% rename from spark-image1.jpg rename to Images/spark-img2.jpg diff --git a/spark-image2.jpg b/Images/spark-img3.jpg similarity index 100% rename from spark-image2.jpg rename to Images/spark-img3.jpg diff --git a/spark.md b/spark.md index b4b05164..b06d92d5 100644 --- a/spark.md +++ b/spark.md @@ -103,8 +103,7 @@ As mentioned above and on other CARC web pages, we suggest that users use Anacon ```wheeler-sn> module load anaconda3-4.4.0-gcc-4.8.5-ubgzkkv wheeler-sn> conda create –n spark python=27 numpy scipy pandas matplotlib ``` -![SparkLogo](https://github.com/UNM-CARC/QuickBytes/blob/master/apache_spark_logo.jpeg) - +![](/Images/spark-img1.jpeg) Once this is done, we just activate that environment and can add new things to it as needed after we launch our Spark cluster, to interactively look at a lot of data. First, we bring up Spark with this customized environment: ```wheeler-sn> qsub –I –l nodes=1:ppn=8 -l walltime=01:00:00 @@ -172,7 +171,7 @@ plt.xticks(size = 18) plt.yticks(size = 18) plt.savefig("crimes-by-month.pdf") ``` -![Crimes](https://github.com/UNM-CARC/QuickBytes/blob/master/spark-image1.jpg) +![](/Images/spark-img2.jpg) Similarly, this code generates a file which charts Chicago crime by location type: @@ -192,7 +191,7 @@ plt.xticks(size = 24) plt.yticks(size = 24) plt.savefig("crimes-by-location.pdf") ``` -![Crimes](https://github.com/UNM-CARC/QuickBytes/blob/master/spark-image2.jpg) +![](/Images/spark-img3.jpg) ## More Information