CS480xFinal-MilesGregg-JoshuaMalcarne-FredericoGalbiati-TimConnors

README.md

@@ -1,123 +1,36 @@
-Final Project - Interactive Data Visualization  
+CS480X Final Project - Artiic Ice Cracks Analysis
 ===
 
-The key learning experience of this course is the final project. 
-You will design a web site and interactive visualizations that answer questions you have, provide an exploratory interface to some topic of your own choosing, or take on a more ambitious experiment than A3. 
-You will acquire the data, design your visualizations, implement them, and critically evaluate the results. 
-
-The path to a good visualization is going to involve mistakes and wrong turns. 
-It is therefore important to recognize that mistakes are valuable in finding the path to a solution, to broadly explore the design space, and to iterate designs to improve possible solutions. 
-To help you explore the design space, we will hold events such as feedback sessions in which you propose your idea and initial designs and receive feedback from the class and staff.
-
-Proposals / Idea Generation
----
-
-Submit project ideas using [this Google Form](https://docs.google.com/forms/d/e/1FAIpQLSepaCzjEq9AXwmJ8mJ-06ytkQUuLI1Z2QF5KGyhVnKaxBI-mA/viewform?usp=sf_link).
-
-You're encouraged to submit many ideas-- staff will help you identify the most promising ones and possible roadblocks.
-
-Please stick to 1-4 folks per team.
-
-Final Project Materials
----
-For your final project you must hand in the following items.
-
-### Process Book
-
-An important part of your project is your process book. Your process book details your steps in developing your solution, including the alternative designs you tried, and the insights you got. Develop your process book out of the project proposal. Equally important to your final results is how you got there! Your process book is the place you describe and document the space of possibilities you explored at each step of your project. It is not, however, a journal or lab notebook that describes every detail - you should think carefully about the important decisions you made and insights you gained and present your reasoning in a concise way.
-
-We strongly advise you to include many figures in your process book, including photos of your sketches of potential designs, screen shots from different visualization tools you explored, inspirations of visualizations you found online, etc. Several images illustrating changes in your design or focus over time will be far more informative than text describing those changes. Instead, use text to describe the rationale behind the evolution of your project.
-
-Your process book should include the following topics. Depending on your project type the amount of discussion you devote to each of them will vary:
-
-- Overview and Motivation: Provide an overview of the project goals and the motivation for it. Consider that this will be read by people who did not see your project proposal.
-- Related Work: Anything that inspired you, such as a paper, a web site, visualizations we discussed in class, etc.
-- Questions: What questions are you trying to answer? How did these questions evolve over the course of the project? What new questions did you consider in the course of your analysis?
-- Data: Source, scraping method, cleanup, etc.
-- Exploratory Data Analysis: What visualizations did you use to initially look at your data? What insights did you gain? How did these insights inform your design?
-- Design Evolution: What are the different visualizations you considered? Justify the design decisions you made using the perceptual and design principles you learned in the course. Did you deviate from your proposal?
-- Implementation: Describe the intent and functionality of the interactive visualizations you implemented. Provide clear and well-referenced images showing the key design and interaction elements.
-- Evaluation: What did you learn about the data by using your visualizations? How did you answer your questions? How well does your visualization work, and how could you further improve it?
-
-As this will be your only chance to describe your project in detail make sure that your process book is a standalone document that fully describes your results and the final design. 
-[Here](http://dataviscourse.net/2015/assets/process_books/bansal_cao_hou.pdf) are a [few examples](http://dataviscourse.net/2015/assets/process_books/walsh_trevino_bett.pdf) of process books from a similar course final.
-
-Tip: Start your process book on Day 1. Make entries after each meeting, and trim / edit as needed towards the end of the project. Many folks use either slides software (like PowerPoint) or Google Docs to make this book, as both allow for flexible layouts and export to PDF.
-
-
-### Project Website
-
-Create a public website for your project using GitHub pages or another web hosting service of your choice. 
-The web site should contain your interactive visualization, summarize the main results of the project, and tell a story. 
-Consider your audience (the site should be public if possible, unless you're running an experiment, etc.) and keep the level of discussion at the appropriate level. 
-Your process book and data should be linked from the web site as well. 
-Also embed your interactive visualization and your screen-cast in your website. 
-If you are not able to publish your work (e.g., due to confidential data) please let us know in your project proposal.
-
-### Project Screen-Cast
-
-Each team will create a two minute screen-cast with narration showing a demo of your visualization and/or some slides. 
-
-You can use any screencast tool of your choice, such as Camtasia or Loom (new and recommended). 
-Please make sure that the sound quality of your video is good -- it may be worthwhile to invest in an external USB microphone-- campus IT should have some you can borrow. 
-Upload the video to an online video-platform such as YouTube or Vimeo and embed it into your project web page. 
-For our final project presentation day, we will show as many videos in class as possible, and ask teams to field questions.
-
-We will strictly enforce the two minute time limit for the video, so please make sure you are not running longer. 
-Use principles of good storytelling and presentations to get your key points across. Focus the majority of your screencast on your main contributions rather than on technical details. 
-What do you feel is the best part of your project? 
-What insights did you gain? 
-What is the single most important thing you would like your audience to take away? Make sure it is front and center rather than at the end.
-
-Outside Libraries/References
+Summary
 ---
 
-For this project you *do not* have to write everything from scratch.
-
-You may *reference* demo programs from books or the web, and *include* popular web libraries like Material UI, React, Svelte, etcetera. 
-
-Please *do not* use libraries on top of d3 without consulting staff, however. 
-Libraries like nvd3.js look tempting, but such libraries often have poor defaults and result in poor visualizations.
-There may be exceptions.
-Instead, draw from the numerous existing d3 examples on the web.
+For our final revised project proposal we wanted to look into how over the years how the arctic ice has evolved during recent years. As you see in the figure the red circles shows the arctic circle which is the area we focused all of our data on. Doing this project was very interesting for all of us to do since we all wanted to a data visualization on the worldwide perspective. The preprocessing of all of the data took us a while to get down and so did all of the d3.js plotting of the data. 
 
-If you use outside sources please provide a References section with links at the end of your Readme.
+The main reasoning for the project is that we wanted to look into how pollution may affect the arctic ice in which it does in several different ways over the years. Once we got all of our data and we knew how to execute the final goal it got much better. Since we spent a lot of time looking at and preprocessing different datasets which took a long time.
 
-Resources
+Links
 ---
-The "[Data is Plural](https://tinyletter.com/data-is-plural/archive)" weekly letter often contains interesting datasets.
 
-Think of something you're interested in, go find data on it! Include data collection and processing as part of your work on this project.
+- GitHub Repository: https://github.com/MilesGregg/final
+- Github Pages: https://milesgregg.github.io/final/ 
+- Video Link: https://www.youtube.com/watch?v=42jXF928klU
+- Book: Please Reference "CS 480X Final Project Process Book"
 
-Requirements
+Contributors
 ---
 
-Store the following in your GitHub repository:
+-   **Josh Malcarne**
 
-- Code - All web site files and libraries assuming they are not too big to include
-- Data - Include all the data that you used in your project. If the data is too large for github store it on a cloud storage provider, such as Dropbox or Yousendit.
-- Process Book- Your Process Book in PDF format.
-- README - The README file must give an overview of what you are handing in: which parts are your code, which parts are libraries, and so on. The README must contain URLs to your project websites and screencast videos. The README must also explain any non-obvious features of your interface.
+    -   GitHub: https://github.com/JoshuaMalcarne
 
-GitHub Details
----
+-   **Federico Galibati**
 
-- Fork the repo. You now have a copy associated with your username.
-- Make changes to index.html to fulfill the project requirements. 
-- Make sure your "main" branch matches your "gh-pages" branch. See the GitHub Guides referenced above if you need help.
-- Edit the README.md with a link to your gh-pages or other external site: for example http://YourUsernameGoesHere.github.io/DataVisFinal/index.html
-- To submit, make a [Pull Request](https://help.github.com/articles/using-pull-requests/) on the original repository.
+    -   GitHub: https://github.com/fedeit
 
-Grading
----
+-   **Miles Gregg**
 
-- Process Book - Are you following a design process that is well documented in your process book?
-- Solution - Is your visualization effective in answering your intended questions? Was it designed following visualization principles?
-- Implementation - What is the quality of your implementation? Is it appropriately polished, robust, and reliable?
-- Presentation - Are your web site and screencast clear, engaging, and effective?
-Your individual project score will also be influenced by your peer evaluations.
+    -   GitHub: https://github.com/MilesGregg
 
-References
----
+-   **Tim Conners**
 
-- This final project is adapted from https://www.dataviscourse.net/2020/project/
+    -   GitHub: https://github.com/timconnors33

convert.py

@@ -0,0 +1,35 @@
+import os
+from glob import glob
+from PIL import Image
+from tqdm import tqdm
+
+for netcdf in tqdm(glob('./data/*.nc')):
+    try:
+        src = os.path.abspath(netcdf)
+        dst = './processed/'+os.path.splitext(os.path.basename(netcdf))[0] + '.png'
+
+        os.system(f'gdal_translate -a_nodata 0 NETCDF:"{netcdf}":Mask mask.tif  > /dev/null')
+        os.system(f'gdal_calc.py -X mask.tif --outfile=mask1.tif --calc="(X!=201)*X" --NoDataValue=0  > /dev/null')
+        os.system('gdal_calc.py -X mask1.tif --outfile=mask2.tif --calc="(X!=200)*X" --NoDataValue=0  > /dev/null')
+        # os.system('gdal_calc.py -X mask2.tif --outfile=mask3.tif --calc="(X!=10)*X" --NoDataValue=0')
+        os.system('gdal_calc.py -X mask2.tif --outfile=mask4.tif --calc="(X>11)*255+(X<=11)*X" --NoDataValue=0  > /dev/null')
+        os.system(f'gdal_translate mask4.tif {dst}  > /dev/null')
+        os.remove('mask.tif')
+        os.remove('mask1.tif')
+        os.remove('mask2.tif')
+        # os.remove('mask3.tif')
+        os.remove('mask4.tif')
+        # Open an already existing image
+        imageObject = Image.open(dst)
+        # Do a flip of left and right
+        img = imageObject.transpose(Image.FLIP_LEFT_RIGHT)
+        img = img.convert("RGB")
+        pixdata = img.load()
+        # Clean the background noise, if color != white, then set to black.
+        for y in range(img.size[1]):
+            for x in range(img.size[0]):
+                if pixdata[x, y] == (255, 255, 255):
+                    pixdata[x, y] = (255, 0, 0)
+        img.save(dst)
+    except:
+        print(f"error on image {netcdf}")