Skip to content

Commit a910b67

Browse files
committed
Minor updates to documentation
1 parent 20c10aa commit a910b67

File tree

4 files changed

+117
-3
lines changed

4 files changed

+117
-3
lines changed

README.md

Lines changed: 109 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -100,5 +100,113 @@ Open `src/.config` file with a text editor of your choice. You will see several
100100
- `PROJECT_ROOT`: This should be the path to the root directory of your project. Modify it if the default does not match your directory structure.
101101
- `GLOCAL_DATA_PATH`: Update this to the location where your Glocal dataset is stored.
102102

103-
### Need Help?
103+
104+
# Raw data
105+
106+
The raw data used in the project shoule be placed in the following directory structure:
107+
108+
```
109+
.
110+
└── raw
111+
├── airports
112+
│   ├── datahub
113+
│   ├── nunn_and_puga
114+
├── country_codes
115+
├── metadata
116+
│   └── 15_ADMProjects
117+
├── mining
118+
├── point_data
119+
│   └── telecom_antennas
120+
├── ports
121+
│   ├── wld
122+
│   └── wpi
123+
├── rasters
124+
│   ├── dmsp
125+
│   ├── elevation
126+
│   ├── emissions
127+
│   ├── fao
128+
│   ├── gdelt_v2
129+
│   ├── ghsl
130+
│   ├── gpcp
131+
│   ├── ntl_dmsp_ext
132+
│   ├── ntl_dvnl
133+
│   ├── population
134+
│   ├── precipitation
135+
│   ├── roads
136+
│   ├── ruggedness
137+
│   ├── sentinel_2
138+
│   ├── solar_potential
139+
│   ├── telecom_mobile_coverage
140+
│   ├── temperature
141+
│   ├── viirs
142+
│   └── wind_potential
143+
├── remote_sensed
144+
│   ├── ACLED
145+
│   ├── all_countries_with_eth
146+
│   ├── all_FAO
147+
│   ├── CRU
148+
│   ├── cru_raster
149+
│   ├── elevation
150+
│   ├── GDELT_ethnic
151+
│   ├── GPCC
152+
│   ├── GPCC_raster
153+
│   ├── gpcp
154+
│   ├── Latinobarometro
155+
│   ├── nightlights
156+
│   ├── population
157+
│   ├── SCAD
158+
│   ├── SCPDSI
159+
│   ├── SCPDSI_raster
160+
│   └── temperature
161+
├── roads
162+
│   ├── code
163+
│   └── test
164+
└── shapefiles
165+
├── gadm
166+
├── gadm_geoparquet
167+
└── ghs
168+
```
169+
170+
Further, the intermediate data folder should have the following structure - some of these folders are automatically created by the code, whereas others (such as the downloads from Google Cloud Storage) need to be created manually. In order to simplify the process, it is best to create all the folders manually.
171+
172+
```
173+
├── intermediate
174+
│   ├── acled
175+
│   ├── gadm_without_geometry
176+
│   ├── gee_accessibility_agg
177+
│   ├── gee_forest_change
178+
│   ├── gee_landcover_agg
179+
│   ├── gee_landcover_compiled
180+
│   ├── gee_landcover_processed
181+
│   ├── gee_viirs_agg
182+
│   ├── gee_viirs_monthly
183+
│   ├── ghs
184+
│   ├── ghs_gadm
185+
│   ├── individual_aggregations
186+
│   ├── market_access
187+
│   ├── mining
188+
│   ├── overture
189+
│   ├── raster_aggregations
190+
│   │   ├── dmsp
191+
│   │   ├── elevation
192+
│   │   ├── emissions
193+
│   │   ├── fao
194+
│   │   ├── ntl_dmsp_ext
195+
│   │   ├── ntl_dvnl
196+
│   │   ├── population
197+
│   │   ├── precipitation
198+
│   │   ├── roads
199+
│   │   ├── ruggedness
200+
│   │   ├── solar_potential
201+
│   │   ├── telecom_mobile_coverage
202+
│   │   ├── temperature
203+
│   │   ├── viirs
204+
│   │   └── wind_potential
205+
│   ├── roads
206+
│   │   └── grip
207+
│   ├── viirs
208+
│   └── viirs_monthly
209+
```
210+
211+
# Need Help?
104212
If you encounter any issues or have questions about configuring your environment, feel free to open an issue in the project repository or contact the project authors.

src/case_study/deforestation_colombia.ipynb

Lines changed: 2 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -47,7 +47,8 @@
4747
"outputs": [],
4848
"source": [
4949
"# Set output folder path - default is the location of the script\n",
50-
"OUTPUT_FOLDER = os.path.realpath(\".\")"
50+
"OUTPUT_FOLDER = os.path.realpath(\".\")\n",
51+
"print(OUTPUT_FOLDER)"
5152
]
5253
},
5354
{

src/google_earth_engine/README.md

Lines changed: 5 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -21,4 +21,8 @@ Make sure that earthengine-api is installed (should already be installed if you
2121

2222
Then, run `earthengine authenticate` to authenticate your Google Earth Engine account.
2323

24-
More details available [here](https://developers.google.com/earth-engine/guides/python_install-conda)
24+
More details available [here](https://developers.google.com/earth-engine/guides/python_install-conda)
25+
26+
# Running the notebooks
27+
28+
As they are currently set up, each of these scripts will run the aggregations and export them to a Google Cloud Storage bucket. In order to replicate this code, you will need to set up a separate GCS bucket, or export to Google Drive. These exports are then downloaded and processed in the `combine_gadm.ipynb` notebook. Note that storage in GCS is not free, but the costs are minimal for the amount of data we are exporting. As of 2024, we had to pay about $2.5 per month for storage.

src/raster_aggregations/README.md

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -8,3 +8,4 @@ This folder contains sub-folders to handle aggregation of specific type of local
88
Supporting scripts:
99

1010
- `zonal_stats_raster.R`: the main component of the pipeline that contains a function that does the raster aggregation given a raster file.
11+

0 commit comments

Comments
 (0)