Generate rollout grids

%matplotlib inline
%reload_ext autoreload
%autoreload 2
import sys

sys.path.append("../../../")
import os

import geopandas as gpd
import pandas as pd

from povertymapping.iso3 import get_region_name
from povertymapping.rollout_grids import get_region_filtered_bingtile_grids
/home/jace/workspace/unicef-ai4d-poverty-mapping/env/lib/python3.9/site-packages/geopandas/_compat.py:111: UserWarning: The Shapely GEOS version (3.11.1-CAPI-1.17.1) is incompatible with the GEOS version PyGEOS was compiled with (3.10.1-CAPI-1.16.0). Conversions between both will be slow.
  warnings.warn(

Generate Rollout Grids: Laos

This notebook is the second step in the rollout and generates the rollout grid tiles over the country. The output file is used as an input for Step 3, where we will run the trained model over the set of grids.

The generated grids are set at 2.4km (zoom level 14), matching the grids used during model training. The grids are also filtered to only include populated areas based on Meta’s High Resolution Settlement Layer (HRSL) data.

Set country-specific parameters

COUNTRY_CODE = "la"
REGION = get_region_name(COUNTRY_CODE, code="alpha-2").lower()
ADMIN_LVL = "ADM2"
ZOOM_LEVEL = 14

Generate Grids

admin_grids_gdf = get_region_filtered_bingtile_grids(
    REGION, admin_lvl=ADMIN_LVL, quadkey_lvl=ZOOM_LEVEL, use_cache=True
)
2023-04-02 23:30:36.854 | INFO     | povertymapping.rollout_grids:get_region_filtered_bingtile_grids:264 - No cached grids file found. Generating grids file :/home/jace/.cache/geowrangler/quadkey_grids/laos_14_ADM2_populated_admin_grids.geojson
2023-04-02 23:30:36.855 | DEBUG    | povertymapping.rollout_grids:get_region_filtered_bingtile_grids:281 - Loading boundaries for region laos and admin level ADM2
2023-04-02 23:30:37.048 | INFO     | povertymapping.rollout_grids:get_region_filtered_bingtile_grids:287 - Generating grids for region laos and admin level ADM2 at quadkey level 14
2023-04-02 23:30:59.997 | INFO     | povertymapping.rollout_grids:get_region_filtered_bingtile_grids:293 - Generated 44335 grids for region laos and admin level ADM2 at quadkey level 14
2023-04-02 23:31:00.004 | INFO     | povertymapping.rollout_grids:get_region_filtered_bingtile_grids:299 - Assigning grids to admin areas using metric crs epsg:3857
2023-04-02 23:31:03.953 | INFO     | povertymapping.rollout_grids:get_region_filtered_bingtile_grids:305 - Getting laos population data for filtering grids
2023-04-02 23:31:05.289 | INFO     | povertymapping.rollout_grids:get_region_filtered_bingtile_grids:307 - Computing population zonal stats per grid
2023-04-02 23:31:05.291 | INFO     | povertymapping.rollout_grids:compute_raster_stats:98 - Creating raster zonal stats for 44335 grids for file size 8294976524
2023-04-02 23:36:07.744 | INFO     | povertymapping.rollout_grids:get_region_filtered_bingtile_grids:318 - Filtering unpopulated grids based on population data
2023-04-02 23:36:07.764 | INFO     | povertymapping.rollout_grids:get_region_filtered_bingtile_grids:321 - Filtered admin grid count: 22133
/home/jace/workspace/unicef-ai4d-poverty-mapping/env/lib/python3.9/site-packages/geopandas/io/file.py:362: FutureWarning: pandas.Int64Index is deprecated and will be removed from pandas in a future version. Use pandas.Index with the appropriate dtype instead.
  pd.Int64Index,

Explore Populated Grids

admin_grids_gdf.info()
<class 'geopandas.geodataframe.GeoDataFrame'>
Int64Index: 22133 entries, 0 to 44334
Data columns (total 8 columns):
 #   Column      Non-Null Count  Dtype   
---  ------      --------------  -----   
 0   geometry    22133 non-null  geometry
 1   quadkey     22133 non-null  object  
 2   shapeName   22133 non-null  object  
 3   shapeISO    22133 non-null  object  
 4   shapeID     22133 non-null  object  
 5   shapeGroup  22133 non-null  object  
 6   shapeType   22133 non-null  object  
 7   pop_count   22133 non-null  float64 
dtypes: float64(1), geometry(1), object(6)
memory usage: 1.5+ MB
admin_grids_gdf.head(2)
geometry quadkey shapeName shapeISO shapeID shapeGroup shapeType pop_count
0 POLYGON ((100.06348 20.34463, 100.06348 20.365... 13220113003212 Tonpheung None LAO-ADM2-3_0_0-B114 LAO ADM2 1139.814456
1 POLYGON ((100.08545 20.36523, 100.08545 20.385... 13220113003211 Tonpheung None LAO-ADM2-3_0_0-B114 LAO ADM2 18.897820 
# Uncomment to view the generated grid on an interactive map
# admin_grids_gdf.explore()

Save to file

rollout_date = "-".join(os.getcwd().split("/")[-2].split("-")[:3])
grid_save_path = f"./{rollout_date}-{COUNTRY_CODE}-rollout-grids.geojson"
admin_grids_gdf.to_file(grid_save_path, driver="GeoJSON", index=False)