Repository navigation
Apache Sedona 1.8.0
Binary download link: https://sedona.apache.org/1.8.0/download/
Release notes: https://sedona.apache.org/1.8.0/setup/release-notes/
Maven coordinate: https://sedona.apache.org/1.8.0/setup/maven-coordinates/
What's Changed
- [SEDONA-720] Add GeoPandas Compatible API on Sedona - framework by @zhangfengcdt in #1843
- build(deps): bump net.snowflake:snowflake-jdbc from 3.22.0 to 3.23.1 in /snowflake-tester by @dependabot[bot] in #1856
- [DOCS] Update the release script and docs by @jiayuasu in #1857
- [DOCS] Add 1.7.1 release news by @jiayuasu in #1858
- [SEDONA-722] Fix precision loss problems caused by casting world coordinates from double to float by @Kontinuation in #1860
- [SEDONA-704] Optimize STAC reader and fix few issues by @zhangfengcdt in #1861
- [DOCS] Bump Sedona versions in doc by @jiayuasu in #1862
- [SEDONA-715] Unify Zeppelin and Jupyter setting in Docker by @sshiv012 in #1850
- [DOCS] add missing useSpheroid argument to ST_DBSCAN docs by @james-willis in #1870
- [SEDONA-724] Fix RS_ZonalStats and RS_ZonalStatsAll edge case bug by @furqaankhan in #1871
- [GH-1868] Fix spark sql extension load failure when parser failed to load by @zhangfengcdt in #1872
- [SEDONA-726] Fix ST_Force_2D and add ST_Force2D by @furqaankhan in #1876
- [DOCS] Update the Databricks doc to reflect issues on DBR 16 by @jiayuasu in #1877
- [DOCS] Re-enable GitHub discussion due to ASF Infra change by @jiayuasu in #1878
- [DOCS] Add notification target for GitHub Discussions by @jiayuasu in #1879
- [SEDONA-704] Add the grid extension to the stac reader by @zhangfengcdt in #1883
- [CI] pre-commit(scala): auto add and standardize license headers by @jbampton in #1880
- [DOCS] Fix case / spelling by @jbampton in #1882
- [DOCS] Format Python Markdown codeblocks with black by @jbampton in #1881
- [CI] pre-commit(insert-license): fix bug in comment markers for .c an… by @jbampton in #1884
- [CI] Add prettier pre-commit hook and format YAML files by @jbampton in #1716
- [DOCS] Fix spelling in Java code by @jbampton in #1887
- [CI] Update CODEOWNERS add @jbampton for pre-commit config by @jbampton in #1891
- [GH-1886] Create EnvelopeAccumulator class by @james-willis in #1885
- chore: standardize spelling in Java code by @jbampton in #1892
- [CI] Clean up the ignored words list
codespell.txtby @jbampton in #1890 - [CI] Update CODEOWNERS add reviewers for linters by @jbampton in #1894
- [CI] pre-commit: add
requirements-docs.txttorequirements-txt-fixerby @jbampton in #1889 - [SEDONA-727] Relocate ST_LabelPoint to alphabetical order in docs by @prantogg in #1896
- [SEDONA-728] Fix Rasterization clamping bug by @prantogg in #1897
- [CI] Add pre-commit hook
pyupgradeto auto upgrade Python syntax by @jbampton in #1638 - [SEDONA-721] Add Sedona vectorized udf for Python by @Imbruced in #1859
- build(deps): bump r-lib/actions from 2.11.2 to 2.11.3 by @dependabot[bot] in #1899
- Clean up and order
.gitignoreby @jbampton in #1904 - [CI] Optimize docs workflow; pip install -r requirements-docs.txt by @jbampton in #1901
- [CI] pre-commit: run prettier on JavaScript files by @jbampton in #1902
- [DOCS] Fix Referer of matomo tracking pixel by @Kontinuation in #1907
- [GH-1900] Fixing ActionLint suggestions on Github Action files by @MadhuriRathod30 in #1906
- [GH-1905] Increment Spark minor version in Databricks setup guide by @Kontinuation in #1912
- [GH-1495] Fix homepage layout bug in mobile view by @furqaankhan in #1913
- [DOCS] README: fix case / spelling of GitHub brand name by @jbampton in #1903
- build(deps): bump pypa/cibuildwheel from 2.22.0 to 2.23.2 by @dependabot[bot] in #1898
- [SEDONA-690] Set default metric to use Haversine for KNN join and code refactoring by @zhangfengcdt in #1909
- [SEDONA-720] Refactor GeoPandas Dataframe implementation by @zhangfengcdt in #1916
- [SEDONA-720] Refactor GeoPandas Series implementation by @zhangfengcdt in #1917
- [DOCS] Update the Discord invite link by @jiayuasu in #1921
- [SEDONA-731] add osm nodes parser by @Imbruced in #1920
- [GH-1922] ST_X/Y/Z ON null geometries by @jgoday in #1923
- [GH-1761] error when invalid ST_Subdivide maxVertices argument by @jgoday in #1926
- [DOCS] Fix the wrong discord link by @jiayuasu in #1927
- [CI] Fix failed Python build extension CI by @jiayuasu in #1928
- [SEDONA-732] Stop previously running jobs when after new push to the PR by @Imbruced in #1924
- [GH-1910] Import geopandas only when type checking by @oliverbeagley in #1929
- [GH-1931] Move packaging module import to geopandas try-except block by @oliverbeagley in #1932
- [DOCS] Add Feng Zhang as committer by @jbampton in #1935
- build(deps): bump pypa/cibuildwheel from 2.23.2 to 2.23.3 by @dependabot[bot] in #1933
- [DOCS] Fix typos by @jbampton in #1936
- [CI] pre-commit: autoupdate and update Node LTS version by @jbampton in #1937
- [SEDONA-725] restructure spark python package by @Imbruced in #1930
- [DOCS] Standardize Markdown filenames by @jbampton in #1938
- [DOCS] Fix links in Markdown files by @jbampton in #1940
- [CI] Standardize Python license headers by @jbampton in #1939
- [DOCS] Update setup for MkDocs and pre-commit; add missing dependency… by @jbampton in #1941
- [GH-1943] Upgrade to Java 11 by @jesspav in #1942
- [CI] Add Jess Pavlin to the whitelist of GitHub actions by @jiayuasu in #1948
- [SEDONA-734] Fix relation parsing in OSM reader by @Imbruced in #1947
- [SEDONA-735] Fix RS_Clip bug caused by AOI geometries smaller than pixel size by @prantogg in #1952
- [SEDONA-725] Add pyflink to Sedona. by @Imbruced in #1875
- [GH-1956][GH-1957] Drop support for Spark 3.3 and Python 3.7 by @Kimahriman in #1958
- [DOCS] updates to the snowflake tutorial: more examples + explicitly specify the DB schema by @cgauvi in #1962
- [GH-1945] Shade Jiffle and its dependencies by @Kontinuation in #1964
- [DOCS] update databricks setup instructions by @MrPowers in #1963
- [DOCS] Add 1.7.2 release notes by @jiayuasu in #1970
- [DOCS] Add missing Apache file headers by @jiayuasu in #1971
- [CI] Pre-commit update hooks and node version; fix markdown linter by @jbampton in #1969
- [GH-1973] Upgrade to GeoTools 33 by @jesspav in #1967
- [DOCS] update R README.md fix typo by @jbampton in #1972
- [CI] Add pre-commit hook check-json by @jbampton in #1311
- [CI] pre-commit auto add missing license headers by @jbampton in #1978
- [CI] gha: set default workflow permissions by @jbampton in #1976
- [GH-1980] Hardcoded file paths to local user files by @raveendra11 in #1981
- [CI] Fix issues with the sql function tests by @emmanuel-ferdman in #1983
- [DOCS] sedona distance by @MrPowers in #1986
- [DOCS] Fix discord badge image by @furqaankhan in #1989
- [CI] Add 2 more names to the collaborator list by @jiayuasu in #1991
- [GH-1993] Geopandas.Series repr() and to_geopandas() by @petern48 in #1990
- [GH-1998] Fix typo in install-scala page (#1998) by @Aashish-Jha-11 in #2000
- [CI] fix: Standardize the pre-commit config by @SumitGupta016 in #1999
- [GH-2002] Add params to KeplerGl constructor by @giswqs in #2003
- [GH-1918] Spark 4 support by @Kimahriman in #1919
- [GH-2004] Geopandas.GeoSeries: Implement Test Framework by @petern48 in #2005
- [DOCS] Fix issues in the Compile Sedona source code page to make it easy to setup dev environment by @petern48 in #2011
- [GH-2007] Geopandas.Dataframe: Fix constructor for pandas-on-pyspark and Sedona Geopandas input types by @petern48 in #2008
- [GH-2012] Add 'Closes #<issue_number>' to PR template by @petern48 in #2015
- [GH-2018] Geopandas.GeoSeries: Setup skeleton of functions and tests by @petern48 in #2019
- [GH-2004] Log advice for to_geopandas function and only use internal calls for constructor by @zhangfengcdt in #2030
- [CI] Rename
lintworkflow topre-commitby @jbampton in #2029 - [GH-2013] Geopandas.Series: Implement crs property and set_crs by @petern48 in #2014
- [GH-1996] Create object of S2Geography, and implement Point/Polyline/PolygonGeography with its encoder/decoder by @ZhuochengShang in #1992
- [GH-2020] Geopandas.GeoSeries: Implement .length and refactor process_geometry_column() by @petern48 in #2021
- [GH-2016] Geopandas.GeoSeries: Implement x(), y(), z(), has_z by @petern48 in #2017
- chore: remove tabs and indent code by @jbampton in #2033
- [GH-2037] Implement _row_wise_operation + intersection, intersect by @petern48 in #2038
- [GH-2025] Geopandas.GeoSeries: Implement is_valid, is_empty, is_simple by @petern48 in #2026
- [GH-2022] Geopandas.GeoSeries: Implement geom_type by @petern48 in #2023
- [GH-2039] Geopandas.GeoSeries: Implement from_wkb, from_wkt, from_xy + temp init fix by @petern48 in #2040
- [GH-2047] Geopandas.GeoSeries: Implement to_crs by @petern48 in #2048
- [GH-1996] Shade S2 and Guava into runtime JARs by @Kontinuation in #2054
- [GH-2050] Geopandas.GeoSeries: Implement align=False for _row_wise_operation + support indexes by @petern48 in #2057
- [GH-2062] Fix failing Geopandas tests after recent PR merges by @petern48 in #2063
- [GH-2043] Geopandas.GeoSeries: Implement is_valid_reason, make_valid by @petern48 in #2044
- [GH-2031] Geopandas.GeoSeries: Implement isna, notna and aliases (isnull, notnull) by @petern48 in #2032
- [SEDONA-740] Fix rasterization rounding issue by @prantogg in #2065
- [DOC] Add Sphinx Doc Build Framework to Sedona Python by @zhangfengcdt in #2064
- [GH-2072] Fix Structured Adapter Issue with Spatial Queries by @zhangfengcdt in #2073
- [GH-2055] Geopandas.GeoSeries: Implement estimate_utm_crs, bounds, total_bounds, getitem by @petern48 in #2056
- [GH-2066] Implement spatial index sindex query() and unit tests by @zhangfengcdt in #2067
- [CI] Remove duplicate versions matrix entry in python.yml by @petern48 in #2076
- [GH-2028] Implementations of GeographyCollection & ShapeIndexGeography on S2Geography Apache Sedona by @ZhuochengShang in #2027
- [GH-2082] Implement nearest Method for GeoPandas Spatial Index by @zhangfengcdt in #2084
- [CI] pre-commit: update hooks, node, prettier; fix oxipng by @jbampton in #2078
- [GH-2083] Implement intersection Method for GeoPandas.SpatialIndex by @zhangfengcdt in #2088
- [GH-2079] Store geometries in EWKB format in spark df and enforce it by @petern48 in #2080
- [GH-2049] Retain index information in query results by @petern48 in #2086
- [GH-2070] Geopandas.GeoSeries: Implement
get_geometryby @petern48 in #2071 - [GH-2041] Implement boundary, centroid, envelope by @petern48 in #2042
- [DOCS] standing up blog infra by @kadolor in #2081
- [CI] Add one more GitHub collaborator by @jiayuasu in #2093
- [GH-2074] Add libpostal integration by @james-willis in #2077
- [GH-2052] Implement geospatial functions of Distance, Predicates, Projection by @ZhuochengShang in #2051
- [GH-2045] Geopandas.GeoSeries: Implement fillna by @petern48 in #2046
- [GH-2006] Geopandas: set_geometry, rename_geometry, active_geometry_name + refactor tests by @petern48 in #2058
- [GH-2066] Fix the Geopandas sindex query method predicate logic by @zhangfengcdt in #2099
- [CI] Remove ShapefileRDD Test by @jesspav in #2089
- [DOCS] moving title to yml frontmatter by @kadolor in #2107
- [GH-2100] Enhance geopandas sjoin implementation by @zhangfengcdt in #2101
- [GH-2112] Geopandas.GeoSeries: Implement
to_wktandto_wkbby @petern48 in #2113 - [SEDONA-738] Add moran i autocorrelation. by @Imbruced in #1975
- [GH-2108] Geopandas.GeoSeries: Implement
union_allaggregation by @petern48 in #2109 - [GH-2060] Geopandas.GeoSeries: Implement crosses, overlaps, touches, within, covers, covered_by, contains, distance by @petern48 in #2061
- [DOCS] Enhance GeoPandas classes documentation and organization by @zhangfengcdt in #2119
- [GH-2122] Fix deserialization of geometry SRID in python by @Kontinuation in #2123
- [GH-2095] Geopandas: Implement Scalable workaround and store as geometries instead of EWKB by @petern48 in #2121
- [GH-2120] Support serializing LinearRing in C bindings for Python interface by @petern48 in #2124
- [GH-2125] Fix STAC reader to accept tuples for datetime parameter by @zhangfengcdt in #2126
- [GH-2116] Geopandas.GeoSeries: Implement
differenceanddwithinby @petern48 in #2117 - [GH-2127] Add Shapely and WKT geometry support to STAC reader by @zhangfengcdt in #2128
- [GH-2085] use graphframes 0.9.0 by @james-willis in #2098
- [GH-2134] Fix bug where get_crs logic won't work if first element is null by @petern48 in #2135
- [GH-1742] Add comprehensive VSCode development guide by @Subham-KRLX in #2114
- [GH-2129] Geopandas: Refactor to use Spark Dataframe API instead of Spark SQL by @petern48 in #2131
- [GH-2091] WKB, WKT reader & writer by @ZhuochengShang in #2090
- [GH-2140] make DataFrameShims usable outside of sedona by @james-willis in #2141
- [GH-2142] Fix STAC python unit tests for remote endpoint by @zhangfengcdt in #2143
- [GH-2102] make ST_ and RS_ function expression classes package private by @james-willis in #2132
- [GH-2104] Geopandas: Implement
to_json,to_arrow,from_arrowby @petern48 in #2105 - [GH-2097] Geopandas: Clean up tests, reduce test time, add LinearRing tests by @petern48 in #2145
- [GH-2110] Geopandas.GeoSeries: Implement simplify and snap by @petern48 in #2111
- [GH-2136] Add redirection and warnings for old Python public functions by @jiayuasu in #2146
- [GH-2152] fix: prevent information disclosure through exception messages in STAC client by @zhangfengcdt in #2153
- [GH-2154] fix: Order by index col in _query_geometry_column by @petern48 in #2155
- [CI] Create basic CodeQL Analysis file by @jbampton in #2156
- [DOCS] Update Discord badge to resolve broken link in README by @Subham-KRLX in #2151
- [CI] Update codeql.yml change branch from
maintomasterby @jbampton in #2160 - [GH-2164] fix RasterType legacy import path by @james-willis in #2165
- [GH-2149] Geopandas: Implement
to_file,from_file,read_fileby @petern48 in #2150 - [GH-2174] Security issues in the STAC client api by @zhangfengcdt in #2168
- [GH-2087] Geopandas: Share geoseries functions in base class to implement them for geodataframe by @petern48 in #2163
- [CI] pre-commit add hook
check-zip-file-is-not-committedby @jbampton in #2172 - [GH-2716] Always use native byte order when writing WKBs by @Kontinuation in #2177
- [DOCS] README: Add
Star History ChartandContributors Avatarsby @jbampton in #2181 - [GH-2169] Clean up Geopandas Documentation after the refactor by @petern48 in #2170
- [GH-2161] Add constructor tests and re-enable more linear ring tests by @petern48 in #2162
- [GH-1755] Implement ST_Segmentize function and geopandas.segmentize() by @petern48 in #2179
- [GH-1643] Add
mvn spotless:applyas a pre-commit hook by @jbampton in #2188 - [GH-2166] More pathing fixes for Python package refactor by @james-willis in #2167
- [GH-2183] Fix ST_Buffer logic cap_style when specifying 'side' parameter + Implement rest of geoseries.buffer() by @petern48 in #2184
- [GH-2192] Geopandas: Implement
plot()for GeoDataFrame and GeoSeries +read_parquetby @petern48 in #2193 - [DOC] Clean up the Sphinx documentation build warnings and errors by @zhangfengcdt in #2191
- [CI] Add Python API Documentation to CI/CD Pipeline by @zhangfengcdt in #2195
- [GH-2204] Fix snowflake tests for ST_Segmentize by @petern48 in #2205
- [DOCS] Fix typo by @jbampton in #2207
- [CI] pre-commit: add
doctochook by @jbampton in #2199 - [GH-2201] Geopandas: Optimize crs operations, getitem, and set_geometry + impl scalable getitem by @petern48 in #2203
- [CI] Fix the python api build failed to import module errors by @zhangfengcdt in #2196
- [CI] pre-commit: add hook to check Makefiles are indented with tabs by @jbampton in #2206
- [CI] pre-commit: add hook
chmodwithmanualstage by @jbampton in #2200 - [GH-2182] Add blacken-docs with pre-commit to run Black on Python code blocks in documentation files by @Gautam3994 in #2190
- [SEDONA-741] Make ST_DWithin and ST_DistanceSpheroid filters to push down by @prantogg in #2214
- [GH-2215] Retain sindex, make sindex.query return geometries, implement has_sindex by @petern48 in #2216
- [GH-2218] Fix index retaining behavior for row_wise_operations on dataframes by @petern48 in #2219
- [GH-2208] Geopandas: Fix sjoin implementation + proper naming and index behavior by @petern48 in #2209
- [GH-2194] Move sedona.geopandas to sedona.spark.geopandas by @petern48 in #2225
- [GH-2222] add Singlepoint, Singlepolyline for correctlty round trip WKT write by @ZhuochengShang in #2221
- [SEDONA-742] Push down ST_DistanceSphere filter by @prantogg in #2238
- [GH-2198] Update mkdocs.yml and improve documentation structure by @jjestrada2 in #2239
- [DOCS] Add all workflow buttons to the README by @jbampton in #2233
- [GH-2231] Implement is_ring by @petern48 in #2232
- [DOCS] Add two more project buttons to the README by @jbampton in #2241
- [GH-2227] Add Geopandas Developer Guide README.md by @petern48 in #2229
- [GH-2242] Geopandas: Remove orderBy in query_geometry_column by @petern48 in #2243
- [DOCS] Add Geography function template by @jiayuasu in #2244
- [GH-2224] Register S2Geography UDT as Geography UDT into Apache Sedona by @ZhuochengShang in #2223
- [DOC] Fix RST formatting: Use double backticks for inline code in documentation by @zhangfengcdt in #2248
- [DOC] Fix documentation structure after moving sedona.geopandas to sedona.spark.geopandas by @zhangfengcdt in #2249
- [CI] pre-commit: add three hooks that target
RSTfiles by @jbampton in #2220 - [GH-2252] Deprecation warnings pop up in the wrong place by @jiayuasu in #2253
- [GH-2255]add test for ST_GeogFromWKB(byte array) by @ZhuochengShang in #2256
- [GH-2258] add MULTIPOLYGON Type in Geography by @ZhuochengShang in #2257
- [DOCS] Replace old pypistats badges with Pepy tech badges by @jiayuasu in #2259
- [DOC] Add the Python documentation links to the main navigation by @zhangfengcdt in #2268
- [GH-2266] Geopandas: Remove unnecessary old_crs check and in
to_crsby @petern48 in #2267 - [GH-2264] Geopandas: Support other of type GeoDataframe in row_wise_operations by @petern48 in #2265
- [GH-2269] Geopandas: Fix geodataframe.copy() to properly create a copy by @petern48 in #2270
- [GH-2273] Fix GeoPandas errors and issues in the examples by @zhangfengcdt in #2274
- [GH-2263]add new constructor ST_GeogFromEWKT by @ZhuochengShang in #2262
- [GH-2261]add new constructor ST_GeogFromEKWB by @ZhuochengShang in #2260
- [GH-2272]add new constructor ST_GeogFromGeoHash by @ZhuochengShang in #2271
- [GH-2279] Geopandas: Support sjoin with
coversandcovered_bypredicates by @petern48 in #2280 - [GH-2288] Make it clear sindex queries doesn't support GeoSeries as input by @petern48 in #2289
- [GH-2276] new constructor of convert Geography to Geometry by @ZhuochengShang in #2275
- [GH-2292] Fix the missing import paths for some stats functions (#483) by @jiayuasu in #2293
- [GH-2294] Introduce XYZM support in GeoJSON reader and writer by @jiayuasu in #2295
- [GH-2281] Geopandas: set ps option 'compute.ops_on_diff_frames' to True by default by @petern48 in #2282
- [GH-2250] Making GeoParquetFileFormat self-contained to avoid problems on Databricks by @Kontinuation in #2297
- [GH-2300] Usage of transformUpWithPruning prevents sedona from working on Databricks by @Kontinuation in #2301
- [GH-2304]add Multipolygon encode / decode by @ZhuochengShang in #2303
- [SEDONA-743] Add geom from mysql function, to support loading MySQL geometry object directly to Sedona. by @Imbruced in #2287
- [GH-2036] update more robust instream count for Geography decode by @ZhuochengShang in #2305
- [GH-2302] add constructor of Geometry to Geography by @ZhuochengShang in #2298
- [GH-2286] ST_Envelope on Geography by @ZhuochengShang in #2285
- [GH-2277] Geopandas: Fix to_file inferring parquet format instead of geoparquet by @petern48 in #2278
- [GH-2299] add function of ST_AsEWKT by @ZhuochengShang in #2309
- [GH-2308] Fix the precision lost issue in OSM PBF reader by @jiayuasu in #2312
- [GH-2290] Update the Databricks instruction for the Python API by @jiayuasu in #2315
- [GH-2316] Fix graphframes dependency across Spark major versions by @Kimahriman in #2317
- [GH-2318] Reapply Geopandas doc improvements and add io section to docs by @petern48 in #2319
- [GH-2314] Remove unexpected mandatory Python dependencies by @jiayuasu in #2320
- [GH-2321] Remove unnecessary commons-lang dependency by @jiayuasu in #2322
- [GH-2312] Fix the precision lost issue in OSM PBF again by @jiayuasu in #2323
- [GH-2327] Add SedonaDB extra by @paleolimbot in #2328
- [GH-2331] Geopandas: Document differences of sindex compared to gpd + sindex fixes by @petern48 in #2332
- [DOCS] adding blacken-docs to docs requirements by @kadolor in #2336
- [DOCS] Adding H3 blog and associated images by @kadolor in #2333
- [DOCS] Add missing license headers by @jiayuasu in #2340
- [GH-2337] Fix the DateTimeParseException in GeoPackage reader by @jiayuasu in #2339
- [DOCS] Add GeoPandas API on Sedona tutorial by @jiayuasu in #2341
- [DOCS] Add 1.8.0 release notes and update corresponding docs by @jiayuasu in #2342
- [DOCS] Bump Sedona Python, R, Zeppelin versions by @jiayuasu in #2343
- [DOCS] Add Scarf telemetry to SedonaDB by @jiayuasu in #2345
New Contributors
- @MadhuriRathod30 made their first contribution in #1906
- @jgoday made their first contribution in #1923
- @oliverbeagley made their first contribution in #1929
- @jesspav made their first contribution in #1942
- @cgauvi made their first contribution in #1962
- @raveendra11 made their first contribution in #1981
- @Aashish-Jha-11 made their first contribution in #2000
- @SumitGupta016 made their first contribution in #1999
- @giswqs made their first contribution in #2003
- @ZhuochengShang made their first contribution in #1992
- @Gautam3994 made their first contribution in #2190
- @jjestrada2 made their first contribution in #2239
Full Changelog: sedona-1.7.1...sedona-1.8.0