Nyall Dawson 9698444f4a [processing] Fix inefficiencies in Delete Duplicate Geometries algorithm ...

..and make progress bar more accurate.

Use a spatial index to avoid comparing every feature to every other
feature, and only compare against features with intersecting bounding
boxes instead. Also optimise feature requests and loop logic.

Benchmarks:

Point layer, 6000k features

Before: 30 seconds
After: 0.15 seconds

Point layer, 45k features

Before: > 10 minutes
After: 7 seconds

Fixes #19973

2018-09-29 07:37:53 +10:00

..

ui

[processing] Fix gdal algorithm use of old wrapper API

2018-09-11 15:40:27 +10:00

__init__.py

…

AddTableField.py

Messy mockup of feature

2018-09-14 18:23:03 +10:00

Aggregate.py

[processing] allow geometryless layers as input in aggregate alg.

2018-09-18 11:08:28 +07:00

Aspect.py

[processing] add group id to QGIS algorithms

2017-12-14 18:04:12 +02:00

BarPlot.py

[processing] Fix bar and box plot exception when category field has NULL values

2018-06-20 08:07:23 +10:00

BasicStatistics.py

[processing] Accept geometry-less layers in more algorithms

2018-08-25 15:41:13 +10:00

BoxPlot.py

[processing] Fix bar and box plot exception when category field has NULL values

2018-06-20 08:07:23 +10:00

Buffer.py

Spell check 'mitre' -> 'miter' (i.e. use en-us variation)

2017-08-07 18:08:57 +10:00

CheckValidity.py

Fix processing algorithm checkvalidity reason

2018-09-18 16:36:30 +02:00

CMakeLists.txt

[processing] turn keep n biggest parts script into normal algorithm

2018-02-05 08:50:44 +02:00

ConcaveHull.py

Fix imports for ConcaveHull

2018-09-14 13:24:57 +02:00

COPYING.fTools

Rename QGis class to Qgis, for capitalisation consistency

2016-07-21 22:01:38 +10:00

COPYING.mmqgis

…

CreateAttributeIndex.py

[processing] Create Attribute Index can run on non-spatial layers

2018-05-15 20:21:08 +10:00

CreateConstantRaster.py

Indentation

2018-06-15 06:39:48 +10:00

Datasources2Vrt.py

[processing] add group id to QGIS algorithms

2017-12-14 18:04:12 +02:00

DefineProjection.py

Processing: Avoid deprecated regex

2018-06-06 06:24:24 +10:00

Delaunay.py

[needs-docs][processing] vectorize and improve remaining geometry tools menu icons

2018-05-15 12:10:11 +07:00

DeleteColumn.py

Messy mockup of feature

2018-09-14 18:23:03 +10:00

DeleteDuplicateGeometries.py

[processing] Fix inefficiencies in Delete Duplicate Geometries algorithm

2018-09-29 07:37:53 +10:00

DensifyGeometries.py

[processing] Tweak api for QgsProcessingFeatureBasedAlgorithm

2018-02-21 09:16:43 +11:00

DensifyGeometriesInterval.py

[processing] Use distance parameter for more algorithms

2018-04-20 18:27:00 +10:00

EliminateSelection.py

[processing] improve eliminate selected polygons alg help

2018-05-01 10:43:13 +07:00

ExecuteSQL.py

[processing] Consist helpful error messages when sinks cannot be created

2018-04-28 05:50:47 +10:00

ExportGeometryInfo.py

[needs-docs][processing] rename export geom. columns to add geom. attributes

2018-05-15 12:10:11 +07:00

ExtentFromLayer.py

[needs-docs][processing] vectorize & improve remaining vector menu icons

2018-05-15 16:37:25 +07:00

ExtractSpecificVertices.py

[processing] Consist helpful error messages when sinks cannot be created

2018-04-28 05:50:47 +10:00

FieldPyculator.py

[processing] Accept geometry-less layers in more algorithms

2018-08-25 15:41:13 +10:00

FieldsCalculator.py

[processing] Accept geometry-less layers in more algorithms

2018-08-25 15:41:13 +10:00

FieldsMapper.py

Disable some more algs

2018-09-14 18:23:03 +10:00

FindProjection.py

[processing] Consist helpful error messages when sinks cannot be created

2018-04-28 05:50:47 +10:00

GeometryByExpression.py

Messy mockup of feature

2018-09-14 18:23:03 +10:00

GeometryConvert.py

[processing] Consist helpful error messages when sinks cannot be created

2018-04-28 05:50:47 +10:00

Grid.py

[needs-docs] Fix parameter's label and some distance default value

2018-08-30 05:10:42 +10:00

Heatmap.py

[needs-docs] Fix parameter's label and some distance default value

2018-08-30 05:10:42 +10:00

Hillshade.py

[processing] add group id to QGIS algorithms

2017-12-14 18:04:12 +02:00

HubDistanceLines.py

[processing] Consist helpful error messages when sinks cannot be created

2018-04-28 05:50:47 +10:00

HubDistancePoints.py

[processing] Consist helpful error messages when sinks cannot be created

2018-04-28 05:50:47 +10:00

HypsometricCurves.py

[processing] More helpful errors when sources cannot be loaded

2018-04-28 05:50:47 +10:00

IdwInterpolation.py

Followup a463858, fix failing tests

2018-04-20 08:38:15 +10:00

ImportIntoPostGIS.py

[processing] Accept geometry-less layers in more algorithms

2018-08-25 15:41:13 +10:00

ImportIntoSpatialite.py

[processing] Accept geometry-less layers in more algorithms

2018-08-25 15:41:13 +10:00

KeepNBiggestParts.py

[processing] Consist helpful error messages when sinks cannot be created

2018-04-28 05:50:47 +10:00

KNearestConcaveHull.py

Improve test coverage for k-nearest neighbor concave hull

2018-09-14 11:44:53 +02:00

LinesToPolygons.py

Fix some exceptions when running in-place edit on geometry-less layer

2018-09-21 18:15:46 +10:00

MeanAndStdDevPlot.py

[processing] More helpful errors when sources cannot be loaded

2018-04-28 05:50:47 +10:00

MinimumBoundingGeometry.py

Add vector icons to some qgs algorithms (fixes #19082) (#7149)

2018-06-04 13:32:56 +07:00

NearestNeighbourAnalysis.py

[needs-docs][processing] vectorize and improve remaining data analysis menu icons

2018-05-15 16:37:25 +07:00

Orthogonalize.py

[processing] Tweak api for QgsProcessingFeatureBasedAlgorithm

2018-02-21 09:16:43 +11:00

PointDistance.py

[needs-docs][processing] vectorize and improve remaining data analysis menu icons

2018-05-15 16:37:25 +07:00

PointsAlongGeometry.py

[processing] Use distance parameter for Points Along Geometry offsets

2018-08-28 10:21:10 +10:00

PointsDisplacement.py

Rename QgsSpatialIndex::insertFeature to ::addFeature, for consistency

2018-09-29 07:37:53 +10:00

PointsFromLines.py

[processing] fix incorrect output names

2018-08-26 11:26:07 +03:00

PointsFromPolygons.py

[processing] fix incorrect output names

2018-08-26 11:26:07 +03:00

PointsInPolygon.py

[processing] Remove unnecessary index creation in points in polygons

2018-09-25 05:20:25 +10:00

PointsLayerFromTable.py

[processing] Consist helpful error messages when sinks cannot be created

2018-04-28 05:50:47 +10:00

PointsToPaths.py

[processing] Consist helpful error messages when sinks cannot be created

2018-04-28 05:50:47 +10:00

PolarPlot.py

[processing] More helpful errors when sources cannot be loaded

2018-04-28 05:50:47 +10:00

PoleOfInaccessibility.py

[processing] Use distance parameter for Points Along Geometry offsets

2018-08-28 10:21:10 +10:00

Polygonize.py

[processing] Consist helpful error messages when sinks cannot be created

2018-04-28 05:50:47 +10:00

PolygonsToLines.py

Fix some exceptions when running in-place edit on geometry-less layer

2018-09-21 18:15:46 +10:00

PostGISExecuteAndLoadSQL.py

[processing][needs-docs] Refine names for 'Import into PostGIS' algs

2018-08-21 16:00:18 +10:00

PostGISExecuteSQL.py

[processing][needs-docs] Refine names for 'Import into PostGIS' algs

2018-08-21 16:00:18 +10:00

QgisAlgorithm.py

Port some existing algorithms to QgsProcessingFeatureBasedAlgorithm

2017-07-18 19:41:33 +10:00

QgisAlgorithmProvider.py

[processing] Default to hiding help button for algorithms

2018-09-26 04:26:49 +10:00

RandomExtract.py

[processing] Consist helpful error messages when sinks cannot be created

2018-04-28 05:50:47 +10:00

RandomExtractWithinSubsets.py

[processing] log cases when subset is smaller than requested number of

2018-07-04 19:15:29 +03:00

RandomPointsAlongLines.py

Rename QgsSpatialIndex::insertFeature to ::addFeature, for consistency

2018-09-29 07:37:53 +10:00

RandomPointsExtent.py

Rename QgsSpatialIndex::insertFeature to ::addFeature, for consistency

2018-09-29 07:37:53 +10:00

RandomPointsLayer.py

Rename QgsSpatialIndex::insertFeature to ::addFeature, for consistency

2018-09-29 07:37:53 +10:00

RandomPointsPolygons.py

Rename QgsSpatialIndex::insertFeature to ::addFeature, for consistency

2018-09-29 07:37:53 +10:00

RandomSelection.py

[processing] Fix random selection algorithm when filter is set on layer

2018-06-28 15:02:06 +10:00

RandomSelectionWithinSubsets.py

[processing] log cases when subset is smaller than requested number of

2018-07-04 19:15:29 +03:00

RasterCalculator.py

more compact if

2018-09-04 15:46:42 +02:00

Rasterize.py

Update Rasterize.py

2017-12-21 17:55:02 +01:00

RasterLayerHistogram.py

[processing] remove explicit outputs definitions

2018-03-02 10:35:56 +02:00

RasterLayerStatistics.py

[processing] remove explicit outputs definitions

2018-03-02 10:35:56 +02:00

RasterSampling.py

[processing] be more flexible with multipoint layers, allow sampling for single part point

2018-07-28 12:30:06 +07:00

RectanglesOvalsDiamondsFixed.py

[processing] Consist helpful error messages when sinks cannot be created

2018-04-28 05:50:47 +10:00

RectanglesOvalsDiamondsVariable.py

[processing] Fix Rectangles/Ovals/...(variable) chokes on angle values of 0

2018-05-31 08:55:26 +10:00

RegularPoints.py

[processing] Minor optimization for regular points algorithm

2018-08-15 10:23:02 +10:00

Relief.py

[processing] Don't create frequency distribution file for relief

2018-08-09 19:17:30 +10:00

Ruggedness.py

Fix build with Qt 5.5

2018-04-10 10:15:19 +10:00

SelectByAttribute.py

[Processing][Needs-docs] Allow optional "value" in "select by attribute" algorithm

2018-08-30 05:10:21 +10:00

SelectByExpression.py

[processing][needs-docs] add selection methods to Select by attribute

2018-05-16 11:20:09 +03:00

ServiceAreaFromLayer.py

[processing] More helpful errors when sources cannot be loaded

2018-04-28 05:50:47 +10:00

ServiceAreaFromPoint.py

[processing] More helpful errors when sources cannot be loaded

2018-04-28 05:50:47 +10:00

SetMValue.py

Fix in-place support check for some more algs

2018-09-14 18:23:03 +10:00

SetRasterStyle.py

[processing] Default to allowing background execution of algorithms

2018-01-29 17:37:05 +11:00

SetVectorStyle.py

[processing] Default to allowing background execution of algorithms

2018-01-29 17:37:05 +11:00

SetZValue.py

Fix in-place support check for some more algs

2018-09-14 18:23:03 +10:00

SingleSidedBuffer.py

[processing] Add dedicated "distance" parameter

2018-04-20 18:27:00 +10:00

Slope.py

[processing] add group id to QGIS algorithms

2017-12-14 18:04:12 +02:00

SnapGeometries.py

Moved new snapping alg as another mode of "Snap geometries" processing alg

2018-09-13 16:24:37 +02:00

SpatialIndex.py

[processing] Default to allowing background execution of algorithms

2018-01-29 17:37:05 +11:00

SpatialiteExecuteSQL.py

[processing] Also standardise names for Spatialite algorithms

2018-08-21 16:00:18 +10:00

SpatialJoin.py

Fix 'equals' predicate in SpatialJoin

2018-08-29 01:07:08 +02:00

SpatialJoinSummary.py

Fix 'equals' predicate in SpatialJoinSummary

2018-08-29 01:09:53 +02:00

StatisticsByCategories.py

Typo

2018-06-20 15:06:36 +10:00

SumLines.py

[needs-docs][processing] vectorize and improve remaining data analysis menu icons

2018-05-15 16:37:25 +07:00

TextToFloat.py

Disable some more algs

2018-09-14 18:23:03 +10:00

TinInterpolation.py

[processing] restore TIN / IDW interpolation algorithms

2018-04-19 17:19:07 +07:00

TopoColors.py

Rename QgsSpatialIndex::insertFeature to ::addFeature, for consistency

2018-09-29 07:37:53 +10:00

TruncateTable.py

[processing] Default to allowing background execution of algorithms

2018-01-29 17:37:05 +11:00

UniqueValues.py

[needs-docs][processing] vectorize and improve remaining data analysis menu icons

2018-05-15 16:37:25 +07:00

VariableDistanceBuffer.py

Add vector icons to some qgs algorithms (fixes #19082) (#7149)

2018-06-04 13:32:56 +07:00

VectorLayerHistogram.py

[processing] More helpful errors when sources cannot be loaded

2018-04-28 05:50:47 +10:00

VectorLayerScatterplot3D.py

[processing] More helpful errors when sources cannot be loaded

2018-04-28 05:50:47 +10:00

VectorLayerScatterplot.py

[processing] More helpful errors when sources cannot be loaded

2018-04-28 05:50:47 +10:00

VectorSplit.py

[processing] add some missing icons for the data management tools menu

2018-04-30 16:50:34 +07:00

voronoi.py

Remove try-except block in voronoi.py fixes #19798

2018-09-08 14:38:25 +10:00

VoronoiPolygons.py

fix hasYMax variable

2018-09-06 06:52:23 +10:00

ZonalStatistics.py

Prevent background execution of zonal stats

2018-06-08 10:13:13 +10:00