Commit Graph

845 Commits (013e395f5cddc2f8ab044ef8c9e4cd350f505683)

Author SHA1 Message Date
Oliver Tonnhofer c3f9992f18 initialize coordsBunch map with capacity size 2013-11-13 13:17:24 +01:00
Oliver Tonnhofer 4fe7379dcd transform nodes before checking against limito in diff import 2013-11-12 17:41:11 +01:00
Oliver Tonnhofer 63cf97eb01 make sure clipped geometries are DestroyedLayer 2013-11-12 12:06:46 +01:00
Oliver Tonnhofer 9d02c24ea0 limit ways and relations as well
only cache ways if the first coord is cached, only cache relations
if the first member is cached.

we need to sync the read process so that we have all coords cached
before the first way gets checked for limitto.
2013-11-12 09:21:17 +01:00
Oliver Tonnhofer 8959147ccf refactored parallel parser 2013-11-11 13:59:53 +01:00
Oliver Tonnhofer c0b5fe7430 close OSM/DiffCache after update 2013-11-11 13:41:09 +01:00
Oliver Tonnhofer e0404e7a1d add -quiet options to imposm3 diff 2013-11-11 10:39:44 +01:00
Oliver Tonnhofer ea2065b5ec do not open OSM/DiffCache for each Update 2013-11-11 10:16:59 +01:00
Oliver Tonnhofer aa632e2bd6 do not add prepared geometries to index 2013-11-11 09:41:41 +01:00
Oliver Tonnhofer 390edea938 add new Expireor interface 2013-11-08 16:22:41 +01:00
Oliver Tonnhofer f4a6192ae8 removed unused code 2013-11-08 16:03:42 +01:00
Oliver Tonnhofer 8a50a6cfe4 write replicationURL of last state in new state 2013-11-08 16:01:08 +01:00
Oliver Tonnhofer d560755a15 transform nodes to mercator before limiting in reader 2013-11-08 15:19:31 +01:00
Oliver Tonnhofer 59a14b7c9d remove skipped nodes before accessing first ID; skip empty node lists 2013-11-08 15:09:24 +01:00
Oliver Tonnhofer d7806c6cfd fix closing of nodes iter channel 2013-11-08 15:03:20 +01:00
Oliver Tonnhofer 129799328d fix race condition where leveldb is closed before the iterator
should solve assertion errors like:
db/version_set.cc:710: leveldb::VersionSet::~VersionSet(): Assertion `dummy_versions_.next_ == &dummy_versions_' failed
2013-11-08 10:18:14 +01:00
Oliver Tonnhofer 178aba56dd removed unused code 2013-11-07 17:49:14 +01:00
Oliver Tonnhofer e8f3e50dcf do not cache skipped nodes 2013-11-07 17:28:42 +01:00
Oliver Tonnhofer 6ad5a535a1 insert rels with negative IDs to be able to distinguish rels from ways during delete 2013-11-07 16:09:08 +01:00
Oliver Tonnhofer 063c48b8c3 report clipping that takes more than a minute 2013-11-07 15:49:40 +01:00
Oliver Tonnhofer 97854f4277 use logging.Warn instead of log.Println/fmt.Prinln 2013-11-07 15:48:55 +01:00
Oliver Tonnhofer 9ac14cc3da support insertedWays in -diff; handle delete of relations 2013-11-05 15:03:32 +01:00
Oliver Tonnhofer e246f5c14b delete/reinsert members of deleted relations 2013-11-05 11:34:03 +01:00
Oliver Tonnhofer 2cebe56d8f prevent SIGSEGV when building buffered limitto geometry 2013-11-04 16:00:19 +01:00
Oliver Tonnhofer 09665205ca always write last.state.txt after -read 2013-11-04 15:04:07 +01:00
Oliver Tonnhofer 9376230048 estimate diff sequence number of new imports 2013-11-04 15:02:28 +01:00
Oliver Tonnhofer af6510b008 enable concurrent writing explicitly 2013-11-04 14:33:32 +01:00
Oliver Tonnhofer a406864fd7 close database handles 2013-11-04 14:32:54 +01:00
Oliver Tonnhofer b67e7cec34 close diff file handle 2013-11-04 14:31:26 +01:00
Oliver Tonnhofer 7903a3293b close geojson file handle 2013-11-04 14:31:05 +01:00
Oliver Tonnhofer 21279a941e close file mapping handle 2013-11-04 14:30:32 +01:00
Oliver Tonnhofer 076926a417 renamed -limittodiffbuffer to -limittocachebuffer 2013-11-04 08:55:10 +01:00
Oliver Tonnhofer 2d2dad7b7e limit cache to -limitto 2013-11-04 08:51:21 +01:00
Oliver Tonnhofer 35e66529a7 force synchronous inserts during diff import
this makes sure that the source geometries for generalizes geometries
are inserted
2013-11-01 11:25:41 +01:00
Oliver Tonnhofer 5203225bcd improve limiter
- check complete contains first
- intersect with original geometry if it intersects to many parts
2013-10-31 18:21:21 +01:00
Oliver Tonnhofer 60a4eb7f4d allow -httpprofile for diff import 2013-10-30 11:14:34 +01:00
Oliver Tonnhofer 0461fd56fe move import main function to import_ package 2013-10-30 10:48:00 +01:00
Oliver Tonnhofer 3b3fa8f834 prevent multiple deletes of the same way/relation 2013-10-29 17:38:49 +01:00
Oliver Tonnhofer deda8e2816 log progress during writing of added/modified elements 2013-10-29 17:06:47 +01:00
Oliver Tonnhofer 122afae480 revert code change 2013-10-29 17:05:59 +01:00
Oliver Tonnhofer 93edef2681 refactored database API 2013-10-29 16:32:16 +01:00
Oliver Tonnhofer abb7734f8c refactored tableNames method 2013-10-29 15:30:51 +01:00
Oliver Tonnhofer 5d3ab6cbcc add comments 2013-10-29 15:11:58 +01:00
Oliver Tonnhofer d387f3cd24 remove unused InsertBuffer 2013-10-29 15:07:26 +01:00
Oliver Tonnhofer 5c59fe8a78 remove unused PostGIS.InsertBatch 2013-10-29 15:06:08 +01:00
Oliver Tonnhofer 337aeafcb8 refactored TxRouter 2013-10-29 15:00:52 +01:00
Oliver Tonnhofer eececc6164 remove print statement 2013-10-29 14:57:50 +01:00
Oliver Tonnhofer fb860b6736 add test-system and test-unit target 2013-10-29 14:08:39 +01:00
Oliver Tonnhofer 311bd01c81 update tests 2013-10-29 14:07:40 +01:00
Oliver Tonnhofer 8d95f50eeb create generalized tabels from other generalized tables 2013-10-29 11:40:09 +01:00