Commit Graph

523 Commits (3b73f91a0d144524b6b9bac7011ffc9e90276e58)

Author SHA1 Message Date
Oliver Tonnhofer 69d08caec1 optimize number of goroutines during reading 2013-12-12 20:14:52 +01:00
Oliver Tonnhofer 2cce36c31f fix automatic version numbering 2013-12-02 15:08:22 +01:00
Oliver Tonnhofer fdb34b7b4c remove duplicate geojson reader code 2013-12-02 14:13:53 +01:00
Oliver Tonnhofer e8f4098e18 automatically transform GeoJSON in WGS84 to webmercator 2013-12-02 14:13:31 +01:00
Oliver Tonnhofer 804da8614b return errors from newTxRouter 2013-12-02 14:01:58 +01:00
Oliver Tonnhofer 3901c5d8c4 make db schema configurable from cmd-line and config.json 2013-12-02 13:10:42 +01:00
Oliver Tonnhofer 122bfc4f31 do not auto destroy BoundsPolygon 2013-12-02 11:43:44 +01:00
Oliver Tonnhofer 34cf674fa0 read geojson with z-values 2013-11-26 09:47:00 +01:00
Oliver Tonnhofer 7e57c6047b do not leak Ticker in closed stats reporter 2013-11-25 09:12:41 +01:00
Oliver Tonnhofer a4ea44acb1 pool idRefs/bytes in diff cache 2013-11-20 09:21:26 +01:00
Oliver Tonnhofer c3a7be1ab2 don't set cache to nil after flushing 2013-11-19 15:47:33 +01:00
Oliver Tonnhofer 83405d2e4b move command handling to cmd package 2013-11-19 15:39:57 +01:00
Oliver Tonnhofer 1309a2f478 add Flush to diff cache 2013-11-19 15:07:40 +01:00
Oliver Tonnhofer b86ecff037 close levigo.Read/WriteOptions 2013-11-19 15:07:26 +01:00
Oliver Tonnhofer 95aa490208 use binary.Varint instead of binary.ReadVarint in UnmarshalIdRefsBunch 2013-11-19 08:41:39 +01:00
Oliver Tonnhofer 596f4de970 marshal length as unsigned varint 2013-11-19 08:40:27 +01:00
Oliver Tonnhofer fbbf29d167 use binary.Varint instead of binary.ReadVarint in UnmarshalDeltaNodes 2013-11-18 17:24:31 +01:00
Oliver Tonnhofer 287ba72f42 make main callable from outside for testing 2013-11-15 11:11:12 +01:00
Oliver Tonnhofer 1feff96db8 use lib/pq for postgres 2013-11-14 09:15:16 +01:00
Oliver Tonnhofer 2d1c98022f remove go vet warnings 2013-11-13 15:41:34 +01:00
Oliver Tonnhofer 9e0fd75fb3 improve logger
print level, do not display stopped progress
2013-11-13 15:26:34 +01:00
Oliver Tonnhofer 9e5e60abc4 handle diff update errors outside of Update 2013-11-13 15:26:22 +01:00
Oliver Tonnhofer d4dd4731d9 add VERBOSE option to test Makefile 2013-11-13 13:30:41 +01:00
Oliver Tonnhofer 62234d49b1 import with -optimize in test-system 2013-11-13 13:30:19 +01:00
Oliver Tonnhofer a9b490419c ANALYSE table after CLUSTER 2013-11-13 13:30:00 +01:00
Oliver Tonnhofer ee8d50addd reset cached bunches when flushing DeltaCoordsCache 2013-11-13 13:29:33 +01:00
Oliver Tonnhofer ca7d7efe7d set cache.BlockSizeK in KB not MB 2013-11-13 13:20:06 +01:00
Oliver Tonnhofer 4eecb7fb94 reuse freeNodes 2013-11-13 13:17:54 +01:00
Oliver Tonnhofer c3f9992f18 initialize coordsBunch map with capacity size 2013-11-13 13:17:24 +01:00
Oliver Tonnhofer 4fe7379dcd transform nodes before checking against limito in diff import 2013-11-12 17:41:11 +01:00
Oliver Tonnhofer 63cf97eb01 make sure clipped geometries are DestroyedLayer 2013-11-12 12:06:46 +01:00
Oliver Tonnhofer 9d02c24ea0 limit ways and relations as well
only cache ways if the first coord is cached, only cache relations
if the first member is cached.

we need to sync the read process so that we have all coords cached
before the first way gets checked for limitto.
2013-11-12 09:21:17 +01:00
Oliver Tonnhofer 8959147ccf refactored parallel parser 2013-11-11 13:59:53 +01:00
Oliver Tonnhofer c0b5fe7430 close OSM/DiffCache after update 2013-11-11 13:41:09 +01:00
Oliver Tonnhofer e0404e7a1d add -quiet options to imposm3 diff 2013-11-11 10:39:44 +01:00
Oliver Tonnhofer ea2065b5ec do not open OSM/DiffCache for each Update 2013-11-11 10:16:59 +01:00
Oliver Tonnhofer aa632e2bd6 do not add prepared geometries to index 2013-11-11 09:41:41 +01:00
Oliver Tonnhofer 390edea938 add new Expireor interface 2013-11-08 16:22:41 +01:00
Oliver Tonnhofer f4a6192ae8 removed unused code 2013-11-08 16:03:42 +01:00
Oliver Tonnhofer 8a50a6cfe4 write replicationURL of last state in new state 2013-11-08 16:01:08 +01:00
Oliver Tonnhofer d560755a15 transform nodes to mercator before limiting in reader 2013-11-08 15:19:31 +01:00
Oliver Tonnhofer 59a14b7c9d remove skipped nodes before accessing first ID; skip empty node lists 2013-11-08 15:09:24 +01:00
Oliver Tonnhofer d7806c6cfd fix closing of nodes iter channel 2013-11-08 15:03:20 +01:00
Oliver Tonnhofer 129799328d fix race condition where leveldb is closed before the iterator
should solve assertion errors like:
db/version_set.cc:710: leveldb::VersionSet::~VersionSet(): Assertion `dummy_versions_.next_ == &dummy_versions_' failed
2013-11-08 10:18:14 +01:00
Oliver Tonnhofer 178aba56dd removed unused code 2013-11-07 17:49:14 +01:00
Oliver Tonnhofer e8f3e50dcf do not cache skipped nodes 2013-11-07 17:28:42 +01:00
Oliver Tonnhofer 6ad5a535a1 insert rels with negative IDs to be able to distinguish rels from ways during delete 2013-11-07 16:09:08 +01:00
Oliver Tonnhofer 063c48b8c3 report clipping that takes more than a minute 2013-11-07 15:49:40 +01:00
Oliver Tonnhofer 97854f4277 use logging.Warn instead of log.Println/fmt.Prinln 2013-11-07 15:48:55 +01:00
Oliver Tonnhofer 9ac14cc3da support insertedWays in -diff; handle delete of relations 2013-11-05 15:03:32 +01:00