Commit Graph

49 Commits (master)

Author SHA1 Message Date
Oliver Tonnhofer b25774d891 fix race condition triggered with new relation_members handling 2016-01-08 09:35:54 +01:00
Oliver Tonnhofer f5d16e170b remove unused deltacoords proto code 2015-11-20 23:07:26 +01:00
Oliver Tonnhofer b8530cb803 remove freeBuffer/freeNode hack 2015-11-20 22:54:53 +01:00
Oliver Tonnhofer 8ba96c9327 improve error checking/handling 2015-01-05 09:56:39 +01:00
Oliver Tonnhofer 3b73f91a0d make go gettable 2014-08-04 15:19:35 +02:00
Oliver Tonnhofer 96b5f1c394 fix updating nodes in DeltaCoordsCache
Updating an existing node in the DeltaCoordsCache resulted in duplicate
nodes instead of a single updated node. GetCoord returned the first node,
depending on the sort order.
2014-04-25 11:18:20 +02:00
Oliver Tonnhofer ee8d50addd reset cached bunches when flushing DeltaCoordsCache 2013-11-13 13:29:33 +01:00
Oliver Tonnhofer 4eecb7fb94 reuse freeNodes 2013-11-13 13:17:54 +01:00
Oliver Tonnhofer c3f9992f18 initialize coordsBunch map with capacity size 2013-11-13 13:17:24 +01:00
Oliver Tonnhofer 9d02c24ea0 limit ways and relations as well
only cache ways if the first coord is cached, only cache relations
if the first member is cached.

we need to sync the read process so that we have all coords cached
before the first way gets checked for limitto.
2013-11-12 09:21:17 +01:00
Oliver Tonnhofer 59a14b7c9d remove skipped nodes before accessing first ID; skip empty node lists 2013-11-08 15:09:24 +01:00
Oliver Tonnhofer e8f3e50dcf do not cache skipped nodes 2013-11-07 17:28:42 +01:00
Oliver Tonnhofer 2d2dad7b7e limit cache to -limitto 2013-11-04 08:51:21 +01:00
Oliver Tonnhofer 9e454714b8 name package to imposm3 2013-08-29 15:44:31 +02:00
Oliver Tonnhofer f75c8994c8 remove deleted elements from cache in diff mode 2013-07-05 15:14:21 +02:00
Oliver Tonnhofer d62f11ff97 refactored cache API 2013-07-04 17:27:22 +02:00
Oliver Tonnhofer 0b4bda5ef2 make bunch cache capacity configurable; incr default 2013-06-20 13:48:08 +02:00
Oliver Tonnhofer ecd5541c1e close caches earlier to release memory; optimize read only access for coords 2013-06-20 09:21:30 +02:00
Oliver Tonnhofer e6f880883b make cache options configurable 2013-06-18 15:53:04 +02:00
Oliver Tonnhofer e1179a08b9 remove misplaced defer 2013-06-05 13:01:26 +02:00
Oliver Tonnhofer bd3024b88c release getBunch lock before loading missing coords from cache 2013-06-05 08:05:31 +02:00
Oliver Tonnhofer 2649fc05cf reduce delta cache size 2013-06-03 12:46:33 +02:00
Oliver Tonnhofer 64da1ef0b0 cache []byte for MarshalDeltaNodes 2013-06-03 11:03:45 +02:00
Oliver Tonnhofer 9993fb51c6 use buffered channel for freeNodes cache 2013-05-21 13:24:55 +02:00
Oliver Tonnhofer 86a1b85f02 reduce getBunch calls 2013-05-21 13:06:49 +02:00
Oliver Tonnhofer 0473597fa6 do not use protobuf for delta encoded nodes 2013-05-21 12:13:48 +02:00
Oliver Tonnhofer 853a45296f combine internal.proto and model.proto 2013-05-17 15:16:24 +02:00
Oliver Tonnhofer 0833105371 move binary package into cache package 2013-05-17 15:10:59 +02:00
Oliver Tonnhofer 9b72f02381 improve error handling in cache; add NotFound error 2013-05-16 15:48:22 +02:00
Oliver Tonnhofer 84bc8e0fb1 flush deltacoordscache after -read 2013-05-14 09:26:28 +02:00
Oliver Tonnhofer 319927d47f update deltaCacheBunchSize 2013-05-13 10:40:18 +02:00
Oliver Tonnhofer c3cb785484 enable deltacoordscache optimizations only for linear imports 2013-05-13 08:08:52 +02:00
Oliver Tonnhofer 7a6bedb2e5 handle errors in putCoordsPacked 2013-05-13 07:39:38 +02:00
Oliver Tonnhofer 1e361975e2 add back sorting of delta nodes 2013-05-13 07:39:00 +02:00
Oliver Tonnhofer 25b16b437c make bunchSize configurable with GOPOSM_DELTACACHE_BUNCHSIZE env 2013-05-10 11:18:15 +02:00
Oliver Tonnhofer 69ee95fa27 use idToKeyBuf in diff and delta cache 2013-05-10 11:11:29 +02:00
Oliver Tonnhofer 2f8a72777c fix bunchId when storing coords directly 2013-05-08 15:45:03 +02:00
Oliver Tonnhofer 8ad66f762f fixed long/lat mixup in unpackNodes 2013-05-08 15:44:34 +02:00
Oliver Tonnhofer 79db75e51a do not synchronize writes to "complete" bunches 2013-05-07 09:14:58 +02:00
Oliver Tonnhofer a7f58cbfe1 add test for DeltaaCoordsCache; fixed missing inserted nodes 2013-05-07 07:51:50 +02:00
Oliver Tonnhofer 80d813d217 use smaller delta node bunch size 2013-05-06 11:09:21 +02:00
Oliver Tonnhofer 39d889bf9e reuse deltacoord slices 2013-05-06 07:28:02 +02:00
Oliver Tonnhofer bf4c5ee31f use slices for deltacoords; store ref index 2013-05-05 20:14:39 +02:00
Oliver Tonnhofer e543b05a16 refactored local var name in deltacoordscache 2013-05-02 21:11:24 +02:00
Oliver Tonnhofer 7247a1c7fd read back relations/ways; fill ways with nodes from cache 2013-05-02 20:37:31 +02:00
Oliver Tonnhofer 8efa1fae9b add error handling for cache 2013-04-16 21:14:19 +02:00
Oliver Tonnhofer 064f7df428 DeltaCoordsCache with LRU cache 2013-04-15 21:54:48 +02:00
Oliver Tonnhofer d8cfe75b71 store coords in bunches 2013-04-14 14:50:38 +02:00
Oliver Tonnhofer 74a388887d full parsing and caching; first delta encoding of coords 2013-04-11 19:50:20 +02:00