Oliver Tonnhofer
b25774d891
fix race condition triggered with new relation_members handling
2016-01-08 09:35:54 +01:00
Oliver Tonnhofer
f5d16e170b
remove unused deltacoords proto code
2015-11-20 23:07:26 +01:00
Oliver Tonnhofer
b8530cb803
remove freeBuffer/freeNode hack
2015-11-20 22:54:53 +01:00
Oliver Tonnhofer
8ba96c9327
improve error checking/handling
2015-01-05 09:56:39 +01:00
Oliver Tonnhofer
3b73f91a0d
make go gettable
2014-08-04 15:19:35 +02:00
Oliver Tonnhofer
96b5f1c394
fix updating nodes in DeltaCoordsCache
...
Updating an existing node in the DeltaCoordsCache resulted in duplicate
nodes instead of a single updated node. GetCoord returned the first node,
depending on the sort order.
2014-04-25 11:18:20 +02:00
Oliver Tonnhofer
ee8d50addd
reset cached bunches when flushing DeltaCoordsCache
2013-11-13 13:29:33 +01:00
Oliver Tonnhofer
4eecb7fb94
reuse freeNodes
2013-11-13 13:17:54 +01:00
Oliver Tonnhofer
c3f9992f18
initialize coordsBunch map with capacity size
2013-11-13 13:17:24 +01:00
Oliver Tonnhofer
9d02c24ea0
limit ways and relations as well
...
only cache ways if the first coord is cached, only cache relations
if the first member is cached.
we need to sync the read process so that we have all coords cached
before the first way gets checked for limitto.
2013-11-12 09:21:17 +01:00
Oliver Tonnhofer
59a14b7c9d
remove skipped nodes before accessing first ID; skip empty node lists
2013-11-08 15:09:24 +01:00
Oliver Tonnhofer
e8f3e50dcf
do not cache skipped nodes
2013-11-07 17:28:42 +01:00
Oliver Tonnhofer
2d2dad7b7e
limit cache to -limitto
2013-11-04 08:51:21 +01:00
Oliver Tonnhofer
9e454714b8
name package to imposm3
2013-08-29 15:44:31 +02:00
Oliver Tonnhofer
f75c8994c8
remove deleted elements from cache in diff mode
2013-07-05 15:14:21 +02:00
Oliver Tonnhofer
d62f11ff97
refactored cache API
2013-07-04 17:27:22 +02:00
Oliver Tonnhofer
0b4bda5ef2
make bunch cache capacity configurable; incr default
2013-06-20 13:48:08 +02:00
Oliver Tonnhofer
ecd5541c1e
close caches earlier to release memory; optimize read only access for coords
2013-06-20 09:21:30 +02:00
Oliver Tonnhofer
e6f880883b
make cache options configurable
2013-06-18 15:53:04 +02:00
Oliver Tonnhofer
e1179a08b9
remove misplaced defer
2013-06-05 13:01:26 +02:00
Oliver Tonnhofer
bd3024b88c
release getBunch lock before loading missing coords from cache
2013-06-05 08:05:31 +02:00
Oliver Tonnhofer
2649fc05cf
reduce delta cache size
2013-06-03 12:46:33 +02:00
Oliver Tonnhofer
64da1ef0b0
cache []byte for MarshalDeltaNodes
2013-06-03 11:03:45 +02:00
Oliver Tonnhofer
9993fb51c6
use buffered channel for freeNodes cache
2013-05-21 13:24:55 +02:00
Oliver Tonnhofer
86a1b85f02
reduce getBunch calls
2013-05-21 13:06:49 +02:00
Oliver Tonnhofer
0473597fa6
do not use protobuf for delta encoded nodes
2013-05-21 12:13:48 +02:00
Oliver Tonnhofer
853a45296f
combine internal.proto and model.proto
2013-05-17 15:16:24 +02:00
Oliver Tonnhofer
0833105371
move binary package into cache package
2013-05-17 15:10:59 +02:00
Oliver Tonnhofer
9b72f02381
improve error handling in cache; add NotFound error
2013-05-16 15:48:22 +02:00
Oliver Tonnhofer
84bc8e0fb1
flush deltacoordscache after -read
2013-05-14 09:26:28 +02:00
Oliver Tonnhofer
319927d47f
update deltaCacheBunchSize
2013-05-13 10:40:18 +02:00
Oliver Tonnhofer
c3cb785484
enable deltacoordscache optimizations only for linear imports
2013-05-13 08:08:52 +02:00
Oliver Tonnhofer
7a6bedb2e5
handle errors in putCoordsPacked
2013-05-13 07:39:38 +02:00
Oliver Tonnhofer
1e361975e2
add back sorting of delta nodes
2013-05-13 07:39:00 +02:00
Oliver Tonnhofer
25b16b437c
make bunchSize configurable with GOPOSM_DELTACACHE_BUNCHSIZE env
2013-05-10 11:18:15 +02:00
Oliver Tonnhofer
69ee95fa27
use idToKeyBuf in diff and delta cache
2013-05-10 11:11:29 +02:00
Oliver Tonnhofer
2f8a72777c
fix bunchId when storing coords directly
2013-05-08 15:45:03 +02:00
Oliver Tonnhofer
8ad66f762f
fixed long/lat mixup in unpackNodes
2013-05-08 15:44:34 +02:00
Oliver Tonnhofer
79db75e51a
do not synchronize writes to "complete" bunches
2013-05-07 09:14:58 +02:00
Oliver Tonnhofer
a7f58cbfe1
add test for DeltaaCoordsCache; fixed missing inserted nodes
2013-05-07 07:51:50 +02:00
Oliver Tonnhofer
80d813d217
use smaller delta node bunch size
2013-05-06 11:09:21 +02:00
Oliver Tonnhofer
39d889bf9e
reuse deltacoord slices
2013-05-06 07:28:02 +02:00
Oliver Tonnhofer
bf4c5ee31f
use slices for deltacoords; store ref index
2013-05-05 20:14:39 +02:00
Oliver Tonnhofer
e543b05a16
refactored local var name in deltacoordscache
2013-05-02 21:11:24 +02:00
Oliver Tonnhofer
7247a1c7fd
read back relations/ways; fill ways with nodes from cache
2013-05-02 20:37:31 +02:00
Oliver Tonnhofer
8efa1fae9b
add error handling for cache
2013-04-16 21:14:19 +02:00
Oliver Tonnhofer
064f7df428
DeltaCoordsCache with LRU cache
2013-04-15 21:54:48 +02:00
Oliver Tonnhofer
d8cfe75b71
store coords in bunches
2013-04-14 14:50:38 +02:00
Oliver Tonnhofer
74a388887d
full parsing and caching; first delta encoding of coords
2013-04-11 19:50:20 +02:00