Commit Graph

160 Commits (master)

Author SHA1 Message Date
Oliver Tonnhofer abda12bb77 renamed diffcache files 2013-05-31 14:57:08 +02:00
Oliver Tonnhofer 268703877b store way->rel coord->way->rel for relations in -diff mode 2013-05-30 16:04:40 +02:00
Oliver Tonnhofer 773cbaac94 write coords->way index 2013-05-30 12:00:11 +02:00
Oliver Tonnhofer 9993fb51c6 use buffered channel for freeNodes cache 2013-05-21 13:24:55 +02:00
Oliver Tonnhofer 86a1b85f02 reduce getBunch calls 2013-05-21 13:06:49 +02:00
Oliver Tonnhofer 0473597fa6 do not use protobuf for delta encoded nodes 2013-05-21 12:13:48 +02:00
Oliver Tonnhofer c4fb0d8a21 make chanels buffered 2013-05-17 17:15:02 +02:00
Oliver Tonnhofer 81d818a0c4 fixed cache tests 2013-05-17 15:33:36 +02:00
Oliver Tonnhofer 03dc885462 reorganized cache package 2013-05-17 15:30:22 +02:00
Oliver Tonnhofer 853a45296f combine internal.proto and model.proto 2013-05-17 15:16:24 +02:00
Oliver Tonnhofer 0833105371 move binary package into cache package 2013-05-17 15:10:59 +02:00
Oliver Tonnhofer decb17cb4c mark/skip inserted ways from mulitpolygon relations; reproject relation geometries 2013-05-17 12:06:50 +02:00
Oliver Tonnhofer 2776061ba7 insert relations into db 2013-05-17 11:42:19 +02:00
Oliver Tonnhofer dc59e013fe add simple query tool 2013-05-17 10:30:58 +02:00
Oliver Tonnhofer 051ad58a3c update cache test for updated error handling 2013-05-17 10:28:51 +02:00
Oliver Tonnhofer f4e9d2c841 make chache dir on Open() if missing 2013-05-17 10:28:32 +02:00
Oliver Tonnhofer 9b72f02381 improve error handling in cache; add NotFound error 2013-05-16 15:48:22 +02:00
Oliver Tonnhofer 516da08599 first mulitppolygon builder 2013-05-16 12:17:21 +02:00
Oliver Tonnhofer 5c174a3ff6 import nodes into db 2013-05-15 13:21:31 +02:00
Oliver Tonnhofer 6aaa753eb8 make fields in table mapping a list 2013-05-15 08:15:57 +02:00
Oliver Tonnhofer 8ea0572410 fixed cache/diff test 2013-05-14 11:54:39 +02:00
Oliver Tonnhofer 84bc8e0fb1 flush deltacoordscache after -read 2013-05-14 09:26:28 +02:00
Oliver Tonnhofer aea54fd050 limit max open files for leveldbs 2013-05-13 15:28:39 +02:00
Oliver Tonnhofer cba18797e9 removed go vet warnings 2013-05-13 10:55:08 +02:00
Oliver Tonnhofer 319927d47f update deltaCacheBunchSize 2013-05-13 10:40:18 +02:00
Oliver Tonnhofer ee13f30435 write to diff cache in batches 2013-05-13 09:54:00 +02:00
Oliver Tonnhofer c3cb785484 enable deltacoordscache optimizations only for linear imports 2013-05-13 08:08:52 +02:00
Oliver Tonnhofer 7a6bedb2e5 handle errors in putCoordsPacked 2013-05-13 07:39:38 +02:00
Oliver Tonnhofer 1e361975e2 add back sorting of delta nodes 2013-05-13 07:39:00 +02:00
Oliver Tonnhofer 094e5c4ace use delta encoding for ref cache 2013-05-13 07:36:54 +02:00
Oliver Tonnhofer 25b16b437c make bunchSize configurable with GOPOSM_DELTACACHE_BUNCHSIZE env 2013-05-10 11:18:15 +02:00
Oliver Tonnhofer 69ee95fa27 use idToKeyBuf in diff and delta cache 2013-05-10 11:11:29 +02:00
Oliver Tonnhofer 2f8a72777c fix bunchId when storing coords directly 2013-05-08 15:45:03 +02:00
Oliver Tonnhofer 8ad66f762f fixed long/lat mixup in unpackNodes 2013-05-08 15:44:34 +02:00
Oliver Tonnhofer 905df4f3e6 tweak leveldb blockrestartinterval 2013-05-08 09:12:57 +02:00
Oliver Tonnhofer 166a6dff02 do not use varint for leveldb key but int64 2013-05-07 13:56:32 +02:00
Oliver Tonnhofer cc28221bb8 add GOPOSM_LEVELDB_ env vars 2013-05-07 11:42:27 +02:00
Oliver Tonnhofer 768d04ad56 add first simple tag filtering 2013-05-07 10:13:09 +02:00
Oliver Tonnhofer 79db75e51a do not synchronize writes to "complete" bunches 2013-05-07 09:14:58 +02:00
Oliver Tonnhofer a7f58cbfe1 add test for DeltaaCoordsCache; fixed missing inserted nodes 2013-05-07 07:51:50 +02:00
Oliver Tonnhofer 8f5d0d0c44 new DiffCache; improved progress report 2013-05-06 14:20:00 +02:00
Oliver Tonnhofer 40c8b04181 keep ref ids in RefIndex sorted 2013-05-06 13:42:58 +02:00
Oliver Tonnhofer 1f0fca5552 move cache/index to cache/diff 2013-05-06 13:19:56 +02:00
Oliver Tonnhofer 6034befe52 add -read/-write/-overwritecache options 2013-05-06 12:51:30 +02:00
Oliver Tonnhofer 80d813d217 use smaller delta node bunch size 2013-05-06 11:09:21 +02:00
Oliver Tonnhofer 39d889bf9e reuse deltacoord slices 2013-05-06 07:28:02 +02:00
Oliver Tonnhofer bf4c5ee31f use slices for deltacoords; store ref index 2013-05-05 20:14:39 +02:00
Oliver Tonnhofer 6ab604da0e create OSMCache 2013-05-04 16:27:05 +02:00
Oliver Tonnhofer e543b05a16 refactored local var name in deltacoordscache 2013-05-02 21:11:24 +02:00
Oliver Tonnhofer 7247a1c7fd read back relations/ways; fill ways with nodes from cache 2013-05-02 20:37:31 +02:00
Oliver Tonnhofer 7c2c5c490a add separate cache for nodes and coords 2013-05-02 18:45:33 +02:00
Oliver Tonnhofer dfd4c41a0c renamed Way.Nodes to Way.Refs 2013-04-23 22:30:41 +02:00
Oliver Tonnhofer 7f28d079fb write everything to cache in batches 2013-04-20 16:50:23 +02:00
Oliver Tonnhofer 8efa1fae9b add error handling for cache 2013-04-16 21:14:19 +02:00
Oliver Tonnhofer 064f7df428 DeltaCoordsCache with LRU cache 2013-04-15 21:54:48 +02:00
Oliver Tonnhofer d8cfe75b71 store coords in bunches 2013-04-14 14:50:38 +02:00
Oliver Tonnhofer 74a388887d full parsing and caching; first delta encoding of coords 2013-04-11 19:50:20 +02:00
Oliver Tonnhofer 79b528d53e parse and cache pbf files 2013-04-08 21:45:13 +02:00
Oliver Tonnhofer 1ad4f7931c hackahoy! parsing of nodes/ways/relations; marshaling 2013-04-02 22:07:27 +02:00
Oliver Tonnhofer 17484a68e9 more hacking 2013-02-12 19:45:49 +01:00