Commit Graph

136 Commits (dab06de51cd906476bbd2d9fec4b6faf563bf142)

Author SHA1 Message Date
Oliver Tonnhofer 3affe43808 improve inserted_ways handling
compare destination tables for each way instead of only comparing
if the tags are similar
2013-12-16 09:57:47 +01:00
Oliver Tonnhofer a4ea44acb1 pool idRefs/bytes in diff cache 2013-11-20 09:21:26 +01:00
Oliver Tonnhofer c3a7be1ab2 don't set cache to nil after flushing 2013-11-19 15:47:33 +01:00
Oliver Tonnhofer 1309a2f478 add Flush to diff cache 2013-11-19 15:07:40 +01:00
Oliver Tonnhofer b86ecff037 close levigo.Read/WriteOptions 2013-11-19 15:07:26 +01:00
Oliver Tonnhofer 95aa490208 use binary.Varint instead of binary.ReadVarint in UnmarshalIdRefsBunch 2013-11-19 08:41:39 +01:00
Oliver Tonnhofer 596f4de970 marshal length as unsigned varint 2013-11-19 08:40:27 +01:00
Oliver Tonnhofer fbbf29d167 use binary.Varint instead of binary.ReadVarint in UnmarshalDeltaNodes 2013-11-18 17:24:31 +01:00
Oliver Tonnhofer ee8d50addd reset cached bunches when flushing DeltaCoordsCache 2013-11-13 13:29:33 +01:00
Oliver Tonnhofer ca7d7efe7d set cache.BlockSizeK in KB not MB 2013-11-13 13:20:06 +01:00
Oliver Tonnhofer 4eecb7fb94 reuse freeNodes 2013-11-13 13:17:54 +01:00
Oliver Tonnhofer c3f9992f18 initialize coordsBunch map with capacity size 2013-11-13 13:17:24 +01:00
Oliver Tonnhofer 9d02c24ea0 limit ways and relations as well
only cache ways if the first coord is cached, only cache relations
if the first member is cached.

we need to sync the read process so that we have all coords cached
before the first way gets checked for limitto.
2013-11-12 09:21:17 +01:00
Oliver Tonnhofer 59a14b7c9d remove skipped nodes before accessing first ID; skip empty node lists 2013-11-08 15:09:24 +01:00
Oliver Tonnhofer d7806c6cfd fix closing of nodes iter channel 2013-11-08 15:03:20 +01:00
Oliver Tonnhofer 129799328d fix race condition where leveldb is closed before the iterator
should solve assertion errors like:
db/version_set.cc:710: leveldb::VersionSet::~VersionSet(): Assertion `dummy_versions_.next_ == &dummy_versions_' failed
2013-11-08 10:18:14 +01:00
Oliver Tonnhofer e8f3e50dcf do not cache skipped nodes 2013-11-07 17:28:42 +01:00
Oliver Tonnhofer 2d2dad7b7e limit cache to -limitto 2013-11-04 08:51:21 +01:00
Oliver Tonnhofer 8e0665aa12 rename internal environment switches 2013-09-02 13:09:26 +02:00
Oliver Tonnhofer 52fb1dfd6e add package descriptions 2013-09-02 10:26:29 +02:00
Oliver Tonnhofer 9e454714b8 name package to imposm3 2013-08-29 15:44:31 +02:00
Oliver Tonnhofer 5866471a07 test delta cache with SetLinearImport 2013-08-07 13:18:07 +02:00
Oliver Tonnhofer d6fcfc6c23 more refactoring 2013-08-06 17:22:31 +02:00
Oliver Tonnhofer ef3db821be refactored IdRefs mashaling into cache/binary 2013-08-06 16:14:29 +02:00
Oliver Tonnhofer 9df027e29b refactored diff cache 2013-08-06 15:39:42 +02:00
Oliver Tonnhofer 7d78ff85de removed unused functions 2013-08-06 15:36:21 +02:00
Oliver Tonnhofer d89a9f2832 implement DeleteFromWay 2013-08-06 15:29:30 +02:00
Oliver Tonnhofer 63794491f6 enable LinearImport for diffCache during import 2013-08-05 12:51:25 +02:00
Oliver Tonnhofer fedb2a8914 add linear import and direct import mode to diff cache 2013-08-05 12:05:06 +02:00
Oliver Tonnhofer e0e3358b6d query for multiple nodes/ways/relations 2013-08-02 10:14:05 +02:00
Oliver Tonnhofer 191632ea0c dump query-cache output as json 2013-08-02 10:08:01 +02:00
Oliver Tonnhofer 0aba137bb8 add cache/query as subcommand 2013-08-01 15:31:47 +02:00
Oliver Tonnhofer b5d578175f remove members of deleted relation from InsertedWaysCache 2013-08-01 14:07:06 +02:00
Oliver Tonnhofer efec87a40c improve cache/query output 2013-08-01 13:35:00 +02:00
Oliver Tonnhofer f75c8994c8 remove deleted elements from cache in diff mode 2013-07-05 15:14:21 +02:00
Oliver Tonnhofer 83af982f2c renamed test file 2013-07-05 09:23:14 +02:00
Oliver Tonnhofer 9d8166ce11 removed empty file 2013-07-05 09:23:05 +02:00
Oliver Tonnhofer 6c5b7e0201 refactored cache API 2013-07-05 09:21:51 +02:00
Oliver Tonnhofer 2ff97757d8 update tests for diff cache 2013-07-05 08:56:01 +02:00
Oliver Tonnhofer d092ba7807 refactored diff cache 2013-07-05 08:03:13 +02:00
Oliver Tonnhofer 0f09649775 Merge branch 'master' into diffbunch
Conflicts:
	cache/diff.go
	cache/diff_test.go
2013-07-04 17:33:35 +02:00
Oliver Tonnhofer d62f11ff97 refactored cache API 2013-07-04 17:27:22 +02:00
Oliver Tonnhofer e38875a850 remove unused code; make private functions lowercase 2013-07-04 16:03:26 +02:00
Oliver Tonnhofer 32e4214351 refactored coords cache 2013-06-28 13:10:18 +02:00
Oliver Tonnhofer 94b5999756 refactored bunchCache; add more tests 2013-06-26 21:57:07 +02:00
Oliver Tonnhofer 64b2689ab8 optimize diff bunches 2013-06-26 19:43:30 +02:00
Oliver Tonnhofer 0a0a079d93 remove conversion to map 2013-06-25 05:12:59 +02:00
Oliver Tonnhofer 2e67df6f0f first bunched diff cache 2013-06-24 15:52:45 +02:00
Oliver Tonnhofer f8e34f37e2 return err immediately 2013-06-24 13:00:20 +02:00
Oliver Tonnhofer 003e5f8f0b Revert "unmarshal items in writer"
This reverts commit c314f01886.
2013-06-21 11:05:29 +02:00