Oliver Tonnhofer
63cf97eb01
make sure clipped geometries are DestroyedLayer
2013-11-12 12:06:46 +01:00
Oliver Tonnhofer
9d02c24ea0
limit ways and relations as well
...
only cache ways if the first coord is cached, only cache relations
if the first member is cached.
we need to sync the read process so that we have all coords cached
before the first way gets checked for limitto.
2013-11-12 09:21:17 +01:00
Oliver Tonnhofer
8959147ccf
refactored parallel parser
2013-11-11 13:59:53 +01:00
Oliver Tonnhofer
c0b5fe7430
close OSM/DiffCache after update
2013-11-11 13:41:09 +01:00
Oliver Tonnhofer
e0404e7a1d
add -quiet options to imposm3 diff
2013-11-11 10:39:44 +01:00
Oliver Tonnhofer
ea2065b5ec
do not open OSM/DiffCache for each Update
2013-11-11 10:16:59 +01:00
Oliver Tonnhofer
aa632e2bd6
do not add prepared geometries to index
2013-11-11 09:41:41 +01:00
Oliver Tonnhofer
390edea938
add new Expireor interface
2013-11-08 16:22:41 +01:00
Oliver Tonnhofer
f4a6192ae8
removed unused code
2013-11-08 16:03:42 +01:00
Oliver Tonnhofer
8a50a6cfe4
write replicationURL of last state in new state
2013-11-08 16:01:08 +01:00
Oliver Tonnhofer
d560755a15
transform nodes to mercator before limiting in reader
2013-11-08 15:19:31 +01:00
Oliver Tonnhofer
59a14b7c9d
remove skipped nodes before accessing first ID; skip empty node lists
2013-11-08 15:09:24 +01:00
Oliver Tonnhofer
d7806c6cfd
fix closing of nodes iter channel
2013-11-08 15:03:20 +01:00
Oliver Tonnhofer
129799328d
fix race condition where leveldb is closed before the iterator
...
should solve assertion errors like:
db/version_set.cc:710: leveldb::VersionSet::~VersionSet(): Assertion `dummy_versions_.next_ == &dummy_versions_' failed
2013-11-08 10:18:14 +01:00
Oliver Tonnhofer
178aba56dd
removed unused code
2013-11-07 17:49:14 +01:00
Oliver Tonnhofer
e8f3e50dcf
do not cache skipped nodes
2013-11-07 17:28:42 +01:00
Oliver Tonnhofer
6ad5a535a1
insert rels with negative IDs to be able to distinguish rels from ways during delete
2013-11-07 16:09:08 +01:00
Oliver Tonnhofer
063c48b8c3
report clipping that takes more than a minute
2013-11-07 15:49:40 +01:00
Oliver Tonnhofer
97854f4277
use logging.Warn instead of log.Println/fmt.Prinln
2013-11-07 15:48:55 +01:00
Oliver Tonnhofer
9ac14cc3da
support insertedWays in -diff; handle delete of relations
2013-11-05 15:03:32 +01:00
Oliver Tonnhofer
e246f5c14b
delete/reinsert members of deleted relations
2013-11-05 11:34:03 +01:00
Oliver Tonnhofer
2cebe56d8f
prevent SIGSEGV when building buffered limitto geometry
2013-11-04 16:00:19 +01:00
Oliver Tonnhofer
09665205ca
always write last.state.txt after -read
2013-11-04 15:04:07 +01:00
Oliver Tonnhofer
9376230048
estimate diff sequence number of new imports
2013-11-04 15:02:28 +01:00
Oliver Tonnhofer
af6510b008
enable concurrent writing explicitly
2013-11-04 14:33:32 +01:00
Oliver Tonnhofer
a406864fd7
close database handles
2013-11-04 14:32:54 +01:00
Oliver Tonnhofer
b67e7cec34
close diff file handle
2013-11-04 14:31:26 +01:00
Oliver Tonnhofer
7903a3293b
close geojson file handle
2013-11-04 14:31:05 +01:00
Oliver Tonnhofer
21279a941e
close file mapping handle
2013-11-04 14:30:32 +01:00
Oliver Tonnhofer
076926a417
renamed -limittodiffbuffer to -limittocachebuffer
2013-11-04 08:55:10 +01:00
Oliver Tonnhofer
2d2dad7b7e
limit cache to -limitto
2013-11-04 08:51:21 +01:00
Oliver Tonnhofer
35e66529a7
force synchronous inserts during diff import
...
this makes sure that the source geometries for generalizes geometries
are inserted
2013-11-01 11:25:41 +01:00
Oliver Tonnhofer
5203225bcd
improve limiter
...
- check complete contains first
- intersect with original geometry if it intersects to many parts
2013-10-31 18:21:21 +01:00
Oliver Tonnhofer
60a4eb7f4d
allow -httpprofile for diff import
2013-10-30 11:14:34 +01:00
Oliver Tonnhofer
0461fd56fe
move import main function to import_ package
2013-10-30 10:48:00 +01:00
Oliver Tonnhofer
3b3fa8f834
prevent multiple deletes of the same way/relation
2013-10-29 17:38:49 +01:00
Oliver Tonnhofer
deda8e2816
log progress during writing of added/modified elements
2013-10-29 17:06:47 +01:00
Oliver Tonnhofer
122afae480
revert code change
2013-10-29 17:05:59 +01:00
Oliver Tonnhofer
93edef2681
refactored database API
2013-10-29 16:32:16 +01:00
Oliver Tonnhofer
abb7734f8c
refactored tableNames method
2013-10-29 15:30:51 +01:00
Oliver Tonnhofer
5d3ab6cbcc
add comments
2013-10-29 15:11:58 +01:00
Oliver Tonnhofer
d387f3cd24
remove unused InsertBuffer
2013-10-29 15:07:26 +01:00
Oliver Tonnhofer
5c59fe8a78
remove unused PostGIS.InsertBatch
2013-10-29 15:06:08 +01:00
Oliver Tonnhofer
337aeafcb8
refactored TxRouter
2013-10-29 15:00:52 +01:00
Oliver Tonnhofer
eececc6164
remove print statement
2013-10-29 14:57:50 +01:00
Oliver Tonnhofer
fb860b6736
add test-system and test-unit target
2013-10-29 14:08:39 +01:00
Oliver Tonnhofer
311bd01c81
update tests
2013-10-29 14:07:40 +01:00
Oliver Tonnhofer
8d95f50eeb
create generalized tabels from other generalized tables
2013-10-29 11:40:09 +01:00
Oliver Tonnhofer
c5bf11c32b
add test for updated generalizations
2013-10-29 10:58:03 +01:00
Oliver Tonnhofer
05cb832682
use single transaction for non-bulk import
2013-10-29 10:57:31 +01:00