Commit Graph

87 Commits (3fae4c34caa87c32562c7e8633ebe477baa4ea21)

Author SHA1 Message Date
Oliver Tonnhofer 3fae4c34ca parse diff metadata 2016-12-06 10:52:25 +01:00
Oliver Tonnhofer c5993ecb81 only set DiffElem.Mod to true on modify 2016-12-06 10:49:17 +01:00
Oliver Tonnhofer 4ac7509e7d flush tile list at most every 30 seconds 2016-12-06 10:30:49 +01:00
Oliver Tonnhofer 5b132abfb1 shutdown in SIGTERM 2016-12-06 10:30:48 +01:00
Oliver Tonnhofer 2abbaa3248 add imposm3 run command 2016-12-06 10:30:48 +01:00
Oliver Tonnhofer c90badce51 discard additional cache.NotFound errors in diff.Update 2016-12-06 10:29:05 +01:00
Oliver Tonnhofer 3453b13af2 write expire tiles; add first tests 2016-11-23 14:43:38 +01:00
Oliver Tonnhofer bba7d68380 allways call Expire with wgs84 coords 2016-11-22 17:06:58 +01:00
Oliver Tonnhofer 02e2abfd2a set diff.Deleter expireor 2016-11-22 16:44:27 +01:00
Oliver Tonnhofer 368c6699a7 fix import of relations without way members when using -limitto 2016-02-09 11:23:21 +01:00
Oliver Tonnhofer 8949fe28c4 fix delete of relations with single_id_space 2016-02-04 17:07:35 +01:00
Oliver Tonnhofer 766118b324 update relations when member node changed 2016-01-08 16:08:00 +01:00
Oliver Tonnhofer 8eae74a6da diff update relation_members 2016-01-08 09:35:54 +01:00
Oliver Tonnhofer 423390ea71 Add new relation_members table type 2016-01-08 09:35:53 +01:00
Oliver Tonnhofer 15111cab7a add diff tests 2015-11-22 12:25:35 +01:00
Oliver Tonnhofer 4195e24dee do not insert relations with unsupported types during diff import 2015-10-07 10:22:30 +02:00
Oliver Tonnhofer d3452eafda improve tests and actually fix #65 and #66
previous fix only worked by accident because way and relation ids were
the same
2015-09-30 14:30:55 +02:00
Oliver Tonnhofer fa99248c7a fix duplicate inserts of ways and relations when handling diffs
closes #65 and #66
2015-09-29 13:58:06 +02:00
Oliver Tonnhofer 4bf826204f do check for intersection with wgs84 2015-03-26 07:34:08 +01:00
Oliver Tonnhofer 0be4fcf565 parse diffs till </osmChange>
- changes and err chan are now closed on success
- io.EOF is now an error
- fixes (possible) parsing of truncated diff files

closes #45
2015-03-24 09:06:37 +01:00
Oliver Tonnhofer 8ba96c9327 improve error checking/handling 2015-01-05 09:56:39 +01:00
Oliver Tonnhofer 44be47583b add -diff-state-before option to set initial diff sequence before 2014-09-15 14:07:27 +02:00
Oliver Tonnhofer 63a7d79113 do not write last.state.txt if it failed to estimate sequence number 2014-08-19 16:31:42 +02:00
Oliver Tonnhofer 3f3c12ece1 add use_single_id_space mapping option
Mangle way and relation IDs so that they don't colide with
node IDs for imports into a single table.
Way IDs are negated, relation IDs are negated and shifted by -1e17.
2014-08-11 10:18:08 +02:00
Oliver Tonnhofer aaa9181134 fix diff updates of nodes with dropped tags 2014-08-08 12:24:28 +02:00
Oliver Tonnhofer 3b73f91a0d make go gettable 2014-08-04 15:19:35 +02:00
Oliver Tonnhofer a9ccec143c add support for single table imports
- support type=geometry
- allow to load all tags
2014-06-25 16:46:42 +02:00
Oliver Tonnhofer 088a4d89f3 refactored tag matching from database to writer
tag matching is independent of the database and can belong to the writer
package. also cleans up the database.Inserter interface.
2014-06-25 16:46:42 +02:00
Oliver Tonnhofer f2d40b047b log more sql errors during import and diff updates 2014-04-28 11:43:25 +02:00
Oliver Tonnhofer e4d1156ff8 make location of last.state.txt configuratble 2014-04-01 13:16:27 +02:00
Oliver Tonnhofer 3901c5d8c4 make db schema configurable from cmd-line and config.json 2013-12-02 13:10:42 +01:00
Oliver Tonnhofer 9e5e60abc4 handle diff update errors outside of Update 2013-11-13 15:26:22 +01:00
Oliver Tonnhofer 4fe7379dcd transform nodes before checking against limito in diff import 2013-11-12 17:41:11 +01:00
Oliver Tonnhofer 9d02c24ea0 limit ways and relations as well
only cache ways if the first coord is cached, only cache relations
if the first member is cached.

we need to sync the read process so that we have all coords cached
before the first way gets checked for limitto.
2013-11-12 09:21:17 +01:00
Oliver Tonnhofer ea2065b5ec do not open OSM/DiffCache for each Update 2013-11-11 10:16:59 +01:00
Oliver Tonnhofer 390edea938 add new Expireor interface 2013-11-08 16:22:41 +01:00
Oliver Tonnhofer 8a50a6cfe4 write replicationURL of last state in new state 2013-11-08 16:01:08 +01:00
Oliver Tonnhofer 178aba56dd removed unused code 2013-11-07 17:49:14 +01:00
Oliver Tonnhofer 6ad5a535a1 insert rels with negative IDs to be able to distinguish rels from ways during delete 2013-11-07 16:09:08 +01:00
Oliver Tonnhofer 9ac14cc3da support insertedWays in -diff; handle delete of relations 2013-11-05 15:03:32 +01:00
Oliver Tonnhofer e246f5c14b delete/reinsert members of deleted relations 2013-11-05 11:34:03 +01:00
Oliver Tonnhofer 9376230048 estimate diff sequence number of new imports 2013-11-04 15:02:28 +01:00
Oliver Tonnhofer a406864fd7 close database handles 2013-11-04 14:32:54 +01:00
Oliver Tonnhofer b67e7cec34 close diff file handle 2013-11-04 14:31:26 +01:00
Oliver Tonnhofer 3b3fa8f834 prevent multiple deletes of the same way/relation 2013-10-29 17:38:49 +01:00
Oliver Tonnhofer deda8e2816 log progress during writing of added/modified elements 2013-10-29 17:06:47 +01:00
Oliver Tonnhofer 93edef2681 refactored database API 2013-10-29 16:32:16 +01:00
Oliver Tonnhofer 5e42ef6b98 record updated IDs for updating generalized tables later 2013-10-28 14:55:01 +01:00
Oliver Tonnhofer f4d0435102 move tagmatching to database for deletes 2013-10-28 12:01:57 +01:00
Oliver Tonnhofer ce962c785e remove tagmatcher from Writer 2013-10-28 11:37:58 +01:00