Commit Graph

69 Commits (063730b8e80465a915d6e3920ccc177a3c8cdb11)

Author SHA1 Message Date
Oliver Tonnhofer 4bf826204f do check for intersection with wgs84 2015-03-26 07:34:08 +01:00
Oliver Tonnhofer 0be4fcf565 parse diffs till </osmChange>
- changes and err chan are now closed on success
- io.EOF is now an error
- fixes (possible) parsing of truncated diff files

closes #45
2015-03-24 09:06:37 +01:00
Oliver Tonnhofer 8ba96c9327 improve error checking/handling 2015-01-05 09:56:39 +01:00
Oliver Tonnhofer 44be47583b add -diff-state-before option to set initial diff sequence before 2014-09-15 14:07:27 +02:00
Oliver Tonnhofer 63a7d79113 do not write last.state.txt if it failed to estimate sequence number 2014-08-19 16:31:42 +02:00
Oliver Tonnhofer 3f3c12ece1 add use_single_id_space mapping option
Mangle way and relation IDs so that they don't colide with
node IDs for imports into a single table.
Way IDs are negated, relation IDs are negated and shifted by -1e17.
2014-08-11 10:18:08 +02:00
Oliver Tonnhofer aaa9181134 fix diff updates of nodes with dropped tags 2014-08-08 12:24:28 +02:00
Oliver Tonnhofer 3b73f91a0d make go gettable 2014-08-04 15:19:35 +02:00
Oliver Tonnhofer a9ccec143c add support for single table imports
- support type=geometry
- allow to load all tags
2014-06-25 16:46:42 +02:00
Oliver Tonnhofer 088a4d89f3 refactored tag matching from database to writer
tag matching is independent of the database and can belong to the writer
package. also cleans up the database.Inserter interface.
2014-06-25 16:46:42 +02:00
Oliver Tonnhofer f2d40b047b log more sql errors during import and diff updates 2014-04-28 11:43:25 +02:00
Oliver Tonnhofer e4d1156ff8 make location of last.state.txt configuratble 2014-04-01 13:16:27 +02:00
Oliver Tonnhofer 3901c5d8c4 make db schema configurable from cmd-line and config.json 2013-12-02 13:10:42 +01:00
Oliver Tonnhofer 9e5e60abc4 handle diff update errors outside of Update 2013-11-13 15:26:22 +01:00
Oliver Tonnhofer 4fe7379dcd transform nodes before checking against limito in diff import 2013-11-12 17:41:11 +01:00
Oliver Tonnhofer 9d02c24ea0 limit ways and relations as well
only cache ways if the first coord is cached, only cache relations
if the first member is cached.

we need to sync the read process so that we have all coords cached
before the first way gets checked for limitto.
2013-11-12 09:21:17 +01:00
Oliver Tonnhofer ea2065b5ec do not open OSM/DiffCache for each Update 2013-11-11 10:16:59 +01:00
Oliver Tonnhofer 390edea938 add new Expireor interface 2013-11-08 16:22:41 +01:00
Oliver Tonnhofer 8a50a6cfe4 write replicationURL of last state in new state 2013-11-08 16:01:08 +01:00
Oliver Tonnhofer 178aba56dd removed unused code 2013-11-07 17:49:14 +01:00
Oliver Tonnhofer 6ad5a535a1 insert rels with negative IDs to be able to distinguish rels from ways during delete 2013-11-07 16:09:08 +01:00
Oliver Tonnhofer 9ac14cc3da support insertedWays in -diff; handle delete of relations 2013-11-05 15:03:32 +01:00
Oliver Tonnhofer e246f5c14b delete/reinsert members of deleted relations 2013-11-05 11:34:03 +01:00
Oliver Tonnhofer 9376230048 estimate diff sequence number of new imports 2013-11-04 15:02:28 +01:00
Oliver Tonnhofer a406864fd7 close database handles 2013-11-04 14:32:54 +01:00
Oliver Tonnhofer b67e7cec34 close diff file handle 2013-11-04 14:31:26 +01:00
Oliver Tonnhofer 3b3fa8f834 prevent multiple deletes of the same way/relation 2013-10-29 17:38:49 +01:00
Oliver Tonnhofer deda8e2816 log progress during writing of added/modified elements 2013-10-29 17:06:47 +01:00
Oliver Tonnhofer 93edef2681 refactored database API 2013-10-29 16:32:16 +01:00
Oliver Tonnhofer 5e42ef6b98 record updated IDs for updating generalized tables later 2013-10-28 14:55:01 +01:00
Oliver Tonnhofer f4d0435102 move tagmatching to database for deletes 2013-10-28 12:01:57 +01:00
Oliver Tonnhofer ce962c785e remove tagmatcher from Writer 2013-10-28 11:37:58 +01:00
Oliver Tonnhofer 819df78d03 disable diff download tests 2013-10-28 08:42:33 +01:00
Oliver Tonnhofer 52fb1dfd6e add package descriptions 2013-09-02 10:26:29 +02:00
Oliver Tonnhofer 9e454714b8 name package to imposm3 2013-08-29 15:44:31 +02:00
Oliver Tonnhofer 1ae42f8345 warn for unknown xml tags on osc file 2013-08-07 13:54:28 +02:00
Oliver Tonnhofer c4a945750d delete rel-way references; improved tests 2013-08-07 13:09:34 +02:00
Oliver Tonnhofer 639c206b16 remove way references from diff cache 2013-08-05 12:05:15 +02:00
Oliver Tonnhofer 87d79a576d refactored command parsing; update --help 2013-08-01 16:19:20 +02:00
Oliver Tonnhofer b5d578175f remove members of deleted relation from InsertedWaysCache 2013-08-01 14:07:06 +02:00
Oliver Tonnhofer c38105b3d1 fixed check if coords of way are cached 2013-08-01 14:06:35 +02:00
Oliver Tonnhofer 9716a0c5cf check for geometryLimiter before accessing it 2013-08-01 13:34:32 +02:00
Oliver Tonnhofer 7500984424 use buffered geometry limiter in diff import 2013-07-30 08:30:06 +02:00
Oliver Tonnhofer 4ec962f002 renamed geom/clipper to geom/limit 2013-07-30 08:17:47 +02:00
Oliver Tonnhofer 61b8f9478d load -limito for diff import 2013-07-29 17:03:15 +02:00
Oliver Tonnhofer 230bec58c4 only cache added relations and ways when we have referenced ways/coords 2013-07-29 16:59:05 +02:00
Oliver Tonnhofer e3b653de6d fixed diff parser for relations 2013-07-29 16:55:17 +02:00
Oliver Tonnhofer 07f4009033 refactored progress statistics (display progress in percent) 2013-07-29 15:47:09 +02:00
Oliver Tonnhofer d5219cbf6b mv diff/cmd/process to diff/ 2013-07-29 08:18:08 +02:00
Oliver Tonnhofer 04714e266c fixed parsing of diff command options 2013-07-26 15:59:03 +02:00