Commit Graph

846 Commits (master)

Author SHA1 Message Date
Oliver Tonnhofer 509ee23db9 wip: update diff importer for single transaction imports 2013-06-21 11:06:05 +02:00
Oliver Tonnhofer c8492b06f7 support non-bulk imports for diff mode 2013-06-21 11:06:05 +02:00
Oliver Tonnhofer cf984157dd first diff import 2013-06-21 11:06:05 +02:00
Oliver Tonnhofer 003e5f8f0b Revert "unmarshal items in writer"
This reverts commit c314f01886.
2013-06-21 11:05:29 +02:00
Oliver Tonnhofer bb083e9442 do not overwrite GOMAXPROCS env 2013-06-20 17:10:57 +02:00
Oliver Tonnhofer c11dc8a55e fixed calculation of worker number 2013-06-20 14:23:06 +02:00
Oliver Tonnhofer c314f01886 unmarshal items in writer 2013-06-20 14:21:20 +02:00
Oliver Tonnhofer 0b4bda5ef2 make bunch cache capacity configurable; incr default 2013-06-20 13:48:08 +02:00
Oliver Tonnhofer 1ad73517bb run generalization and index creation in parallel 2013-06-20 13:44:58 +02:00
Oliver Tonnhofer a13ca37fde create osm id index on generalized tables 2013-06-20 10:34:48 +02:00
Oliver Tonnhofer 03d96b5aae fixed closing of caches 2013-06-20 10:34:22 +02:00
Oliver Tonnhofer ecd5541c1e close caches earlier to release memory; optimize read only access for coords 2013-06-20 09:21:30 +02:00
Oliver Tonnhofer 1962abec78 fixed tests 2013-06-20 08:11:54 +02:00
Oliver Tonnhofer c071bdd15e tweaked refindex cache size 2013-06-19 16:23:04 +02:00
Oliver Tonnhofer 4d85c03f92 load refs in parallel 2013-06-19 16:05:36 +02:00
Oliver Tonnhofer 3d7a38c817 reuse refindex caches 2013-06-19 13:05:02 +02:00
Oliver Tonnhofer 99fc4dfef1 increase refindex cache size 2013-06-19 11:50:57 +02:00
Oliver Tonnhofer 6579da5526 set SRID in AddGeometryColumn; write geoms as EWKB 2013-06-19 09:19:21 +02:00
Oliver Tonnhofer 6abee98a10 Merge branch 'master' into singletransaction 2013-06-18 16:04:29 +02:00
Oliver Tonnhofer 4bf4cf712d add missing config.go file 2013-06-18 16:04:20 +02:00
Oliver Tonnhofer 4e921b723d Merge branch 'master' into singletransaction 2013-06-18 15:53:14 +02:00
Oliver Tonnhofer e6f880883b make cache options configurable 2013-06-18 15:53:04 +02:00
Oliver Tonnhofer d39703aed9 tweaked buffer sizes 2013-06-18 11:48:47 +02:00
Oliver Tonnhofer 9601dbbfde use optimized asHex function instead of Sprintf 2013-06-17 17:34:40 +02:00
Oliver Tonnhofer e520b515ab update import to public name 2013-06-17 15:56:02 +02:00
Oliver Tonnhofer 51b0c2ef4e use COPY FROM STDIN 2013-06-17 15:17:39 +02:00
Oliver Tonnhofer c1353c281a tweaking 2013-06-11 15:09:10 +02:00
Oliver Tonnhofer ef77711c60 truncate table at begin 2013-06-11 14:43:14 +02:00
Oliver Tonnhofer a415956ca7 create goroutine for each TableTx 2013-06-11 14:21:27 +02:00
Oliver Tonnhofer 8a9fe9bf2f first import with single transaction per table 2013-06-11 14:12:45 +02:00
Oliver Tonnhofer aa2c24b8d2 reorganized postgis package 2013-06-11 10:42:32 +02:00
Oliver Tonnhofer bad86777af add script for taginfo extract 2013-06-11 10:31:22 +02:00
Oliver Tonnhofer dbca8bcae5 create index on osm ids 2013-06-11 10:30:16 +02:00
Oliver Tonnhofer 0f15bacdf7 implement Deleter interface for PostGIS 2013-06-11 10:29:59 +02:00
Oliver Tonnhofer 9ccd303f93 new Deleter interface 2013-06-11 10:29:21 +02:00
Oliver Tonnhofer 76e2cc3949 return parsed diff elements in chan 2013-06-11 10:28:00 +02:00
Oliver Tonnhofer fd60373b58 reduce buffer sizes 2013-06-07 15:39:08 +02:00
Oliver Tonnhofer d6c9e1ee14 destroy geoms immediately after errors 2013-06-07 15:38:29 +02:00
Oliver Tonnhofer 84ab38c33d update comment 2013-06-05 13:27:23 +02:00
Oliver Tonnhofer 4f4cba0174 write ways first, then nodes 2013-06-05 13:27:10 +02:00
Oliver Tonnhofer e1179a08b9 remove misplaced defer 2013-06-05 13:01:26 +02:00
Oliver Tonnhofer 469b585217 do not show geos notice messages 2013-06-05 12:21:55 +02:00
Oliver Tonnhofer eb72ab9c0f destroy prepared geometry in multipolygon builder 2013-06-05 11:57:38 +02:00
Oliver Tonnhofer 6f191a49e2 validate mulitpolygons 2013-06-05 11:53:01 +02:00
Oliver Tonnhofer 4a61314f32 add tests for idToKeyBuf/idFromKeyBuf 2013-06-05 11:13:19 +02:00
Oliver Tonnhofer b1de9ebfdd store common keys as single char 2013-06-05 10:10:04 +02:00
Oliver Tonnhofer 618deea4a9 store common tags as single unicode char 2013-06-05 09:39:22 +02:00
Oliver Tonnhofer bd3024b88c release getBunch lock before loading missing coords from cache 2013-06-05 08:05:31 +02:00
Oliver Tonnhofer 9f48dbbab9 update serialize tests for removed ids 2013-06-05 08:04:53 +02:00
Oliver Tonnhofer f31323f975 do not store Ids in cache value, already stored as the key 2013-06-05 07:47:28 +02:00