RSS Feed icon

Blog

Karlsruher OSM Hack Weekend

5.03.2012 | Christine Karch

Langsam ist bei uns nach dem Hack-Weekend wieder der Alltag eingekehrt. Ein sehr angenehmes Treffen ganz unterschiedlicher Leute mit ganz unterschiedlichen Projekten. Die Teilnehmer kamen von Bonn bis München und sogar aus Zürich zu uns nach Karlsruhe. Und auch die Karlsruher Community war zahlreich vertreten.

Es wurde viel gefachsimpelt und über Dinge geredet, die man endlich mal in Angriff nehmen sollte (und ein paar davon wurden auch tatsächlich erledigt oder zumindest angefangen): Frederik hat einen neuen Relationen-Layer für die Lizenzwechsel-Anzeige im OSM Inspector gebastelt; Jochen hat ein paar Bugs im Taginfo repariert. Ich habe dem Bigmap-Tool ein Frontend mit Karte verpasst, Sarah wurde mit Nominatim-Verbesserungswünschen überhäuft, und Sven hat am deutschen Mapnik-Stil gearbeitet. Andi und Stephan sah man ODbL-Statistiken ausrechnen, und Christoph musste zwischendurch immer mal wieder vor die Tür, um den neuesten Build der gesprochenen Fahranweisungen in seinem MoNav zu testen, und vieles vieles mehr.

Der große Tintenstrahldrucker der Geofabrik hat dafür gesorgt, dass der eine oder andere ein nettes Souvenir mit nach Hause nehmen konnte.

Am Samstag Abend wurde in grosser Runde im Büro zu Abend gegessen.

Wir hatten viel Spass dabei, und es soll nicht das letzte Wochenende dieser Art gewesen sein: Als Termin für das nächste Hack-Weekend in Karlsruhe hier bei der Geofabrik haben wir den 2. und 3. Juni 2012 anvisiert. Tragt Euch das schonmal in den Kalender ein – wir melden uns rechtzeitig hier und auf der Mailingliste mit einer genaueren Planung.

Best of OSM: Ein Mapping Trip in Nangarhar

2.01.2012 | Christine Karch

Ich habe die Zeit zwischen den Jahren genutzt und Best of OpenStreetMap um einige interessante Beispiele erweitert.

Wer Best of OpenStreetMap noch nicht kennt: Es dokumentiert Meilensteine der OpenStreetMap Entwicklung. Wir zeigen herausragende Mapping-Beispiele, wenn sie eine historische Bedeutung haben oder wenn es sich ganz einfach um besonders interessante Stellen handelt.

Besonders erwähnenswert finde ich den Mapping Trip in die Regionen Beshood und Surkhrod in der
Provinz Nangarhar. Werft auch einen Blick auf diesen durchaus informativen und interessanten Blog aus Afghanistan: Jalalalaa Good!

Gleichzeitig möchte ich diese Gelegenheit nutzen, um mich vorzustellen: Seit August 2011 bin ich Mit-Geschäftsführer-/Inhaberin der Geofabrik. Ich komme aus dem Bereich der Web-Entwicklung und werde die Geofabrik insbesondere hier verstärken. Davor habe ich 9 Jahre bei plan b und 3 Jahre bei der 1&1 gearbeitet. Der OSM Community bin ich zum größten Teil noch unbekannt. Ich hoffe aber, dass sich das im Lauf der Zeit ändert, und werde meinen Teil zum Vorankommen des Projekts beitragen.

Our OSM Inspector web site is an important part of many a mapper’s toolbox. It has a series of, daily updated, debug views on OSM data, highlighting potential problems from invalid multipolygons over strange tagging or faulty geometries to missing address data.

The OSM Inspector, or OSMI for short, has several thematic views (like “geometry”, “tagging”, “boundaries”), each of which again supports a number of individually selectable layers that highlight a specific kind of problem. OSMI displays its results over an OSM base map, and you can select individual bug reports and get more information about them, or even download a list of errors for further processing. There’s extensive documentation on the OpenStreetMap Wiki.

Worldwide Routing View

While most views have always shown data computed in-house at Geofabrik, one of our views, the routing view, presents data that comes from an algorithm developed by Pascal Neis of OpenRouteService fame, and is sponsored by Skobbler. The routing view attempts to highlight obstacles to routing – mostly roads that are not connected when they should be, but also duplicate roads that may lead to strange routing results.

We do not have a sponsor for running this routing view world-wide on a daily basis right now, but we have run it once for the non-Europe part of the planet, and you can try it out here:

OSMI Routing View Non-EU

We’ll try to update this once a week or so. (The normal, sponsored routing view for Europe with daily updates is here.)

In all, OSMI has data collected by three different toolchains; one of them works globally and feeds e.g. the tagging, multipolygon, and general geometry debug views; the other two, including the routing view toolchain, currently do Europe only and would require re-writing or more hardware to cope with the whole planet.

Potlatch

It has always been possible to access OSMI views through WMS for use in other applications, especially as a background layer in editors. Users of the popular Potlatch editor were however unable to make use of this as Potlatch does not support WMS backgrounds. We have therefore configured OSMI to serve tiles as well. (We’re using the excellent open source MapProxy for that.)

If you are using Potlatch, you can now add any or all of the following background layers:

  • Geometry View: http://tools.geofabrik.de/osmi/tiles/geometry/$z/$x/$y.png
  • Places View: http://tools.geofabrik.de/osmi/tiles/places/$z/$x/$y.png
  • Tagging View: http://tools.geofabrik.de/osmi/tiles/tagging/$z/$x/$y.png
  • Highways View: http://tools.geofabrik.de/osmi/tiles/highways/$z/$x/$y.png
  • Multipolygon View: http://tools.geofabrik.de/osmi/tiles/multipolygon/$z/$x/$y.png
  • Address View (*): http://tools.geofabrik.de/osmi/tiles/addresses/$z/$x/$y.png
  • Boundaries View (*): http://tools.geofabrik.de/osmi/tiles/boundaries/$z/$x/$y.png
  • Water View (*): http://tools.geofabrik.de/osmi/tiles/water/$z/$x/$y.png
  • Routing View (*): http://tools.geofabrik.de/osmi/tiles/routing/$z/$x/$y.png
  • Routing View (non-Europe): http://tools.geofabrik.de/osmi/tiles/routing_non_eu/$z/$x/$y.png

Those marked (*), and additionally all the public transport views offered by OSMI, are currently only available for Europe. For the public transport views, use the URL components “ptri” (rail infrastructure), “ptnri” (non-rail infrastructure), “ptf” (ferries), “pts” (stops), “ptn” (network).

Note that the tiles for each view will always show all available layers at the selected zoom level; when using tiles, you cannot toggle the visibility of individual layers like you can when using OSMI through its web interface. Also, the key to colours and symbols is only available within OSMI. Therefore, even if you plan to use the tiles in your editor, it might make sense to familiarize yourself with the data presentation on OSMI first!

We hope that these changes help to further improve quality awareness and, in consequence, data quality in OSM, and we’re happy to work with potential sponsors on extending these services to support more frequent updates, additional analyses, or a wider geographical coverage.

Shiny New Shapefiles

19.09.2011 | Frederik Ramm

For years, Geofabrik has been supplying the world with OpenStreetMap Shapefiles – two kinds of them, in fact; there’s our popular download page which has free shapefile downloads for many places, updated daily, and there’s our extended shapefile service where we sell shapefiles that require more work, and processing time, than the free nightly builds.

Whereas the free nightly builds are very close to the source, simply taking OSM objects and converting them into shapefiles, the extended service, which is based on a different toolchain here at Geofabrik, has a well-documented feature catalogue which we are today releasing in version 0.6 with a ton of enhancements over the previous version. The extended service also encompasses a few useful preprocessing steps, like automatically converting area POIs to points and proper handling of large multipolygons. The extended shapefiles are made to order; the standard feature catalogue contains almost anything in OSM that is widely used, but clients can also request extra features to be added. Extended shapefiles are available for any area – the whole planet, a single continent, a single country, a city, or anything in between.

In addition to releasing our new feature catalogue for our extended shapefiles, we’ve also made a change to the free nightly builds; these now have a much-asked-for “landuse” layer that contains information from OSM’s tag of the same name.

(Eine deutsche Version folgt.)

More …

A Night at the Office

30.11.2010 | Frederik Ramm

We are sometimes asked how we produce the files on our download server. Read this if you are one of those asking.

It is 22:30 in Central Europe, and the lights come on in the Geofabrik office. (The HDD LEDs, that is.) One of the servers, named bonne, begins downloading the collected works of mappers around the world from the last 24 hours

osmosis --rri --simc --write-xml-change 2010-11-16-22:30.osc (duration 00:01:30)

and then applies them to a locally held, full copy of the OSM database (the “planet file”).

osmosis --read-xml-change 2010-11-16-22:30.osc --read-bin current-planet.osm.pbf --apply-change --write-bin new-planet.osm.pbf compress=none (00:28:09)

The newly created planet file is transferred to another server, named hammer, where a script converts it to a simple CSV-like format (the “tbf” format) and then analyzes and converts it in several steps, creating statistics and a number of shape files. The shape files are later copied to our off-site tools server where they are used by the OSM Inspector.

But bonne, of course, doesn’t sit idle. More …