location-formats: Difference between revisions

From Microformats Wiki
Jump to navigation Jump to search
m (Reverted edits by ABIDEEN10 (Talk) to last version by Tantek)
 
(38 intermediate revisions by 17 users not shown)
Line 1: Line 1:
= Location Formats =
<h1>location formats</h1>
__TOC__
{{TOC-right}}
This is a list of previous efforts at location / geographic ("Geo") data formats and protocols, as background research for developing a location format.
 
This is a list of previous efforts at location / geographic ("Geo") data formats and protocols, as background research for developing [[location]] microformats. Continuation of work from [[location-examples]], and following onto [[location-brainstorming]].
 
== Authors ==
* [[User:Tantek|Tantek Çelik]]
* Bud Gibson
* Ryan King
* Eron Wright
* ...
* please add yourself if you help(ed) with this document.


== vCard & hCard ==
== vCard & hCard ==
vCard (RFC2426) and [[hcard]] includes 'adr', a way to markup addresses. There is also a field called 'geo' for lat/long.
vCard (RFC2426) and [[hcard]] include 'adr', a way to markup addresses. They also have a field called 'geo' for lat/long.


== UPU S42 & OASIS xNAL ==
== UPU S42 & OASIS xNAL ==
Line 25: Line 34:


== ICBM ==
== ICBM ==
Comma seperated list of lat/long <code><meta name="ICBM" content="XXX.XXXXX, XXX.XXXXX"></code>
One comma seperated pair of lat/long <code><meta name="ICBM" content="XXX.XXXXX, XXX.XXXXX"></code>
[http://www.catb.org/~esr/jargon/html/I/ICBM-address.html]
[http://www.catb.org/~esr/jargon/html/I/ICBM-address.html]
This is incorrect. It is one pair, not a list.


== GeoUrl ==
== GeoUrl ==
* [http://geourl.org/ GeoURL]
* [http://geourl.org/ GeoURL]
** This seems to have a decent amount of geeky adoption, though there are lots of typical invisible metadata problems, coordinates reversed, postive instead of negative etc.
* [http://www.multimap.com/ Multimap.com] provides similar functionality to GeoUrl, searching for websites and weblogs which are geotagged or ICBM tagged, and adding them to local information databases.
* [http://www.multimap.com/ Multimap.com] provides similar functionality to GeoUrl, searching for websites and weblogs which are geotagged or ICBM tagged, and adding them to local information databases.


Line 41: Line 49:
* [http://mappr.com mappr], [http://brainoff.com/worldkit/flick mapping flickr] also support these geotags.
* [http://mappr.com mappr], [http://brainoff.com/worldkit/flick mapping flickr] also support these geotags.
* flickr also supports [http://www.flickr.com/services/api/flickr.photos.getExif.html EXIF headers], which can be used for storing location.
* flickr also supports [http://www.flickr.com/services/api/flickr.photos.getExif.html EXIF headers], which can be used for storing location.
* [http://beta.plazes.com plazes] also allows flickr photos to be tagged with geotags
This is somewhat of a problem though, as mechanically generated "tags" are not really tags.  Including/setting Flickr "Geotags" could be considered pollution of truly user entered text, since the text of geotags is merely an encoding for a point on a map.


== Geotagging ==
== Geotagging ==
* Geotagging has been employed in other hosted services: [http://brainoff.com/worldkit/delicious/ delicious], [http://worldkit.typepad.com/ Typepad], [http://blog.360.yahoo.com/blog-yRZQpvY8cq2kWXBO5ZrxEmrwsg--?p=9 Yahoo 360]
* Geotagging has been employed in other hosted services: [http://brainoff.com/worldkit/delicious/ delicious], [http://worldkit.typepad.com/ Typepad], [http://blog.360.yahoo.com/blog-yRZQpvY8cq2kWXBO5ZrxEmrwsg--?p=9 Yahoo 360], [http://www.zoto.com/users/geotags/ Zoto]


== A2B ==
But what do these references to "geotagging" mean?
[http://www.a2b.cc/ A2B] is a location based search engine. Lat and long only. Seems to pick stuff up from geo meta tags. Pages can either be manually entered or [http://www.a2b.cc/help-searching-addurl-blogping.a2b pinged]. They support lat/long and ICBM meta tags.


== RSS ==
== RSS ==
Line 57: Line 67:
* [http://brainoff.com/worldkit/doc/polygon.php Polygons and lines in polygons] - A simple format for expressing polygons and lines is defined for worldKit
* [http://brainoff.com/worldkit/doc/polygon.php Polygons and lines in polygons] - A simple format for expressing polygons and lines is defined for worldKit
* [http://developer.yahoo.net/maps/ Yahoo Maps API] - uses "geo" ( http://www.w3.org/2003/01/geo/wgs84_pos# ) and "ymaps" ( http://api.maps.yahoo.com/Maps/V1/AnnotatedMaps.xsd ) namespaces to spatially-reference RSS as part of its API, specifically geo:lat, geo:long, ymaps:Address, ymaps:CityState, ymaps:Zip
* [http://developer.yahoo.net/maps/ Yahoo Maps API] - uses "geo" ( http://www.w3.org/2003/01/geo/wgs84_pos# ) and "ymaps" ( http://api.maps.yahoo.com/Maps/V1/AnnotatedMaps.xsd ) namespaces to spatially-reference RSS as part of its API, specifically geo:lat, geo:long, ymaps:Address, ymaps:CityState, ymaps:Zip
* [http://georss.org GeoRSS]


== Address2Coordinates ==
== RDF ==
Both of these systems are freely available sources of address to lat/long mappings (US only). I think they're based on US Census data, so they might be up to date.
* [http://www.census.gov/geo/www/tiger/ TIGER]
* [http://www.itl.nist.gov/fipspubs/55new/nav-top-fr.htm FIPS]
* [http://geocoder.us/ geocoder]
* You can get coordinates from UK post-codes from [http://www.streetmap.co.uk streetmap]
* Worldwide city level location data (over 4 million entries) is available from the [http://earth-info.nga.mil/gns/html/ GNS]. This is accessible as a REST service from the [http://brainoff.com/geocoder/ worldkit geocoder]
 
== Plazes ==
[http://plazes.com Plazes] is a system that does geo-info based on the network access point that the user's computer is connected to. They use tagging to identify locations.
 
== Mapping Sites ==
* [http://www.multimap.com Multimap]
* [http://maps.google.com Google Maps]
* [http://www.mapquest.com MapQuest]
* [http://maps.yahoo.com Yahoo Maps]
* [http://www.mapblast.com MapBlast]
* [http://mapufacture.com mapufacture]
 
== Semantic Web ==
* [http://www.geosemantics.org/ Geosemantics Interest Group]
* [http://www.geosemantics.org/ Geosemantics Interest Group]
* [http://esw.w3.org/topic/GeoOnion GeoOnion] - a SW vocuabulary for relating items by distance from each other.
* [http://esw.w3.org/topic/GeoOnion GeoOnion] - a SW vocuabulary for relating items by distance from each other.
Line 84: Line 76:


== GML ==
== GML ==
[http://www.opengeospatial.org/docs/02-023r4.pdf Geographic Markup Language] - a "600 page standard"
[http://www.opengeospatial.org/docs/02-023r4.pdf Geographic Markup Language] provides the most complete XML descriptiono of geographic information available.  Fortunately, it is also in wide-spread use, so a commonly-used subset of the 600-page specification has emerged.  GML is used in the OGC WFS payload described below.
 
== Google ==
=== Google Earth XML ===
20050629 at Where 2.0 conference:
  "Google Earth has an XML schema for describing a place on the earth. Will be releasing today or tomorrow."
  - John Hanke of Google/Keyhole.
Official KML [http://www.keyhole.com/kml/kml_doc.html Docs] and [http://www.keyhole.com/kml/kml_tut.html Tutorial]
 
[http://bbs.keyhole.com/boards/showflat/Board-features-Number-16076-Forum-All_Forums-Words-schema-Match-Entire%20Phrase-Searchpage-0-Limit-100-Old-allposts-Main-16076-Search-true KML Reverse Engineered Schema] (depricated now that KML 2.0 is officially released)
 
=== Google Maps API ===
* [http://www.google.com/apis/maps/ Google Maps API documentation]
 
== Yahoo Maps API ==
* [http://developer.yahoo.net/maps/ Yahoo Maps API documentation]
 


<blockquote style="background: white; border: 1px solid black; padding: 1em;">
<blockquote style="background: white; border: 1px solid black; padding: 1em;">
== OGC ==
== Open Geospatical Consortium - OGC ==
Since 1994, [http://www.opengeospatial.org/ Open Geospatial Consortium] has been developing open specifications to enable the exchange of geographic information between applications.  While some GIS vendors opposed OGC initially, essentially all commercial GIS software companies have broken down their proprietary "stovepipes" by embracing OGC specifications.  The recent groundswell of ajax mapping applications can benefit tremendously from using OGC specs.
Since 1994, [http://www.opengeospatial.org/ Open Geospatial Consortium] has been developing open specifications to enable the exchange of geographic information between applications.  While some GIS vendors opposed OGC initially, essentially all commercial GIS software companies have broken down their proprietary "stovepipes" by embracing OGC specifications.  The recent groundswell of ajax mapping applications can benefit tremendously from using OGC specs.


Line 124: Line 100:


</blockquote>
</blockquote>
== Google ==
=== Google Earth XML ===
20050629 at Where 2.0 conference:
"Google Earth has an XML schema for describing a place on the earth. Will be releasing today or tomorrow."
  - John Hanke of Google/Keyhole.
Official KML  [http://www.keyhole.com/kml/kml_doc.html Docs] and [http://www.keyhole.com/kml/kml_tut.html Tutorial]
[http://bbs.keyhole.com/ubb/showthreaded.php/Cat/0/Number/16076/an/khGlobe/page/0#16076 Reverse-Engineered KML Schema] (deprecated now that KML 2.0 is officially released)
Note that KML supports the ''altitude'' component of a coordinate to support 3D terrain.


== NMEA ==
== NMEA ==
Line 133: Line 120:
[http://en.wikipedia.org/wiki/Wikipedia:WikiProject_Geographical_coordinates Geo:Coordinates in Wikipedia Project]
[http://en.wikipedia.org/wiki/Wikipedia:WikiProject_Geographical_coordinates Geo:Coordinates in Wikipedia Project]


 
== ISO6709 ==
 
[http://en.wikipedia.org/wiki/ISO_6709 : ISO6709 Alpha-numerical representation of Latitude,Longitude,(Altitude)]
== What People are Publishing ==
 
* links to mapping services, canonical URLs to 3rd party services like:
** Google Maps
** Map Quest
** Yahoo Maps
 
* human / named / legislated formats
** named places, e.g. Westin St. Francis
** addresses, including zip codes
 
* global/mathematical/geometrical
** Lat & Lon
*** MAKE has a GeoURL button
*** Geo in RSS.  Means a particular blog post is associated with a specific lat/long.  Not specific about whether it means the location that the post was made from or the location was the post was about.


== Other Formats ==
== Other Formats ==
(move these into lists near top of document)


* GPX = GPS XML format
* GPX = GPS XML format
* [http://en.wikipedia.org/wiki/Wikipedia:WikiProject_Geographical_coordinates Wikipedia markup styles]
* [http://en.wikipedia.org/wiki/Wikipedia:WikiProject_Geographical_coordinates Wikipedia markup styles]
* [http://openguides.org/ OpenGuides] and [http://b.evnt.org evnt] are both looking into real-world/folksonomic location name mappings


=Location Tagging=
== Location APIs ==


At the BOF on 6/30, we discussed the idea of location tagging. What does that mean exactly?  Here are some initial thoughts.
=== Google Maps API ===
* [http://www.google.com/apis/maps/ Google Maps API documentation]


==Brief summary of thoughts at the 6/30 BOF==
=== Yahoo Maps API ===
* [http://developer.yahoo.net/maps/ Yahoo Maps API documentation]


At one point, we summarized two key axes for a potential geo microformat:
== Location Data, Tools and Sites ==


* Address vs. coordinate systems: I give a location in one of the standard human ways, for instance a street address with a town, state, province, country, etc., or I give lattitude and longitude perhaps with altitude.
=== Address2Coordinates ===
These systems are freely available sources of address to lat/long mappings (US only). The first few are based on US Census data, so they might be up to date.
* [http://www.census.gov/geo/www/tiger/ TIGER]
* [http://www.itl.nist.gov/fipspubs/55new/nav-top-fr.htm FIPS]
* [http://geocoder.us/ geocoder]
* You can get coordinates from UK post-codes from [http://www.streetmap.co.uk streetmap]
* Worldwide city level location data (over 4 million entries) is available from the [http://earth-info.nga.mil/gns/html/ GNS]. This is accessible as a REST service from the [http://brainoff.com/geocoder/ worldkit geocoder]
* [http://www.mysociety.org/?p=83 mysociety.org] is providing an interesting name-based location look-up services.  The results are returned as a CSV file! &nbsp; For instance, the query [http://gaze.mysociety.org/gaze-rest?f=find_places&country=US&state=CA&query=sunnyvale http://gaze.mysociety.org/gaze-rest?f=find_places&country=US&state=CA&query=sunnyvale] returns


* Textual vs. URL standards:  An example of textual might be hCard. Textual is data fields expressed in markup that can be displayed.  Our discussion of URL standards in the BOF related almost entirely to URLs that projected onto map coordinates.
<pre>
"Name","In","Near","Latitude","Longitude","State","Score"
"Sunnyvale","Santa Clara County","","37.36889","-122.03528","CA","100"
</pre>
but with a mime-type (text/csv) that browsers don't understand.


If we are going to think about location tagging, we probably need to extend our thinking about how we will use URLs for locations. Also, we may want to be a little less literal in how we interpret location. The address vs. coordinate system axis is all about pinning location down to a very narrow, deterministic range.
=== A2B ===
[http://www.a2b.cc/ A2B] is a location based search engine. Lat and long only. Seems to pick stuff up from geo meta tags. Pages can either be manually entered or [http://www.a2b.cc/help-searching-addurl-blogping.a2b pinged]. They support lat/long and ICBM meta tags.


Is that all location is?


Consider neighborhoods in San Francisco or any other city. Where does one begin and the other end?  Are the boundaries the same over time or always agreed upon?  Yet, we use the idea of neighborhoods all the time to refer to places that are more or less there.  For instance, people more or less know the difference between "Upper Haight" and "The Sunset". They have an idea of what these mean based partially on location and partially on the atmosphere that pervades the location.
=== Plazes ===
[http://plazes.com Plazes] is a system that does geo-info based on the network access point that the user's computer is connected to. They use tagging to identify locations.


Some locations might not "exist" even at this level.  Consider Poland between the world wars.
=== Mapping Sites ===
 
* [http://www.multimap.com Multimap]
==What we might mean by location tagging==
* [http://maps.google.com Google Maps]
 
* [http://www.mapquest.com MapQuest]
Tagging is simply labeling artifacts on the web.  In distributed architectures, tags resolve to URLs (see [[rel-tag]]) of pages that "define" them. The definition pages might be lists of links or even formal statements of what the tags mean.
* [http://maps.yahoo.com Yahoo Maps]
 
* [http://www.mapblast.com MapBlast]
Given all of this background (yes, Tantek), location tagging seems to have at least two main interpretations:
* [http://mapufacture.com mapufacture]
 
* [http://www.mister-map.com Mister-Map]
===Labeling a web artifact as belonging to a location=== 
 
Oddly enough, I think the most compelling idea is labeling things with the more amorphous locations like neighborhoods. Based on all the talk around Where 2.0 where we had the BOF, location seems to have a special status.
 
I suggest a very simple extension to reltag that could do this:
 
<a href="http://servername/tag" rel="tag geo">text</a>
 
The key point being the use of "geo" as a rel attribute along with "tag". I'll call this geotag.  I'll leave it to others to debate whether this should all be done in the rel attribute.
 
===Labeling a precisely defined location===
 
This is simply adding tags to a location. For instance, labeling 16 Fuller Street, Brookline, MA with "first home", "Lily", "Felix", "Angela".  You might even add a geotag of "Coolidge Corner".
 
I would expect that the geo microformat would take care of the precise location in this example.
 
==How it all fits together==
 
Geotag is attractive because it is so simple from a user perspective. No knowing coordinates, no knowing precise locations.  The geo microformat, having participated in the BOF, seems oriented toward precise locations like what you would put on a map.
 
If we look at the evolution of mapping as presented at Where 2.0, however, mapping definitely started in the less precise mode, and in fact continues in that mode today.  There is currently a google mash-up of New York burroughs with neighborhoods.  Individuals define the neighborhoods (this was at Where as a last minute addition, Nat Torkington would know who these people are).  The fact that there is a modern mash-up of this idea legitimizes its currency.
 
The question is how you marry up precision with the simple amorphous approach in geotag.  I see two ways.  One, geotag locations in the geo microformat.  That essentially attaches a geographic label to the precise location.  These can then be aggregated up in the usual tagging way as pioneered by Technorati tags.  At that stage, you have a constellation of precisely determined locations defined by the tag, and you can use the constellation of geographic coordinates to define the geographic extent of the tag so that it can be mapped.
 
Alternatively, you could come up with a definition format for geotag and use that on the page the tag URL points to.  I like the first way better because it harnesses social processes.


As for tagging precise locations with words like "first home", that can be easily accomplished by adding reltags to the geo microformat.  This works for evaluative tags like "vomitous" and "great".  If the tagger decides to make any tag a geotag, then the tag represents a place.  One can imagine an aggregation where we have all of the "first homes" listed as places or all of the goods listed as places.  This is to be expected and not all that bad (if you think it bad at all).  Where geotag gets its value is when place names are socially shared.  The key feature of a geotag when you apply it is that you think of it as referring to a place.  If we believe all the buzz around Where 2.0, place has importance and deserves a special designator.
== see also ==
* [[location]]
* [[location-examples]]
* [[location-brainstorming]]

Latest revision as of 04:58, 7 April 2013

location formats

This is a list of previous efforts at location / geographic ("Geo") data formats and protocols, as background research for developing location microformats. Continuation of work from location-examples, and following onto location-brainstorming.

Authors

  • Tantek Çelik
  • Bud Gibson
  • Ryan King
  • Eron Wright
  • ...
  • please add yourself if you help(ed) with this document.

vCard & hCard

vCard (RFC2426) and hcard include 'adr', a way to markup addresses. They also have a field called 'geo' for lat/long.

UPU S42 & OASIS xNAL

UPU S42 is a standard for representing postal addresses. UPU, the Universal Postal Union, is the consortium of all national posts. See UPU S42 Announcement. xNAL, the XML Name and Address Language, is an earlier attempt to standardize on the components of addresses developed by OASIS, a consortium of business-process weenies. The distinction between vCard/hCard and S42/xAL/xNAL comes down to whether the address line elements themselves are decomposed. For example, in xNAL you can specify components like street number, street prefix directional, street name, street type, street postfix directional, subaddress type (Suite), subaddress number.

It is not always possible to conclusively determine these components from an address line, even in the US where addresses are more canonical than others. "A 4TH ST W STE 10" is a legal address line in the US. The street number and name are required (in the US) so this could be canonically decomposed as streetnumber="A", streetname="4TH", streettype="ST", postdirectional="W", subtype="STE", subtypenumber="10".

UPU S42 and OASIS xNAL standards are likely overkill for tagging general web content. However, they are important standards that should be considered in web-services involving both geocoding and reverse-geocoding. Perhaps standards related to decomposed addresses is something that should be placed on another page.

In addition, there should be pointers to national address standards.

USPS publishes a complete list of canonical abbreviations for both streettypes and subtypes. Their publications are self-inconsistent, but it is easy to infer the correct mappings. See USPS Acronyms & Abbreviations

New Zealand apparently adopted a variant of xNAL NZ xNAL Guidelines Release 1.0.

ICBM

One comma seperated pair of lat/long <meta name="ICBM" content="XXX.XXXXX, XXX.XXXXX"> [1]

GeoUrl

  • GeoURL
    • This seems to have a decent amount of geeky adoption, though there are lots of typical invisible metadata problems, coordinates reversed, postive instead of negative etc.
  • Multimap.com provides similar functionality to GeoUrl, searching for websites and weblogs which are geotagged or ICBM tagged, and adding them to local information databases.

Flickr Geotags

This is somewhat of a problem though, as mechanically generated "tags" are not really tags. Including/setting Flickr "Geotags" could be considered pollution of truly user entered text, since the text of geotags is merely an encoding for a point on a map.

Geotagging

But what do these references to "geotagging" mean?

RSS

Several people have tried putting geographic information into RSS.

RDF

  • Geosemantics Interest Group
  • GeoOnion - a SW vocuabulary for relating items by distance from each other.
  • RDFMap
  • GeoRDF similar effort to collect prior art, for an effort in interoperability between OGC standards and various lightweight geo formats.

GML

Geographic Markup Language provides the most complete XML descriptiono of geographic information available. Fortunately, it is also in wide-spread use, so a commonly-used subset of the 600-page specification has emerged. GML is used in the OGC WFS payload described below.

Open Geospatical Consortium - OGC

Since 1994, Open Geospatial Consortium has been developing open specifications to enable the exchange of geographic information between applications. While some GIS vendors opposed OGC initially, essentially all commercial GIS software companies have broken down their proprietary "stovepipes" by embracing OGC specifications. The recent groundswell of ajax mapping applications can benefit tremendously from using OGC specs.

WMS

The OGC Web Map Service (WMS) specification makes it easy to request map images from a map rendering engine, such as the UMN Map Server. It is straightforward to build dynamic tiling ("slippy map") ajax applications that pull in OGC map tiles. At Where 2.0, MetaCarta demonstrated such an OGC-capable ajax GIS client. The portal map providers (yahoo/gmaps/msn/map quest) do not yet offer WMS interfaces, so someone should wrap their proprietary interfaces in a WMS wrapper to encourage them :-)

WCS

Web Coverage Service extends WMS to enable attribute information about large area overview maps.


WFS

The OGC Web Feature Service (WFS) specification is the best way to express geographic information about Web content. It is more complex than the ad hoc geoURL syntax, and for good reason: it can be loaded directly into any OGC-capable GIS even if the coordinate information is in a different projection/datum or is more complex than just a point.

WFS provides a robust means of querying for geographic entities, such as points, polygons, and more complex feature types. One can define new feature types simply by describing them. One can even specify the visual appearance of the geographic features using the OGC Styled Layer Description (SLD) specification.

WFS is to vector map data, as WMS is to raster map data.

Geographic search results, such as the yellow page information from the portals, could be presented in WFS. John Battelle commented that RSS forces publishers to attach their business model to their content, instead of to the web site holding the content, so that they can make money no matter where their content flows. The search portals will probably be forced to do the same, e.g. putting click-through ads in the RSS search results or WFS yellow page results, so that even when you display them in your customized ajax mapping application, the portal publishing the search results can still make money.

Google

Google Earth XML

20050629 at Where 2.0 conference: 

"Google Earth has an XML schema for describing a place on the earth. Will be releasing today or tomorrow." 
  - John Hanke of Google/Keyhole.

Official KML Docs and Tutorial

Reverse-Engineered KML Schema (deprecated now that KML 2.0 is officially released)

Note that KML supports the altitude component of a coordinate to support 3D terrain.

NMEA

Standard and Proprietary NMEA Sentances

Wikipedia

Geo:Coordinates in Wikipedia Project

ISO6709

: ISO6709 Alpha-numerical representation of Latitude,Longitude,(Altitude)

Other Formats

Location APIs

Google Maps API

Yahoo Maps API

Location Data, Tools and Sites

Address2Coordinates

These systems are freely available sources of address to lat/long mappings (US only). The first few are based on US Census data, so they might be up to date. 

"Name","In","Near","Latitude","Longitude","State","Score"
"Sunnyvale","Santa Clara County","","37.36889","-122.03528","CA","100"

but with a mime-type (text/csv) that browsers don't understand.

A2B

A2B is a location based search engine. Lat and long only. Seems to pick stuff up from geo meta tags. Pages can either be manually entered or pinged. They support lat/long and ICBM meta tags.


Plazes

Plazes is a system that does geo-info based on the network access point that the user's computer is connected to. They use tagging to identify locations.

Mapping Sites

see also

Retrieved from "http://microformats.org/wiki/index.php?title=location-formats&oldid=52419"