location-formats: Difference between revisions

From Microformats Wiki
Jump to navigation Jump to search
(authors)
m (Reverted edits by ABIDEEN10 (Talk) to last version by Tantek)
 
(25 intermediate revisions by 11 users not shown)
Line 1: Line 1:
= Location Research =
<h1>location formats</h1>
This is a list of previous efforts at location / geographic ("Geo") data formats and protocols, as background research for developing a location format.
{{TOC-right}}
__TOC__
 
This is a list of previous efforts at location / geographic ("Geo") data formats and protocols, as background research for developing [[location]] microformats. Continuation of work from [[location-examples]], and following onto [[location-brainstorming]].


== Authors ==
== Authors ==
 
* [[User:Tantek|Tantek Çelik]]
A whole bunch of people...
* Bud Gibson
 
* Tantek Çelik
* Ryan King
* Ryan King
* Eron Wright
* ...
* ...
* please add yourself if you help(ed) with this document.
* please add yourself if you help(ed) with this document.
= Location Examples =
== What People are Publishing ==
* links to mapping services, canonical URLs to 3rd party services like:
** Google Maps
** Map Quest
** Yahoo Maps
* human / named / legislated formats
** named places, e.g. Westin St. Francis
** addresses, including zip codes
* global/mathematical/geometrical
** Lat & Lon
*** MAKE has a GeoURL button
*** Geo in RSS.  Means a particular blog post is associated with a specific lat/long.  Not specific about whether it means the location that the post was made from or the location was the post was about.
= Location Formats =


== vCard & hCard ==
== vCard & hCard ==
Line 59: Line 39:
== GeoUrl ==
== GeoUrl ==
* [http://geourl.org/ GeoURL]
* [http://geourl.org/ GeoURL]
* This seems to have a decent amount of geeky adoption, though there are lots of typical invisible metadata problems, coordinates reversed, postive instead of negative etc.
** This seems to have a decent amount of geeky adoption, though there are lots of typical invisible metadata problems, coordinates reversed, postive instead of negative etc.
* [http://www.multimap.com/ Multimap.com] provides similar functionality to GeoUrl, searching for websites and weblogs which are geotagged or ICBM tagged, and adding them to local information databases.
* [http://www.multimap.com/ Multimap.com] provides similar functionality to GeoUrl, searching for websites and weblogs which are geotagged or ICBM tagged, and adding them to local information databases.


Line 87: Line 67:
* [http://brainoff.com/worldkit/doc/polygon.php Polygons and lines in polygons] - A simple format for expressing polygons and lines is defined for worldKit
* [http://brainoff.com/worldkit/doc/polygon.php Polygons and lines in polygons] - A simple format for expressing polygons and lines is defined for worldKit
* [http://developer.yahoo.net/maps/ Yahoo Maps API] - uses "geo" ( http://www.w3.org/2003/01/geo/wgs84_pos# ) and "ymaps" ( http://api.maps.yahoo.com/Maps/V1/AnnotatedMaps.xsd ) namespaces to spatially-reference RSS as part of its API, specifically geo:lat, geo:long, ymaps:Address, ymaps:CityState, ymaps:Zip
* [http://developer.yahoo.net/maps/ Yahoo Maps API] - uses "geo" ( http://www.w3.org/2003/01/geo/wgs84_pos# ) and "ymaps" ( http://api.maps.yahoo.com/Maps/V1/AnnotatedMaps.xsd ) namespaces to spatially-reference RSS as part of its API, specifically geo:lat, geo:long, ymaps:Address, ymaps:CityState, ymaps:Zip
* [http://georss.org GeoRSS]


== RDF ==
== RDF ==
Line 127: Line 108:
Official KML  [http://www.keyhole.com/kml/kml_doc.html Docs] and [http://www.keyhole.com/kml/kml_tut.html Tutorial]
Official KML  [http://www.keyhole.com/kml/kml_doc.html Docs] and [http://www.keyhole.com/kml/kml_tut.html Tutorial]


[http://bbs.keyhole.com/boards/showflat/Board-features-Number-16076-Forum-All_Forums-Words-schema-Match-Entire%20Phrase-Searchpage-0-Limit-100-Old-allposts-Main-16076-Search-true KML Reverse Engineered Schema] (deprecated now that KML 2.0 is officially released)
[http://bbs.keyhole.com/ubb/showthreaded.php/Cat/0/Number/16076/an/khGlobe/page/0#16076 Reverse-Engineered KML Schema] (deprecated now that KML 2.0 is officially released)
 
Note that KML supports the ''altitude'' component of a coordinate to support 3D terrain.


== NMEA ==
== NMEA ==
Line 136: Line 119:


[http://en.wikipedia.org/wiki/Wikipedia:WikiProject_Geographical_coordinates Geo:Coordinates in Wikipedia Project]
[http://en.wikipedia.org/wiki/Wikipedia:WikiProject_Geographical_coordinates Geo:Coordinates in Wikipedia Project]
== ISO6709 ==
[http://en.wikipedia.org/wiki/ISO_6709 : ISO6709 Alpha-numerical representation of Latitude,Longitude,(Altitude)]


== Other Formats ==
== Other Formats ==
Line 143: Line 129:
* [http://openguides.org/ OpenGuides] and [http://b.evnt.org evnt] are both looking into real-world/folksonomic location name mappings
* [http://openguides.org/ OpenGuides] and [http://b.evnt.org evnt] are both looking into real-world/folksonomic location name mappings


= Location APIs =
== Location APIs ==


== Google Maps API ==
=== Google Maps API ===
* [http://www.google.com/apis/maps/ Google Maps API documentation]
* [http://www.google.com/apis/maps/ Google Maps API documentation]


== Yahoo Maps API ==
=== Yahoo Maps API ===
* [http://developer.yahoo.net/maps/ Yahoo Maps API documentation]
* [http://developer.yahoo.net/maps/ Yahoo Maps API documentation]


= Location Data, Tools and Sites =
== Location Data, Tools and Sites ==


== Address2Coordinates ==
=== Address2Coordinates ===
Both of these systems are freely available sources of address to lat/long mappings (US only). I think they're based on US Census data, so they might be up to date.
These systems are freely available sources of address to lat/long mappings (US only). The first few are based on US Census data, so they might be up to date.
* [http://www.census.gov/geo/www/tiger/ TIGER]
* [http://www.census.gov/geo/www/tiger/ TIGER]
* [http://www.itl.nist.gov/fipspubs/55new/nav-top-fr.htm FIPS]
* [http://www.itl.nist.gov/fipspubs/55new/nav-top-fr.htm FIPS]
Line 160: Line 146:
* You can get coordinates from UK post-codes from [http://www.streetmap.co.uk streetmap]
* You can get coordinates from UK post-codes from [http://www.streetmap.co.uk streetmap]
* Worldwide city level location data (over 4 million entries) is available from the [http://earth-info.nga.mil/gns/html/ GNS]. This is accessible as a REST service from the [http://brainoff.com/geocoder/ worldkit geocoder]
* Worldwide city level location data (over 4 million entries) is available from the [http://earth-info.nga.mil/gns/html/ GNS]. This is accessible as a REST service from the [http://brainoff.com/geocoder/ worldkit geocoder]
* [http://www.mysociety.org/?p=83 mysociety.org] is providing an interesting name-based location look-up services.  The results are returned as a CSV file! &nbsp; For instance, the query [http://gaze.mysociety.org/gaze-rest?f=find_places&country=US&state=CA&query=sunnyvale http://gaze.mysociety.org/gaze-rest?f=find_places&country=US&state=CA&query=sunnyvale] returns
<pre>
"Name","In","Near","Latitude","Longitude","State","Score"
"Sunnyvale","Santa Clara County","","37.36889","-122.03528","CA","100"
</pre>
but with a mime-type (text/csv) that browsers don't understand.


== A2B ==
=== A2B ===
[http://www.a2b.cc/ A2B] is a location based search engine. Lat and long only. Seems to pick stuff up from geo meta tags. Pages can either be manually entered or [http://www.a2b.cc/help-searching-addurl-blogping.a2b pinged]. They support lat/long and ICBM meta tags.
[http://www.a2b.cc/ A2B] is a location based search engine. Lat and long only. Seems to pick stuff up from geo meta tags. Pages can either be manually entered or [http://www.a2b.cc/help-searching-addurl-blogping.a2b pinged]. They support lat/long and ICBM meta tags.




== Plazes ==
=== Plazes ===
[http://plazes.com Plazes] is a system that does geo-info based on the network access point that the user's computer is connected to. They use tagging to identify locations.
[http://plazes.com Plazes] is a system that does geo-info based on the network access point that the user's computer is connected to. They use tagging to identify locations.


== Mapping Sites ==
=== Mapping Sites ===
* [http://www.multimap.com Multimap]
* [http://www.multimap.com Multimap]
* [http://maps.google.com Google Maps]
* [http://maps.google.com Google Maps]
Line 175: Line 168:
* [http://www.mapblast.com MapBlast]
* [http://www.mapblast.com MapBlast]
* [http://mapufacture.com mapufacture]
* [http://mapufacture.com mapufacture]
* [http://www.mister-map.com Mister-Map]


= Location Brainstorming =
== see also ==
 
* [[location]]
A lot of was discussed and figured out at the Geo Microformat BOF at O'Reilly's Where 2.0 conference.
* [[location-examples]]
 
* [[location-brainstorming]]
See the [[geo-bof-2005-06-30]] minutes/notes.
 
Conclusion was to define two new microformats to reflect the two kinds of most commonly published geo data.
 
* [[adr]] - for representing / marking-up / publishing address location information.  "adr" is simply the [[hcard|hCard]] "adr" property and all its sub-properties.
* [[geo]] - for representing / marking-up / publishing latitude longitude location information.  "geo" is simply the [[hcard|hCard]] "geo" property and all its sub-properties, with the explicitly specified datum of WGS84.
 
=Location Tagging=
 
At the [[geo-bof-2005-06-30|geo microformat BOF]] on 6/30, we discussed the idea of location tagging.  What does that mean exactly?  Here are some initial thoughts.
 
==Brief summary of thoughts at the 6/30 BOF==
 
At one point, we summarized two key axes for a potential geo microformat:
 
* Address vs. coordinate systems:  I give a location in one of the standard human ways, for instance a street address with a town, state, province, country, etc., or I give lattitude and longitude perhaps with altitude.
 
* Textual vs. URL standards:  An example of textual might be hCard.  Textual is data fields expressed in markup that can be displayed.  Our discussion of URL standards in the BOF related almost entirely to URLs that projected onto map coordinates.
 
If we are going to think about location tagging, we probably need to extend our thinking about how we will use URLs for locations.  Also, we may want to be a little less literal in how we interpret location.  The address vs. coordinate system axis is all about pinning location down to a very narrow, deterministic range.
 
Is that all location is?
 
Consider neighborhoods in San Francisco or any other city.  Where does one begin and the other end?  Are the boundaries the same over time or always agreed upon?  Yet, we use the idea of neighborhoods all the time to refer to places that are more or less there.  For instance, people more or less know the difference between "Upper Haight" and "The Sunset".  They have an idea of what these mean based partially on location and partially on the atmosphere that pervades the location.
 
Some locations might not "exist" even at this level.  Consider Poland between the world wars.
 
==What we might mean by location tagging==
 
Tagging is simply labeling artifacts on the web.  In distributed architectures, tags resolve to URLs (see [[rel-tag]]) of pages that "define" them.  The definition pages might be lists of links or even formal statements of what the tags mean.
 
Given all of this background (yes, Tantek), location tagging seems to have at least two main interpretations:
 
===Labeling a web artifact as belonging to a location=== 
 
Oddly enough, I think the most compelling idea is labeling things with the more amorphous locations like neighborhoods.  Based on all the talk around Where 2.0 where we had the BOF, location seems to have a special status.
 
I suggest a very simple extension to reltag that could do this:
 
<a href="http://servername/tag" rel="tag geo">text</a>
 
The key point being the use of "geo" as a rel attribute along with "tag".  I'll call this geotag.  I'll leave it to others to debate whether this should all be done in the rel attribute.
 
===Labeling a precisely defined location===
 
This is simply adding tags to a location.  For instance, labeling 16 Fuller Street, Brookline, MA with "first home", "Lily", "Felix", "Angela".  You might even add a geotag of "Coolidge Corner".
 
I would expect that the geo microformat would take care of the precise location in this example.
 
==How it all fits together==
 
Geotag is attractive because it is so simple from a user perspective.  No knowing coordinates, no knowing precise locations.  The geo microformat, having participated in the BOF, seems oriented toward precise locations like what you would put on a map.
 
If we look at the evolution of mapping as presented at Where 2.0, however, mapping definitely started in the less precise mode, and in fact continues in that mode today.  There is currently a google mash-up of New York burroughs with neighborhoods.  Individuals define the neighborhoods (this was at Where as a last minute addition, Nat Torkington would know who these people are).  The fact that there is a modern mash-up of this idea legitimizes its currency.
 
The question is how you marry up precision with the simple amorphous approach in geotag.  I see two ways.  One, geotag locations in the geo microformat.  That essentially attaches a geographic label to the precise location.  These can then be aggregated up in the usual tagging way as pioneered by Technorati tags.  At that stage, you have a constellation of precisely determined locations defined by the tag, and you can use the constellation of geographic coordinates to define the geographic extent of the tag so that it can be mapped.
 
Alternatively, you could come up with a definition format for geotag and use that on the page the tag URL points to.  I like the first way better because it harnesses social processes.
 
As for tagging precise locations with words like "first home", that can be easily accomplished by adding reltags to the geo microformat.  This works for evaluative tags like "vomitous" and "great".  If the tagger decides to make any tag a geotag, then the tag represents a place.  One can imagine an aggregation where we have all of the "first homes" listed as places or all of the goods listed as places.  This is to be expected and not all that bad (if you think it bad at all).  Where geotag gets its value is when place names are socially shared.  The key feature of a geotag when you apply it is that you think of it as referring to a place.  If we believe all the buzz around Where 2.0, place has importance and deserves a special designator.

Latest revision as of 04:58, 7 April 2013

location formats

This is a list of previous efforts at location / geographic ("Geo") data formats and protocols, as background research for developing location microformats. Continuation of work from location-examples, and following onto location-brainstorming.

Authors

  • Tantek Çelik
  • Bud Gibson
  • Ryan King
  • Eron Wright
  • ...
  • please add yourself if you help(ed) with this document.

vCard & hCard

vCard (RFC2426) and hcard include 'adr', a way to markup addresses. They also have a field called 'geo' for lat/long.

UPU S42 & OASIS xNAL

UPU S42 is a standard for representing postal addresses. UPU, the Universal Postal Union, is the consortium of all national posts. See UPU S42 Announcement. xNAL, the XML Name and Address Language, is an earlier attempt to standardize on the components of addresses developed by OASIS, a consortium of business-process weenies. The distinction between vCard/hCard and S42/xAL/xNAL comes down to whether the address line elements themselves are decomposed. For example, in xNAL you can specify components like street number, street prefix directional, street name, street type, street postfix directional, subaddress type (Suite), subaddress number.

It is not always possible to conclusively determine these components from an address line, even in the US where addresses are more canonical than others. "A 4TH ST W STE 10" is a legal address line in the US. The street number and name are required (in the US) so this could be canonically decomposed as streetnumber="A", streetname="4TH", streettype="ST", postdirectional="W", subtype="STE", subtypenumber="10".

UPU S42 and OASIS xNAL standards are likely overkill for tagging general web content. However, they are important standards that should be considered in web-services involving both geocoding and reverse-geocoding. Perhaps standards related to decomposed addresses is something that should be placed on another page.

In addition, there should be pointers to national address standards.

USPS publishes a complete list of canonical abbreviations for both streettypes and subtypes. Their publications are self-inconsistent, but it is easy to infer the correct mappings. See USPS Acronyms & Abbreviations

New Zealand apparently adopted a variant of xNAL NZ xNAL Guidelines Release 1.0.

ICBM

One comma seperated pair of lat/long <meta name="ICBM" content="XXX.XXXXX, XXX.XXXXX"> [1]

GeoUrl

  • GeoURL
    • This seems to have a decent amount of geeky adoption, though there are lots of typical invisible metadata problems, coordinates reversed, postive instead of negative etc.
  • Multimap.com provides similar functionality to GeoUrl, searching for websites and weblogs which are geotagged or ICBM tagged, and adding them to local information databases.

Flickr Geotags

This is somewhat of a problem though, as mechanically generated "tags" are not really tags. Including/setting Flickr "Geotags" could be considered pollution of truly user entered text, since the text of geotags is merely an encoding for a point on a map.

Geotagging

But what do these references to "geotagging" mean?

RSS

Several people have tried putting geographic information into RSS.

RDF

  • Geosemantics Interest Group
  • GeoOnion - a SW vocuabulary for relating items by distance from each other.
  • RDFMap
  • GeoRDF similar effort to collect prior art, for an effort in interoperability between OGC standards and various lightweight geo formats.

GML

Geographic Markup Language provides the most complete XML descriptiono of geographic information available. Fortunately, it is also in wide-spread use, so a commonly-used subset of the 600-page specification has emerged. GML is used in the OGC WFS payload described below.

Open Geospatical Consortium - OGC

Since 1994, Open Geospatial Consortium has been developing open specifications to enable the exchange of geographic information between applications. While some GIS vendors opposed OGC initially, essentially all commercial GIS software companies have broken down their proprietary "stovepipes" by embracing OGC specifications. The recent groundswell of ajax mapping applications can benefit tremendously from using OGC specs.

WMS

The OGC Web Map Service (WMS) specification makes it easy to request map images from a map rendering engine, such as the UMN Map Server. It is straightforward to build dynamic tiling ("slippy map") ajax applications that pull in OGC map tiles. At Where 2.0, MetaCarta demonstrated such an OGC-capable ajax GIS client. The portal map providers (yahoo/gmaps/msn/map quest) do not yet offer WMS interfaces, so someone should wrap their proprietary interfaces in a WMS wrapper to encourage them :-)

WCS

Web Coverage Service extends WMS to enable attribute information about large area overview maps.


WFS

The OGC Web Feature Service (WFS) specification is the best way to express geographic information about Web content. It is more complex than the ad hoc geoURL syntax, and for good reason: it can be loaded directly into any OGC-capable GIS even if the coordinate information is in a different projection/datum or is more complex than just a point.

WFS provides a robust means of querying for geographic entities, such as points, polygons, and more complex feature types. One can define new feature types simply by describing them. One can even specify the visual appearance of the geographic features using the OGC Styled Layer Description (SLD) specification.

WFS is to vector map data, as WMS is to raster map data.

Geographic search results, such as the yellow page information from the portals, could be presented in WFS. John Battelle commented that RSS forces publishers to attach their business model to their content, instead of to the web site holding the content, so that they can make money no matter where their content flows. The search portals will probably be forced to do the same, e.g. putting click-through ads in the RSS search results or WFS yellow page results, so that even when you display them in your customized ajax mapping application, the portal publishing the search results can still make money.

Google

Google Earth XML

20050629 at Where 2.0 conference: 

"Google Earth has an XML schema for describing a place on the earth. Will be releasing today or tomorrow." 
  - John Hanke of Google/Keyhole.

Official KML Docs and Tutorial

Reverse-Engineered KML Schema (deprecated now that KML 2.0 is officially released)

Note that KML supports the altitude component of a coordinate to support 3D terrain.

NMEA

Standard and Proprietary NMEA Sentances

Wikipedia

Geo:Coordinates in Wikipedia Project

ISO6709

: ISO6709 Alpha-numerical representation of Latitude,Longitude,(Altitude)

Other Formats

Location APIs

Google Maps API

Yahoo Maps API

Location Data, Tools and Sites

Address2Coordinates

These systems are freely available sources of address to lat/long mappings (US only). The first few are based on US Census data, so they might be up to date. 

"Name","In","Near","Latitude","Longitude","State","Score"
"Sunnyvale","Santa Clara County","","37.36889","-122.03528","CA","100"

but with a mime-type (text/csv) that browsers don't understand.

A2B

A2B is a location based search engine. Lat and long only. Seems to pick stuff up from geo meta tags. Pages can either be manually entered or pinged. They support lat/long and ICBM meta tags.


Plazes

Plazes is a system that does geo-info based on the network access point that the user's computer is connected to. They use tagging to identify locations.

Mapping Sites

see also

Retrieved from "http://microformats.org/wiki/index.php?title=location-formats&oldid=52419"