getSchema’s Microdata extractor is a REST web service to extract RDF [1] data from Microdata [2] annotations and provide the semantic information as N-Triples [5] , N3 [3] and JSON [4]. This service conforms with the Microdata2RDF specification [11] at W3C, but the generation algorithm may be different from the one proposed by the specification. This service is powered by node.js [9] and is using the jsdom [10] library.
Use our test form to try the service: http://getschema.org/microdataextractor/test
Get some test examples from: http://getschema.org/microdata2rdf/examples/
The service endpoint is http://getschema.org/microdataextractor
The following parameters are required:
rdf
, n3
and json
. Any other value is treated as invalid and the service will return an error.When missing any of the parameters the service will return an error.
The service allows only GET requests. Any other request type will return an error.
Test the service using this url: http://getschema.org/microdataextractor?url=http%3A%2F%2Fgetschema.org%2Fmicrodata2rdf%2Fexamples%2Fexample.html&out;=rdf
Requests sent to the API endpoint must be HTTP GET requests, with all arguments sent as query parameters. All arguments must be url-encoded (as per RFC 3986, [7])
rdf
, n3
and json
. Any other value is treated as invalid and the service will return an error.Consider the following HTML example and find below various possible service responses.
(See http://getschema.org/microdata2rdf/examples/example.html)
<!DOCTYPE HTML> <html> <head> <title>Untitled</title> </head> <body> <div itemid="http://www.imdb.com/title/tt0076759/" itemscope itemtype="http://schema.org/Movie" class="example"> <h3 itemprop="name">Star Wars Episode IV: A New Hope</h3> <div itemprop="description"> Set <em>a long time ago in a galaxy far, far away</em>, the film follows a group of freedom fighters known as the Rebel Alliance as they plot to destroy the powerful Death Star space station, a devastating weapon created by the evil Galactic Empire... </div> <div> <strong>Directed by: </strong> <span itemprop="director"> <span itemid="http://en.wikipedia.org/wiki/George_Lucas" itemscope itemtype="http://schema.org/Person"> <span itemprop="name">George Lucas</span> </span> </span>; <strong>Produced by: </strong> <span itemprop="producer"> <span itemscope itemtype="http://schema.org/Person" itemprop="name"> Gary Kurtz </span> </span>; <strong>Music by: </strong> <span itemprop="musicBy"> <span itemscope itemtype="http://schema.org/Person" itemprop="name"> John Williams </span> </span>; <strong>Starring: </strong> <span itemprop="actors"> <span itemscope itemtype="http://schema.org/Person" itemprop="name"> Mark Hamill </span> </span>, <span itemprop="actors"> <span itemid="http://en.wikipedia.org/wiki/Harrison_Ford" itemscope itemtype="http://schema.org/Person" itemprop="name"> Harrison Ford </span> </span>, <span itemprop="actors"> <span itemscope itemtype="http://schema.org/Person"> <span itemprop="name">Carrie Fisher</span> </span> </span>, <span itemprop="actors"> <span itemscope itemtype="http://schema.org/Person" itemprop="name"> Peter Cushing </span> </span>, <span itemprop="actors"> <span itemscope itemtype="http://schema.org/Person" itemprop="name"> Alec Guinness </span> </span> </div> <div> <strong>Studio: </strong> <span itemprop="productionCompany"> <span itemscope itemtype="http://schema.org/Organization" itemprop="name"> Lucasfilm </span> </span>; <strong>Distributed by: </strong> <span itemprop="provider"> <span itemscope itemtype="http://schema.org/Organization" itemprop="name"> 20th Century Fox </span> </span>; <strong>Release date(s): </strong> <meta itemprop="datePublished" content="1977-05-25" /> May 25, 1977; <strong>Duration: </strong> <meta itemprop="duration" content="P2H1M" /> 121 minutes; <strong>Country: </strong> <span itemprop="contentLocation"> <span itemscope itemtype="http://schema.org/Place"> United States </span> </span>; <strong>Language: </strong> <span itemprop="inLanguage">English</span> </div> </div> </body> </html>
The out
parameter will be changed according to the desired output format.
An N-Triples [5] response is sent when the out
parameter set to rdf (out=rdf
). The headers use the Content-type text/plain.
<http://www.imdb.com/title/tt0076759/> <http://www.w3.org/1999/02/22-rdf-syntax-ns#type> <http://schema.org/Movie>. <http://www.imdb.com/title/tt0076759/> <http://schema.org/name> "Star Wars Episode IV: A New Hope". <http://www.imdb.com/title/tt0076759/> <http://schema.org/description> "Set a long time ago in a galaxy far, far away, the film follows a group of freedom fighters known as the Rebel Alliance as they plot to destroy the powerful Death Star space station, a devastating weapon created by the evil Galactic Empire...". <http://en.wikipedia.org/wiki/George_Lucas> <http://www.w3.org/1999/02/22-rdf-syntax-ns#type> <http://schema.org/Person>. <http://www.imdb.com/title/tt0076759/> <http://schema.org/director> <http://en.wikipedia.org/wiki/George_Lucas>. <http://en.wikipedia.org/wiki/George_Lucas> <http://schema.org/name> "George Lucas". <_:gs0> <http://www.w3.org/1999/02/22-rdf-syntax-ns#type> <http://schema.org/Person>. <http://www.imdb.com/title/tt0076759/> <http://schema.org/producer> <_:gs0>. <_:gs0> <http://schema.org/name> "Gary Kurtz". <_:gs1> <http://www.w3.org/1999/02/22-rdf-syntax-ns#type> <http://schema.org/Person>. <http://www.imdb.com/title/tt0076759/> <http://schema.org/musicBy> <_:gs1>. <_:gs1> <http://schema.org/name> "John Williams". <_:gs2> <http://www.w3.org/1999/02/22-rdf-syntax-ns#type> <http://schema.org/Person>. <http://www.imdb.com/title/tt0076759/> <http://schema.org/actors> <_:gs2>. <_:gs2> <http://schema.org/name> "Mark Hamill". <http://en.wikipedia.org/wiki/Harrison_Ford> <http://www.w3.org/1999/02/22-rdf-syntax-ns#type> <http://schema.org/Person>. <http://www.imdb.com/title/tt0076759/> <http://schema.org/actors> <http://en.wikipedia.org/wiki/Harrison_Ford>. <http://en.wikipedia.org/wiki/Harrison_Ford> <http://schema.org/name> "Harrison Ford". <_:gs3> <http://www.w3.org/1999/02/22-rdf-syntax-ns#type> <http://schema.org/Person>. <http://www.imdb.com/title/tt0076759/> <http://schema.org/actors> <_:gs3>. <_:gs3> <http://schema.org/name> "Carrie Fisher". <_:gs4> <http://www.w3.org/1999/02/22-rdf-syntax-ns#type> <http://schema.org/Person>. <http://www.imdb.com/title/tt0076759/> <http://schema.org/actors> <_:gs4>. <_:gs4> <http://schema.org/name> "Peter Cushing". <_:gs5> <http://www.w3.org/1999/02/22-rdf-syntax-ns#type> <http://schema.org/Person>. <http://www.imdb.com/title/tt0076759/> <http://schema.org/actors> <_:gs5>. <_:gs5> <http://schema.org/name> "Alec Guinness". <_:gs6> <http://www.w3.org/1999/02/22-rdf-syntax-ns#type> <http://schema.org/Organization>. <http://www.imdb.com/title/tt0076759/> <http://schema.org/productionCompany> <_:gs6>. <_:gs6> <http://schema.org/name> "Lucasfilm". <_:gs7> <http://www.w3.org/1999/02/22-rdf-syntax-ns#type> <http://schema.org/Organization>. <http://www.imdb.com/title/tt0076759/> <http://schema.org/provider> <_:gs7>. <_:gs7> <http://schema.org/name> "20th Century Fox". <http://www.imdb.com/title/tt0076759/> <http://schema.org/datePublished> "1977-05-25". <http://www.imdb.com/title/tt0076759/> <http://schema.org/duration> "P2H1M". <_:gs8> <http://www.w3.org/1999/02/22-rdf-syntax-ns#type> <http://schema.org/Place>. <http://www.imdb.com/title/tt0076759/> <http://schema.org/contentLocation> <_:gs8>. <http://www.imdb.com/title/tt0076759/> <http://schema.org/inLanguage> "English" .
A N3 response is sent when the out
parameter set to n3 (out=n3
). The headers use the Content-type text/n3
.
@prefix rdf: <http://www.w3.org/1999/02/22-rdf-syntax-ns#>. @prefix schema: <http://schema.org/>. <http://www.imdb.com/title/tt0076759/> rdf:type <http://schema.org/Movie>; schema:name "Star Wars Episode IV: A New Hope"; schema:description "Set a long time ago in a galaxy far, far away, the film follows a group of freedom fighters known as the Rebel Alliance as they plot to destroy the powerful Death Star space station, a devastating weapon created by the evil Galactic Empire..."; schema:director <http://en.wikipedia.org/wiki/George_Lucas>; schema:producer <_:gs0>; schema:musicBy <_:gs1>; schema:actors <_:gs2>; schema:actors <http://en.wikipedia.org/wiki/Harrison_Ford>; schema:actors <_:gs3>; schema:actors <_:gs4>; schema:actors <_:gs5>; schema:productionCompany <_:gs6>; schema:provider <_:gs7>; schema:datePublished "1977-05-25"; schema:duration "P2H1M"; schema:contentLocation <_:gs8>; schema:inLanguage "English". <http://en.wikipedia.org/wiki/George_Lucas> rdf:type <http://schema.org/Person>; schema:name "George Lucas". <_:gs0> rdf:type <http://schema.org/Person>; schema:name "Gary Kurtz". <_:gs1> rdf:type <http://schema.org/Person>; schema:name "John Williams". <_:gs2> rdf:type <http://schema.org/Person>; schema:name "Mark Hamill". <http://en.wikipedia.org/wiki/Harrison_Ford> rdf:type <http://schema.org/Person>; schema:name "Harrison Ford". <_:gs3> rdf:type <http://schema.org/Person>; schema:name "Carrie Fisher". <_:gs4> rdf:type <http://schema.org/Person>; schema:name "Peter Cushing". <_:gs5> rdf:type <http://schema.org/Person>; schema:name "Alec Guinness". <_:gs6> rdf:type <http://schema.org/Organization>; schema:name "Lucasfilm". <_:gs7> rdf:type <http://schema.org/Organization>; schema:name "20th Century Fox". <_:gs8> rdf:type <http://schema.org/Place>.
A JSON response is sent when setting the out
parameter to json (out=json
). The response format follows Talis RDF-JSON [6]. It is a well formed JSON delivered using the Content-type application/json
.
{ "http://www.imdb.com/title/tt0076759/": { "http://www.w3.org/1999/02/22-rdf-syntax-ns#type": [ { "type": "uri", "value": "http://schema.org/Movie" } ], "http://schema.org/name": [ { "type": "literal", "value": "Star Wars Episode IV: A New Hope" } ], "http://schema.org/description": [ { "type": "literal", "value": "Set a long time ago in a galaxy far, far away, the film follows a group of freedom fighters known as the Rebel Alliance as they plot to destroy the powerful Death Star space station, a devastating weapon created by the evil Galactic Empire..." } ], "http://schema.org/director": [ { "type": "uri", "value": "http://en.wikipedia.org/wiki/George_Lucas" } ], "http://schema.org/producer": [ { "type": "bnode", "value": "_:gs0" } ], "http://schema.org/musicBy": [ { "type": "bnode", "value": "_:gs1" } ], "http://schema.org/actors": [ { "type": "bnode", "value": "_:gs2" }, { "type": "uri", "value": "http://en.wikipedia.org/wiki/Harrison_Ford" }, { "type": "bnode", "value": "_:gs3" }, { "type": "bnode", "value": "_:gs4" }, { "type": "bnode", "value": "_:gs5" } ], "http://schema.org/productionCompany": [ { "type": "bnode", "value": "_:gs6" } ], "http://schema.org/provider": [ { "type": "bnode", "value": "_:gs7" } ], "http://schema.org/datePublished": [ { "type": "literal", "value": "1977-05-25" } ], "http://schema.org/duration": [ { "type": "literal", "value": "P2H1M" } ], "http://schema.org/contentLocation": [ { "type": "bnode", "value": "_:gs8" } ], "http://schema.org/inLanguage": [ { "type": "literal", "value": "English" } ] }, "http://en.wikipedia.org/wiki/George_Lucas": { "http://www.w3.org/1999/02/22-rdf-syntax-ns#type": [ { "type": "uri", "value": "http://schema.org/Person" } ], "http://schema.org/name": [ { "type": "literal", "value": "George Lucas" } ] }, "_:gs0": { "http://www.w3.org/1999/02/22-rdf-syntax-ns#type": [ { "type": "uri", "value": "http://schema.org/Person" } ], "http://schema.org/name": [ { "type": "literal", "value": "Gary Kurtz" } ] }, "_:gs1": { "http://www.w3.org/1999/02/22-rdf-syntax-ns#type": [ { "type": "uri", "value": "http://schema.org/Person" } ], "http://schema.org/name": [ { "type": "literal", "value": "John Williams" } ] }, "_:gs2": { "http://www.w3.org/1999/02/22-rdf-syntax-ns#type": [ { "type": "uri", "value": "http://schema.org/Person" } ], "http://schema.org/name": [ { "type": "literal", "value": "Mark Hamill" } ] }, "http://en.wikipedia.org/wiki/Harrison_Ford": { "http://www.w3.org/1999/02/22-rdf-syntax-ns#type": [ { "type": "uri", "value": "http://schema.org/Person" } ], "http://schema.org/name": [ { "type": "literal", "value": "Harrison Ford" } ] }, "_:gs3": { "http://www.w3.org/1999/02/22-rdf-syntax-ns#type": [ { "type": "uri", "value": "http://schema.org/Person" } ], "http://schema.org/name": [ { "type": "literal", "value": "Carrie Fisher" } ] }, "_:gs4": { "http://www.w3.org/1999/02/22-rdf-syntax-ns#type": [ { "type": "uri", "value": "http://schema.org/Person" } ], "http://schema.org/name": [ { "type": "literal", "value": "Peter Cushing" } ] }, "_:gs5": { "http://www.w3.org/1999/02/22-rdf-syntax-ns#type": [ { "type": "uri", "value": "http://schema.org/Person" } ], "http://schema.org/name": [ { "type": "literal", "value": "Alec Guinness" } ] }, "_:gs6": { "http://www.w3.org/1999/02/22-rdf-syntax-ns#type": [ { "type": "uri", "value": "http://schema.org/Organization" } ], "http://schema.org/name": [ { "type": "literal", "value": "Lucasfilm" } ] }, "_:gs7": { "http://www.w3.org/1999/02/22-rdf-syntax-ns#type": [ { "type": "uri", "value": "http://schema.org/Organization" } ], "http://schema.org/name": [ { "type": "literal", "value": "20th Century Fox" } ] }, "_:gs8": { "http://www.w3.org/1999/02/22-rdf-syntax-ns#type": [ { "type": "uri", "value": "http://schema.org/Place" } ] } }
All service errors are delivered using JSON format. The following kinds of errors may occur:
Iframes are not loaded.
Scripts are loaded when the script
element is annotated with an itemtype
attribute with the value http://schema.org/WebPageElement/Script
.
There might be other limitations regarding the triple extraction such as duplicates since we are still in beta.
While itemid
is supported, itemref
is not.
The property schema:additionalType
is not processed and multiple item types for the same itemscope are not yet supported too.
RuleTheWeb! – A Firefox Extension consuming Schema.org Annotations
This service is offered free of charge by http://binarypark.org
You must follow any policies made available to you within the Services.
We believe you will not misuse this service, rather may find it helpful. However, just in case:
Using this service does not give you ownership of any intellectual property rights related to the service or the content you access. You may not use content from our Services unless you obtain permission from its owner or are otherwise permitted by law. These terms do not grant you the right to use any branding or logos used in this service. Don?t remove, obscure, or alter any legal notices displayed in or along with the service.
This service provides content that is not owned by the service provider. This content is the sole responsibility of the entity that makes it available.
The terms of use can change at any time and is not the provider responsibility to inform you.
More necessary information may be found at http://binarypark.org.
Would you be interested to learn more or to contribute to this service, please contact us at mtg(at)binarypark.org.
[1] Resource Description Framework (RDF), http://www.w3.org/RDF/
[2] HTML5 Microdata, http://www.whatwg.org/specs/web-apps/current-work/multipage/microdata.html
[3] Notation3 (N3): A readable RDF syntax, http://www.w3.org/TeamSubmission/n3/
[4] JavaScript Object Notation, http://json.org/
[5] RDF N-Triples Syntax, http://www.w3.org/TR/rdf-testcases/#ntriples but also http://www.w3.org/2011/rdf-wg/wiki/N-Triples-Format
[6] RDF-JSON Specification, http://docs.api.talis.com/platform-api/output-types/rdf-json
[7] Uniform Resource Identifier (URI): Generic Syntax (RFC3986), http://www.ietf.org/rfc/rfc3986.txt
[8] Web Application Description Language (WADL), http://www.w3.org/Submission/wadl/
[9] node.js http://nodejs.org
[10] jsdom – A JavaScript implementation of the DOM, for use with node.js, https://github.com/tmpvar/jsdom
[11] Microdata to RDF: Transformation from HTML+Microdata to RDF, W3C Interest Group Note 08 March 2012, http://www.w3.org/TR/microdata-rdf/