You are browsing a read-only backup copy of Wikitech. The live site can be found at wikitech.wikimedia.org

User:AndreaWest/WDQS Testing/Explaining the Benchmark Queries Spreadsheet: Difference between revisions

From Wikitech-static
Jump to navigation Jump to search
imported>AndreaWest
(Created page with "Coming")
 
imported>AndreaWest
 
Line 1: Line 1:
Coming
The Wikidata SPARQL queries are defined in the [https://github.com/AndreaWesterinen/wikidata-tests/blob/main/Wikidata-Benchmark-Queries.xlsx Wikidata-Benchmark-Queries.xlsx in the wikidata-tests repository]. There are two types of tests, static ones for compliance and dynamic ones for stress and workload testing, and two worksheet pages (one sheet for each type). The WikiTech page, [https://wikitech.wikimedia.org/wiki/User:AndreaWest/WDQS_Testing WDQS Testing] defines how testing will be executed.
 
Note that over time, additional queries will be added to the workload testing to better mimic required query characteristics.
 
The following sections overview the contents of the "Compliance" and "Stress" worksheets. Each row of a worksheet defines one test.
 
__TOC__
 
== Compliance ==
The columns of the Compliance worksheet are:
* Static Query
* SELECT, ASK, CONSTRUCT, DESCRIBE
* Federation
* GeoSPARQL
* Truthy or Statement Predicates
* Solution Modifiers (Distinct, Limit, Order by, …)
* BIND, VALUES
* Algebraic Operators (Filter, Optional, Exists, …)
* Aggregation Operators (Count, Min/Max, Group by, ...)
* SPARQL Functions
* Property Paths
* Subquery
* # of Triples
* # of Join Vertices
* Largest Join Degree
* # of Variables
* Longest Chain
* Selectivity (High, Equal, Low)
* Result Set Size (Large, Medium, Small)
* Comments
** The source or inspiration for the query is listed. The following sources are used:
*** Maintenance query examples - https://www.wikidata.org/wiki/Wikidata:SPARQL_query_service/queries/examples/maintenance
*** Joal query examples - https://wikitech.wikimedia.org/wiki/User:Joal/WDQS_Queries_Analysis
*** Science query examples - https://www.wikidata.org/wiki/Wikidata:SPARQL_query_service/queries/examples#Science
*** Simple query examples - https://www.wikidata.org/wiki/Wikidata:SPARQL_query_service/queries/examples#Simple_queries
*** Showcase query examples - https://www.wikidata.org/wiki/Wikidata:SPARQL_query_service/queries/examples#Showcase_Queries
*** Example queries from https://www.wikidata.org/wiki/Wikidata:SPARQL_query_service/queries
*** Wikibase  + Wikicite + xxx from same pages as Simple queries
*** Lexeme queries from https://en.wikibooks.org/wiki/SPARQL/WIKIDATA_Lexicographical_data or https://www.wikidata.org/wiki/Wikidata:SPARQL_query_service/queries/examples#Lexeme_queries
* Future Revision
 
== Stress ==
The columns of the Stress worksheet are:
* Stress Test Query
* Based on Static Query
* SELECT, ASK, CONSTRUCT, DESCRIBE
* % of Queries
* Comments

Latest revision as of 19:18, 27 June 2022

The Wikidata SPARQL queries are defined in the Wikidata-Benchmark-Queries.xlsx in the wikidata-tests repository. There are two types of tests, static ones for compliance and dynamic ones for stress and workload testing, and two worksheet pages (one sheet for each type). The WikiTech page, WDQS Testing defines how testing will be executed.

Note that over time, additional queries will be added to the workload testing to better mimic required query characteristics.

The following sections overview the contents of the "Compliance" and "Stress" worksheets. Each row of a worksheet defines one test.

Compliance

The columns of the Compliance worksheet are:

Stress

The columns of the Stress worksheet are:

  • Stress Test Query
  • Based on Static Query
  • SELECT, ASK, CONSTRUCT, DESCRIBE
  • % of Queries
  • Comments