Open GIS Test Suite Release Notes


\| Return to Start Page \|

Open GIS Test Suite Release Notes

General

This is the sixth general acceptance release (ga2.4) of the OGC test suite.

If bugs are found within the tests suite then bug reports can be raised through the links at the foot of each screen.

NOTE: Due to an interoperability problem between Internet Explorer and Apache, when creating a new user account with IE, you will need to log out of the browser and log in again to stop being asked for your login details for every request. This is only for the first time you create an account.

WFS Testing

The Web Feature Service tests scripts are designed to test WFS implementations based on the WFS 1.0.0 specification.

The test engine will read the capabilities document from the server and use the values in this document to identify the tests that are to be run. A sample capabilities document can be obtained at WfsCapabilities.xml

The GML schemas for the test features can be downloaded from dataFeatures.xsd, geometryFeatures.xsd and complexFeatures.xsd and loaded into the WFS before executing the tests for the first time.

The tests for a basic WFS require test data to be loaded before the tests are run, this test data is not changed by the tests so will only need to be only loaded once. The test data can be downloaded as a WFS transaction with GML from Wfs basic test data and Wfs complex value test data (if complex values are supported, see checkbox below to enable these tests).

The tests for a transactional and locking WFS require test data to be loaded before the tests are run, this test data is changed by the tests so will need to be loaded before every test run. The test data can be downloaded as a WFS transaction with GML from Wfs lock test data and Wfs transaction test data

Each of the above schemas use a different namespace, if your product only supports a single namespace you may run the tests multiple times, once for each dataset and then combine the passes from each run to generate your final score. The OGC does however recommend that vendors implement multiple namespace support.

The orginal Filter 1.0.0 specification describes the DWithin operator but did not include this in the capabilities schema in the specification. This was an oversight and the official schemas on http://schemas.opengis.net have been updated to include this operator. The CITE tests use this schema for validation of the capabilities document.

WMS Testing

The Web Map Service tests scripts are designed to test WMS implementations based on the WMS 1.1.1 specification.

Many of the tests require implementation of a standard dataset. The dataset is described in Section 1. B. of the Test Requirements and Assertions document. It is available in GML, MapInfo Interchange Format, and ESRI Shapefile f ormat and can be downloaded here. Implementation of the dataset is required for certification.

Changes since the previous release (version ga2.3)

This version addresses all of the bugs that were raised, or not fixed since the previous version. There are also a number of enhancements
Number of bug reports submitted.

Area Number of bug reports

Test Engine 2

WFS tests 0

WMS tests 0

GML Validator
0

The following concerns bugs raised against the previous general acceptance release of the test suite.

Bug Number Description Status Comment

0096
Allow http "head" requests
Closed (Change Required)
This enhancement has now been added to this version of the test engine.

0098 The test engine cannot distinguish GML schema defined in WFS and GML schema in WCS
Closed (Change Required)
This enhancement has now been added to this version of the test engine.

Also in addition to the two bugs/enhancements, the test engine has been modified so that the 'validategml' attribute of a request has been deprecated, and replaced with 'validatexml'.

Changes since the previous release (version ga2.2)

This version addresses all of the bugs that were raised, or not fixed since the previous version
Number of bug reports submitted.

Area Number of bug reports

Test Engine 1

WFS tests 0

WMS tests 0

GML Validator
0

The following concerns bugs raised against the previous general acceptance release of the test suite.

Bug Number Description Status Comment

0092 The test engine cannot distinguish GML schema defined in WFS and GML schema in WCS
Rejected
This will be covered in a later enhancement (BR 98)

0093
Problem iterating over a blank list
Closed (change required)
Fixed so that if there is nothing to iterate over then nothing is done

0094
Can't view large test logs
Closed (change required)
The log has been changed so that any part of a response that is larger than 16k is truncated to 16k

0096
Allow http "head" requests
Responded
This is an enhancement, so is not covered by bug fixing

0097
Header fields without a value cause errors
Closed (change required)
This has been changed so that headers do not have to contain a value.

0098
The test engine cannot distinguish GML schema defined in WFS and GML schema in WCS
Responded
This is an enhancement, so is not covered by bug fixing

Changes since the previous release (version s3_1)

This version brings the previous sanity release to a full GA release
Number of bug reports submitted.

Area Number of bug reports

Test Engine 2

WFS tests 0

WMS tests 0

GML Validator
0

The following concerns bugs raised against the previous general acceptance release of the test suite.

Bug Number Description Status Comment

0096 Allow http "head" requests
Responded
This will be covered in a later enhancement

0097
Header fields without a value cause errors
open
This will be fixed in the next bug fix release

Changes since the previous release (version ga2.1)

This version adds the following test types to the test suite

ebRIM 1.0.0

Catalogue Services 2.0.0

Open Location Directory Service 1.0.0

Open Location Gateway Service 1.0.0

Open Location Presentation Service 1.0.0

Open Location Route Service 1.1.0

Open Location Utility Service 1.0.0

Web Coverage Server 1.0.0

Web Feature Server 1.1.0

Web Map Server 1.3.0

Number of bug reports submitted.

Area Number of bug reports

Test Engine 3

WFS tests 0

WMS tests 0

GML Validator
0

The following concerns bugs raised against the previous general acceptance release of the test suite.

Bug Number Description Status Comment

0093 Problem iterating over a blank list
Responded
This will be fixed in the next bug fix release

0094
Can't view large test logs
Responded
This will be fixed in the next bug fix release

0095
Missing group attribute causes tests not to be selected
Closed (change required)
This has been fixed in the code.

Changes since the previous release (version s2_2)

This version puts the previous sanity release into a ga release

Number of bug reports submitted.

Area Number of bug reports

Test Engine 0

WFS tests 0

WMS tests 0

GML Validator
0

Changes since the previous release (version ga2)

This version fixes the bugs found with the previous ga version.

Number of bug reports submitted.

Area Number of bug reports

Test Engine 5

WFS tests 0

WMS tests 0

GML Validator
0

The following concerns bugs raised against the second general acceptance release of the test suite.

Bug Number Description Status Comment

0088 Results Validation in Dynamic Tests
Closed (change required)
Iterated values now have the correct value in the processing of results.

0089
Scopes don't work with funcitonal groups
Closed (change required)
This has been fixed in the code

0090
Execution order doesn't match presentation order
Closed (change required)
This has been fixed in the code.

0091
The test engine cannot calculate the variable based on the other variables in the same variable setting
Closed (change required)
This has been fixed in the code.

0092
The test engine cannot distinguish GML schema defined in WFS and GML schema in WCS
Open
This issue is currently undergoing discussion

Changes since the previous release (version s2_1)

This version fixes the bugs found with the previous sanity version.

Number of bug reports submitted.

Area Number of bug reports

Test Engine 0

WFS tests 0

WMS tests 0

GML Validator
0

Although there were no bug reports submitted, there was an issue with the correct tests being brought into the test sessions. This has now been fixed.

Changes since the previous release (version b2_1)

This version fixes the bugs found with the previous beta version. It also restructures some of the enhancements. Tese restructures are...

The Optional/Mandatory column of test session results summary has been removed

The selection of grouped tests has been moved to the main test session creation page

Number of bug reports submitted.

Area Number of bug reports

Test Engine 2

WFS tests 0

WMS tests 0

GML Validator
0

The following concerns bugs raised against the general acceptance release of the test suite.

Bug Number Description Status Comment

0086 Tests do not work with IE
Closed (change required)
The content type has been changed to 'text/html'.

0087
Incorrect tests in test session
Closed (change required)
This has been fixed in the code.

Changes since the previous release (version ga1.0)

This version of the test suite includes many enhancements over the previous release. A bief list of these enhancements are shown below.

The test suite header is now the same as the main OGC portal header

The test suite footer now follows the style of the main OGC portal footer

The same style sheet is used as is used in the main OGC portal

A summary of the test results along with the raw test logs can be packaged and sent to the Certification Authority as a given email address

The test session summary now shows the class of the test

Test sessions can be created based on the functional groups of the tests

Number of bug reports submitted.

Area Number of bug reports

Test Engine 0

WFS tests 0

WMS tests 2

GML Validator
1

The following concerns bugs raised against the general acceptance release of the test suite.

Bug Number Description Status Comment

0083 Undefined variables cause tests to fail
Closed (no change required)
This bug was raised before the ga test suite had been properly set up (before the official start date). The bug submitter now states that this is no longer a problem.

0084
DTD fails to match.
Closed (no change required)
This bug was raised before the ga test suite had been properly set up (before the official start date). The bug submitter now states that this is no longer a problem.

0085
Error report not formatted
Closed (change required)
Fixed the stylesheet to display the general errors in a table.

Changes since the previous release (version s1.0)

Number of bug reports submitted.

Area Number of bug reports

Test Engine 1

WFS tests 2

WMS tests 0

GML Validator
0

The following concerns bugs raised against the sanity release of the test suite.

Bug Number Description Status Comment

0080 Repeated output.
Closed (change required)
This was actually a WFS problem. The text has been updated.

0081
CONTAINMENT test is not valid.
Closed (no change required)
This will be brought up with the WFS RWG as a specification issue.

0082
Some transactional tests should accept transaction:FAILED
Closed (change required)
Changed all the transaction tests that test for ServiceExceptionReport to also check the transaction status for failed.

Changes since the previous release (version b4.0)

Number of bug reports submitted.

Area Number of bug reports

Test Engine 1

WFS tests 1

WMS tests 0

GML Validator
0

The following concerns bugs raised against the fourth beta release of the test suite.

Bug Number Description Status Comment

0078 Requests contain incorrect geometry.
Closed (change required)
The geometries have been fixed.

0079
OGC Cite WFS test suite-Underscore added to the WFS server name request
Rejected
This was not actually a bug, but user error.

Changes since the third release (version b3.0)

Number of bug reports submitted.

Area Number of bug reports

Test Engine 1

WFS tests 13

WMS tests 13

GML Validator
1

The following concerns bugs raised against the third beta release of the test suite.

Bug Number Description Status Comment

0050 Incorrect request sent in wms/wmsops/getfeatureinfo/general/1
Closed (change required)
This test has been removed

0051
Transaction test should not be performed on basic server
Closed (change required)
Added transactional to the scope

0052
Incorrect request data sent
Closed (change required)
Fixed the geometry

0053
More tests needed
Rejected
For this release it was decided to have a basic set of spatial tests to test the interface and some check that the correct result is returned.

0054
Feature and property names causing conflicts
Closed (change required)
The properties have been renamed.

0055
XMLSCHEMA is the only accepted for SchemaDescriptionLanguage
Rejected
The document is not valid according to the WFS schema

0056
Expected content for element is not valid
Rejected
The document is not valid according to the WFS schema

0057
The test suite incorrectly expects the VendorSpecificCapabilities section to be empty...
Rejected
The document is not valid according to the WFS schema

0058
Test suite does not handle all possible WFS versions correctly.
Closed (change required)
Changed the test to use the version number 0.99.99

0059
Element names too long ...
Closed (change required)
he feature type names have been changed to shorter versions.

0060
Testing geographic features without geometry should be optional ...
Closed (change required)
All features now have a geometry.

0061
wms/basic_elements/version/negotiation/1 incorrect
Rejected
The test fails if the capabilities document returned does not contain a root element

0062
wms/basic_elements/version/negotiation/3 incorrect
Rejected
The test fails if the capabilities document returned does not contain a root element

0063
wms/wmsops/getfeatureinfo/params/feature_count/2 tests ill-specified behavior
Closed (change required)
The test has been changed so that the request uses only one layer.

0064
wms/wmsops/getmap/params/bbox/4 assumes too much
Closed (change required)
The test has been changed so that the pixels which are directly covered by the polygon must be non-white, but the other pixels are not tested.

0065
Multiple namespace support should be optional.
Rejected
Namespaces are inherent in the GML and web services and therefore are important to test.

0066
Locking tests send all requests to same URL
Closed (change required)
Changed all the transaction URLs to use the transaction url from the capabilities document.

0067
Test fails if DWithin is in capabilities
Closed (change required)
Modified the schema used for validation to accept the DWithin operator.

0068
Schema cache problem?
Closed (change required)
Removed the cache of the schemas

0069
Invalid requests if URL prefix terminator missing
Closed (change required)
The capabilities setup has been changed to append a ? or & to the URLs if necessary.

0070
Feature_count interpretation
Duplicate
Duplicate of 63.

0071
BBOX validation too strict
Duplicate
Duplicate of 64.

0072
Problem with multiple specification links
Closed (change required)
All of the links are now shown in exactly the same way that they are in the assertion specification.

0073
wms/.../latlonbbox/1 test disputed - specification is contradictory
Rejected
The definition of the DTD is not a contradiction.

0074
Comparison of DOS DTD and UNIX DTD fails
Closed (change required)
The DTD comparison has been fixed.

0075
FEATURE_COUNT IS OPTIONAL AS PER SPECIFICATION BUT CITE ENFORCES IT
Rejected
The test will remain mandatory for servers that support GetFeatureInfo requests.

0076
Mime Types do not allow charset definition
Closed (change required)
The tests which check mime types have been modified to ignore any mime parameters.

0077
TrUe instead of TRUE
Closed (change required
This change has been made for consistency with the probable 1.2 spec.

Changes since the second release (version b2.0)

Number of bug reports submitted.

Area Number of bug reports

Test Engine 10

WFS tests 7

WMS tests 6

The following concerns bugs raised against the second beta release of the test suite.

Bug Number Description Status Comment

0027 DescribeFeatureType - could not evaluate the xpath expression
Closed (no change required)
This was caused by schemas out side of this projects controll.

0028 Encoding of Get requests for getFeatures
Closed (change required)
The tests did not have the encoded=true set on the values of the filter expression, this has been changed so that the url encoding is performed

0029 Nulls in gml:name, getFeature/comparisonoperators/22 Rejected
The assumptions made for the tests are that the absence of an element makes it null and when a value of a property is null then the property is not returned in the result.

0030 Hard to tell if you've entered the capabilities URL correctly
Rejected
There is not really any better way than currently used.

0031 Unclear whether to click the "Add Capabilities Values" or "Create Test Session" button
Closed (change required)
The setup files have been modified to allow test script creators to select which buttons they require. Allowing only the "Add Capabilities values" button to appear if necessary.

0032 Changing the capabilities URL without creating a new session
Rejected
This would basically mean creating a new session anyway.

0033 Delete session confirmation page doesn't show session name Closed (change required) This page has been modified to show the session description as well as the ID.

0034 Invalid capabilites request sent to server
Closed (change required)
If the wmtver being requested is less than 1.1.0, the request will be capabilities instead of GetCapabilities.

0035 Beyond #12 - missing distance element and typename is misspelled
Closed (change required)
Added distance element and corrected typename

0036 certification/1: standard layers not recognized
Closed (change required)
VAR_STDDATA_EXISTS has been changed to fix this

0037 Changing the capabilities URL without creating a new session
Rejected
This is the same issue as Bug #32

0038 Per test Variable listing misplaced
Closed (change required) The 'View Test' page has now been altered so that the per test variables are shown within the request that they are set.

0039 comparisonoperators/22 test executed when it shouldn't
Closed (change required) Additional scopes have been added for the operators to remove the optional ones

0040 contains/get/11: incorrect GML
Closed (change required)
Changed all multi geometries to have the srsName on the outer most element

0041 Intersects spatial operator not detected
Closed (change required)
The WFS spec has Intersects for the operator and Intersect for the capabilities document. This was not handled by the automatic script generation and has been fixed

0042 Viewing Test Results
Closed (change required)
This is just a config file error. The correct URL has been entered

0043 View per test variables in log
Closed (change required)
This has been fixed so that the per test variables are only shown and saved once.

0044 Problem with CDATA in XML
Closed (change required)
This has been fixed so that nested CDATA sections are escaped in the log so that they can be represented correctly

0045 Problem with binary response
Closed (change required)
If any response has characters that can not be represented within XML, then the a note to the user is entered in place of the actual response

0046 Problem with wms/certification/2
Closed (change required)
Changed the Xpath expression from string-length([[VAR]]) to string-length("[[VAR]]")

0047 Validation should not occur
Closed (change required)
Changed the validategml attribute to false for the first request

0048 Invalid layer queried
Closed (change required)
Changed cite:Streams to cite:Forests

0049 '+' characters should be escaped
Closed (change required)
Added attribute encoding="true" to the parameter values which use the '+' character.

Changes since the first release (version b1.1)

Number of bug reports submitted.

Area Number of bug reports

Test Engine 16

WFS tests 10

WMS tests 0

The following concerns bugs raised against the first beta release of the test suite.

Bug Number Description Status Comment

0001 Double Question Marks Closed (change required) Fixed so that the log is shown correctly

0002 Custom functions... Closed (change required) This was a bug in the actual custom java class being used. This has now been fixed

0003 DescribeFeatureType POST using GET Closed (change required) Changed the transaction type to be POST for the affected tests

0004 get feature 8 missing namespace Closed (change required) Added the GML namespace declaration

0005 get feature 11 wrong prefix Closed (change required) move the prefix from the function to the axis

0006 get feature 12 extra text in xml Closed (change required) Removed the extra text

0007 get feature 18 missing closing > Closed (change required) Added the > after the element name

0008 gml prefix using the ogc namespace Closed (change required) Changed the namespace

0009 Not encoding transaction values Closed (change required) The engine has been modified so that there can be an attribute named 'encoded' on values sent to the server. If this is true then the value is URL encoded.

0010 Multiple values are not being sent to the server correctly Closed (change required) Multiple values are now sent as a comma sepperated list.

0011 Error in log if test has no expected result Closed (change required) Made it so that a test can have a blank expected result.

0012 Invalid XML in tests Closed (change required) Removed the extra content

0013 Wrong feature collection name Closed (change required) Name changed

0014 Test just checks one possible outcome Closed (change required) added a check for failed transaction as well

0015 Headers Closed (change required) The headers are now shown

0016 & character at the end of the capabilities url... Closed (change required) When there is an '&' character at the end of a URL the engine now does not append the '?' character or another '&' character when there are additional parameters to add.

0017 Have execute test option on Main Menu Closed (change required) Execute test option added to the Main Menu

0018 manual tests followed by automatic tests Closed (no change required) This is a setup issue, so no change to the engine is required

0019 Validation Closed (change required) Fixed so that the DTD and schema validation is carried out correctly

0020 XML Response in log Closed (change required) This has been fixed so that the content is shown in the log exactly as it is returned from the server.

0021 Namespaces in attributes Closed (no change required) This is an issue outside of out controll. Tests have been rewritten to overcome this though

0022 Non-existing Variable Replacement Closed (change required) The engine has been modified so that when a variable in the setup of a test session is not present, or returns an empty string, it is saved as such and can be used within the tests.

0023 String index out of range error Closed (change required) This has been fixed so that if no values are returned in a list a variable is set to an empty string.

0024 Multiple variables don't work Closed (change required) This is actually a bug in the schema. The per test variables have been written so that all variables set from one response are contained within one <cite:variable id="x"> element. Multiple variables are defined by multiple <cite:set> elements within that <cite:variable> element.

0025 Negated scopes don't work Closed (change required) This has been fixed so that when the capabilities document is used to set up scopes if the capability is not supported then it is negated. THere will be descriptions for all scopes AND the negated scopes so that a user can see exactly what is and what is not supported.

0026 getcapabilities/24: presence of NullCheck is optional Closed (change required) All GetCapabilities tests that check for elements that may be optional have been removed, these will be covered by having scopes that check for the existance of operators and then running the tests if they area specified.

Submit Bug Report • Search Bug Reports • Bug Report Summary • Terms and Conditions

Copyright(C) The Open Group 2004. All rights reserved.

Test Engine Created By

Bug Number	Description	Status	Comment
0096	Allow http "head" requests	Closed (Change Required)	This enhancement has now been added to this version of the test engine.
0098	The test engine cannot distinguish GML schema defined in WFS and GML schema in WCS	Closed (Change Required)	This enhancement has now been added to this version of the test engine.

Bug Number	Description	Status	Comment
0092	The test engine cannot distinguish GML schema defined in WFS and GML schema in WCS	Rejected	This will be covered in a later enhancement (BR 98)
0093	Problem iterating over a blank list	Closed (change required)	Fixed so that if there is nothing to iterate over then nothing is done
0094	Can't view large test logs	Closed (change required)	The log has been changed so that any part of a response that is larger than 16k is truncated to 16k
0096	Allow http "head" requests	Responded	This is an enhancement, so is not covered by bug fixing
0097	Header fields without a value cause errors	Closed (change required)	This has been changed so that headers do not have to contain a value.
0098	The test engine cannot distinguish GML schema defined in WFS and GML schema in WCS	Responded	This is an enhancement, so is not covered by bug fixing

Bug Number	Description	Status	Comment
0088	Results Validation in Dynamic Tests	Closed (change required)	Iterated values now have the correct value in the processing of results.
0089	Scopes don't work with funcitonal groups	Closed (change required)	This has been fixed in the code
0090	Execution order doesn't match presentation order	Closed (change required)	This has been fixed in the code.
0091	The test engine cannot calculate the variable based on the other variables in the same variable setting	Closed (change required)	This has been fixed in the code.
0092	The test engine cannot distinguish GML schema defined in WFS and GML schema in WCS	Open	This issue is currently undergoing discussion

Bug Number	Description	Status	Comment
0086	Tests do not work with IE	Closed (change required)	The content type has been changed to 'text/html'.
0087	Incorrect tests in test session	Closed (change required)	This has been fixed in the code.

Bug Number	Description	Status	Comment
0083	Undefined variables cause tests to fail	Closed (no change required)	This bug was raised before the ga test suite had been properly set up (before the official start date). The bug submitter now states that this is no longer a problem.
0084	DTD fails to match.	Closed (no change required)	This bug was raised before the ga test suite had been properly set up (before the official start date). The bug submitter now states that this is no longer a problem.
0085	Error report not formatted	Closed (change required)	Fixed the stylesheet to display the general errors in a table.

Bug Number	Description	Status	Comment
0080	Repeated output.	Closed (change required)	This was actually a WFS problem. The text has been updated.
0081	CONTAINMENT test is not valid.	Closed (no change required)	This will be brought up with the WFS RWG as a specification issue.
0082	Some transactional tests should accept transaction:FAILED	Closed (change required)	Changed all the transaction tests that test for ServiceExceptionReport to also check the transaction status for failed.

Bug Number	Description	Status	Comment
0078	Requests contain incorrect geometry.	Closed (change required)	The geometries have been fixed.
0079	OGC Cite WFS test suite-Underscore added to the WFS server name request	Rejected	This was not actually a bug, but user error.

Bug Number	Description	Status	Comment
0050	Incorrect request sent in wms/wmsops/getfeatureinfo/general/1	Closed (change required)	This test has been removed
0051	Transaction test should not be performed on basic server	Closed (change required)	Added transactional to the scope
0052	Incorrect request data sent	Closed (change required)	Fixed the geometry
0053	More tests needed	Rejected	For this release it was decided to have a basic set of spatial tests to test the interface and some check that the correct result is returned.
0054	Feature and property names causing conflicts	Closed (change required)	The properties have been renamed.
0055	XMLSCHEMA is the only accepted for SchemaDescriptionLanguage	Rejected	The document is not valid according to the WFS schema
0056	Expected content for element is not valid	Rejected	The document is not valid according to the WFS schema
0057	The test suite incorrectly expects the VendorSpecificCapabilities section to be empty...	Rejected	The document is not valid according to the WFS schema
0058	Test suite does not handle all possible WFS versions correctly.	Closed (change required)	Changed the test to use the version number 0.99.99
0059	Element names too long ...	Closed (change required)	he feature type names have been changed to shorter versions.
0060	Testing geographic features without geometry should be optional ...	Closed (change required)	All features now have a geometry.
0061	wms/basic_elements/version/negotiation/1 incorrect	Rejected	The test fails if the capabilities document returned does not contain a root element
0062	wms/basic_elements/version/negotiation/3 incorrect	Rejected	The test fails if the capabilities document returned does not contain a root element
0063	wms/wmsops/getfeatureinfo/params/feature_count/2 tests ill-specified behavior	Closed (change required)	The test has been changed so that the request uses only one layer.
0064	wms/wmsops/getmap/params/bbox/4 assumes too much	Closed (change required)	The test has been changed so that the pixels which are directly covered by the polygon must be non-white, but the other pixels are not tested.
0065	Multiple namespace support should be optional.	Rejected	Namespaces are inherent in the GML and web services and therefore are important to test.
0066	Locking tests send all requests to same URL	Closed (change required)	Changed all the transaction URLs to use the transaction url from the capabilities document.
0067	Test fails if DWithin is in capabilities	Closed (change required)	Modified the schema used for validation to accept the DWithin operator.
0068	Schema cache problem?	Closed (change required)	Removed the cache of the schemas
0069	Invalid requests if URL prefix terminator missing	Closed (change required)	The capabilities setup has been changed to append a ? or & to the URLs if necessary.
0070	Feature_count interpretation	Duplicate	Duplicate of 63.
0071	BBOX validation too strict	Duplicate	Duplicate of 64.
0072	Problem with multiple specification links	Closed (change required)	All of the links are now shown in exactly the same way that they are in the assertion specification.
0073	wms/.../latlonbbox/1 test disputed - specification is contradictory	Rejected	The definition of the DTD is not a contradiction.
0074	Comparison of DOS DTD and UNIX DTD fails	Closed (change required)	The DTD comparison has been fixed.
0075	FEATURE_COUNT IS OPTIONAL AS PER SPECIFICATION BUT CITE ENFORCES IT	Rejected	The test will remain mandatory for servers that support GetFeatureInfo requests.
0076	Mime Types do not allow charset definition	Closed (change required)	The tests which check mime types have been modified to ignore any mime parameters.
0077	TrUe instead of TRUE	Closed (change required	This change has been made for consistency with the probable 1.2 spec.

Bug Number	Description	Status	Comment
0027	DescribeFeatureType - could not evaluate the xpath expression	Closed (no change required)	This was caused by schemas out side of this projects controll.
0028	Encoding of Get requests for getFeatures	Closed (change required)	The tests did not have the encoded=true set on the values of the filter expression, this has been changed so that the url encoding is performed
0029	Nulls in gml:name, getFeature/comparisonoperators/22	Rejected	The assumptions made for the tests are that the absence of an element makes it null and when a value of a property is null then the property is not returned in the result.
0030	Hard to tell if you've entered the capabilities URL correctly	Rejected	There is not really any better way than currently used.
0031	Unclear whether to click the "Add Capabilities Values" or "Create Test Session" button	Closed (change required)	The setup files have been modified to allow test script creators to select which buttons they require. Allowing only the "Add Capabilities values" button to appear if necessary.
0032	Changing the capabilities URL without creating a new session	Rejected	This would basically mean creating a new session anyway.
0033	Delete session confirmation page doesn't show session name	Closed (change required)	This page has been modified to show the session description as well as the ID.
0034	Invalid capabilites request sent to server	Closed (change required)	If the wmtver being requested is less than 1.1.0, the request will be capabilities instead of GetCapabilities.
0035	Beyond #12 - missing distance element and typename is misspelled	Closed (change required)	Added distance element and corrected typename
0036	certification/1: standard layers not recognized	Closed (change required)	VAR_STDDATA_EXISTS has been changed to fix this
0037	Changing the capabilities URL without creating a new session	Rejected	This is the same issue as Bug #32
0038	Per test Variable listing misplaced	Closed (change required)	The 'View Test' page has now been altered so that the per test variables are shown within the request that they are set.
0039	comparisonoperators/22 test executed when it shouldn't	Closed (change required)	Additional scopes have been added for the operators to remove the optional ones
0040	contains/get/11: incorrect GML	Closed (change required)	Changed all multi geometries to have the srsName on the outer most element
0041	Intersects spatial operator not detected	Closed (change required)	The WFS spec has Intersects for the operator and Intersect for the capabilities document. This was not handled by the automatic script generation and has been fixed
0042	Viewing Test Results	Closed (change required)	This is just a config file error. The correct URL has been entered
0043	View per test variables in log	Closed (change required)	This has been fixed so that the per test variables are only shown and saved once.
0044	Problem with CDATA in XML	Closed (change required)	This has been fixed so that nested CDATA sections are escaped in the log so that they can be represented correctly
0045	Problem with binary response	Closed (change required)	If any response has characters that can not be represented within XML, then the a note to the user is entered in place of the actual response
0046	Problem with wms/certification/2	Closed (change required)	Changed the Xpath expression from string-length([[VAR]]) to string-length("[[VAR]]")
0047	Validation should not occur	Closed (change required)	Changed the validategml attribute to false for the first request
0048	Invalid layer queried	Closed (change required)	Changed cite:Streams to cite:Forests
0049	'+' characters should be escaped	Closed (change required)	Added attribute encoding="true" to the parameter values which use the '+' character.

Bug Number	Description	Status	Comment
0001	Double Question Marks	Closed (change required)	Fixed so that the log is shown correctly
0002	Custom functions...	Closed (change required)	This was a bug in the actual custom java class being used. This has now been fixed
0003	DescribeFeatureType POST using GET	Closed (change required)	Changed the transaction type to be POST for the affected tests
0004	get feature 8 missing namespace	Closed (change required)	Added the GML namespace declaration
0005	get feature 11 wrong prefix	Closed (change required)	move the prefix from the function to the axis
0006	get feature 12 extra text in xml	Closed (change required)	Removed the extra text
0007	get feature 18 missing closing >	Closed (change required)	Added the > after the element name
0008	gml prefix using the ogc namespace	Closed (change required)	Changed the namespace
0009	Not encoding transaction values	Closed (change required)	The engine has been modified so that there can be an attribute named 'encoded' on values sent to the server. If this is true then the value is URL encoded.
0010	Multiple values are not being sent to the server correctly	Closed (change required)	Multiple values are now sent as a comma sepperated list.
0011	Error in log if test has no expected result	Closed (change required)	Made it so that a test can have a blank expected result.
0012	Invalid XML in tests	Closed (change required)	Removed the extra content
0013	Wrong feature collection name	Closed (change required)	Name changed
0014	Test just checks one possible outcome	Closed (change required)	added a check for failed transaction as well
0015	Headers	Closed (change required)	The headers are now shown
0016	& character at the end of the capabilities url...	Closed (change required)	When there is an '&' character at the end of a URL the engine now does not append the '?' character or another '&' character when there are additional parameters to add.
0017	Have execute test option on Main Menu	Closed (change required)	Execute test option added to the Main Menu
0018	manual tests followed by automatic tests	Closed (no change required)	This is a setup issue, so no change to the engine is required
0019	Validation	Closed (change required)	Fixed so that the DTD and schema validation is carried out correctly
0020	XML Response in log	Closed (change required)	This has been fixed so that the content is shown in the log exactly as it is returned from the server.
0021	Namespaces in attributes	Closed (no change required)	This is an issue outside of out controll. Tests have been rewritten to overcome this though
0022	Non-existing Variable Replacement	Closed (change required)	The engine has been modified so that when a variable in the setup of a test session is not present, or returns an empty string, it is saved as such and can be used within the tests.
0023	String index out of range error	Closed (change required)	This has been fixed so that if no values are returned in a list a variable is set to an empty string.
0024	Multiple variables don't work	Closed (change required)	This is actually a bug in the schema. The per test variables have been written so that all variables set from one response are contained within one <cite:variable id="x"> element. Multiple variables are defined by multiple <cite:set> elements within that <cite:variable> element.
0025	Negated scopes don't work	Closed (change required)	This has been fixed so that when the capabilities document is used to set up scopes if the capability is not supported then it is negated. THere will be descriptions for all scopes AND the negated scopes so that a user can see exactly what is and what is not supported.
0026	getcapabilities/24: presence of NullCheck is optional	Closed (change required)	All GetCapabilities tests that check for elements that may be optional have been removed, these will be covered by having scopes that check for the existance of operators and then running the tests if they area specified.

Copyright(C) The Open Group 2004. All rights reserved.
		Test Engine Created By