Log of /branches/eth/eve/Src/library/testing
Directory Listing
Revision
92684 -
Directory Listing
Modified
Fri Jun 7 15:28:53 2013 UTC
(6 years, 6 months ago)
by
jasonw
<<Merged from trunk#92682.>>
Revision
92410 -
Directory Listing
Modified
Fri Apr 5 15:33:25 2013 UTC
(6 years, 8 months ago)
by
maxpei
Fixed a few bugs in AutoTest.
Revision
91347 -
Directory Listing
Modified
Fri Mar 8 09:55:21 2013 UTC
(6 years, 9 months ago)
by
jasonw
<<Merged from trunk#91345.>>
Revision
91272 -
Directory Listing
Modified
Fri Feb 22 12:41:46 2013 UTC
(6 years, 9 months ago)
by
jasonw
<<Merged from trunk#91270.>>
Revision
91117 -
Directory Listing
Modified
Fri Feb 1 08:57:09 2013 UTC
(6 years, 10 months ago)
by
jasonw
<<Merged from trunk#91110.>>
Revision
91005 -
Directory Listing
Modified
Mon Jan 28 14:40:26 2013 UTC
(6 years, 10 months ago)
by
jasonw
<<Merged from trunk#90997.>>
Revision
90750 -
Directory Listing
Modified
Mon Jan 21 13:30:30 2013 UTC
(6 years, 10 months ago)
by
jasonw
<<Merged from trunk#90747.>>
Revision
90504 -
Directory Listing
Modified
Thu Jan 10 20:20:04 2013 UTC
(6 years, 11 months ago)
by
maxpei
1. Reverted AutoTest command line inputs to STRING_8;
2. Fixed a fault causing the AutoTest console to report only passing and invalid tests.
Revision
90398 -
Directory Listing
Modified
Fri Jan 4 09:58:58 2013 UTC
(6 years, 11 months ago)
by
jasonw
<<Merged from trunk#90397.>>
Revision
90122 -
Directory Listing
Modified
Fri Dec 7 08:28:50 2012 UTC
(7 years ago)
by
jasonw
<<Merged from trunk#90120.>>
Revision
89804 -
Directory Listing
Modified
Fri Nov 2 09:14:04 2012 UTC
(7 years, 1 month ago)
by
jasonw
<<Merged from trunk#89803.>>
Revision
89681 -
Directory Listing
Modified
Fri Oct 26 07:23:22 2012 UTC
(7 years, 1 month ago)
by
jasonw
<<Merged from trunk#89679.>>
Revision
88874 -
Directory Listing
Modified
Thu Jun 14 14:25:07 2012 UTC
(7 years, 5 months ago)
by
jasonw
1. Fixed a bug in AutoTest which caused some faults to be dropped by test case serialization.
2. Fixed a bug in AutoTest which generates wrong fault ids for online statistics file.
Revision
88743 -
Directory Listing
Modified
Wed May 16 09:04:03 2012 UTC
(7 years, 6 months ago)
by
jasonw
Fixed a bug which caused test serialization to crash AutoTest when the objects to be serialized violate their class invariants.
Revision
88695 -
Directory Listing
Modified
Fri May 4 09:59:08 2012 UTC
(7 years, 7 months ago)
by
jasonw
<<Merged from trunk#88694.>>
Revision
88619 -
Directory Listing
Modified
Thu Apr 19 09:20:35 2012 UTC
(7 years, 7 months ago)
by
jasonw
1. Added an AutoTest command line option to enable the output of test cases during testing.
2. Fixed a bug in state file output which ignored retrieved post-states.
Revision
88607 -
Directory Listing
Modified
Mon Apr 16 14:20:14 2012 UTC
(7 years, 7 months ago)
by
jasonw
Added an option in AutoTest to enable passing test case serialization data from the interpreter to the proxy during testing.
Revision
88406 -
Directory Listing
Modified
Thu Mar 15 10:17:36 2012 UTC
(7 years, 8 months ago)
by
mpei
Removed one incorrect postcondition.
Revision
88234 -
Directory Listing
Modified
Fri Jan 27 09:58:45 2012 UTC
(7 years, 10 months ago)
by
jasonw
<<Merged from trunk#88233.>>
Revision
88212 -
Directory Listing
Modified
Fri Jan 20 13:30:20 2012 UTC
(7 years, 10 months ago)
by
jasonw
<<Merged from trunk#88211.>>
Revision
88026 -
Directory Listing
Modified
Fri Nov 25 12:11:03 2011 UTC
(8 years ago)
by
jasonw
<<Merged from trunk#88024.>>
Revision
87305 -
Directory Listing
Modified
Fri Sep 23 08:21:01 2011 UTC
(8 years, 2 months ago)
by
jasonw
<<Merged from trunk#87304.>>
Revision
86799 -
Directory Listing
Modified
Tue Jun 28 09:41:48 2011 UTC
(8 years, 5 months ago)
by
jasonw
Enabled object state statistics during AutoTesting.
Revision
86268 -
Directory Listing
Modified
Sat Apr 16 15:53:40 2011 UTC
(8 years, 7 months ago)
by
jasonw
Fixed various bugs in precondition-reduction strategy in AutoTest.
Revision
86202 -
Directory Listing
Modified
Mon Apr 11 14:04:17 2011 UTC
(8 years, 8 months ago)
by
jasonw
1. Fixed various bugs in precondition reduction strategy.
2. Supported invalidation of implications inferred by AutoInfer using the precondition reduction.
3. Refactoring.
Revision
86024 -
Directory Listing
Modified
Sun Mar 27 20:58:57 2011 UTC
(8 years, 8 months ago)
by
jasonw
1. Added an option in whole queryable query to specify which kinds (number of operands) of properties to retrieve.
2. Fixed some issues in SQL statement generation related to object equality comparison.
3. Supported new operators in expression evaluator.
4. Enhanced precondition-reduction strategy in AutoTest. Change the goal of the reduction from breaking invariants to satisfying invariants.
5. Added some convenient features in EPA_UTILITY.
Revision
85991 -
Directory Listing
Modified
Thu Mar 24 20:23:05 2011 UTC
(8 years, 8 months ago)
by
jasonw
Enhanced precondition-reduction startegy.
Revision
85906 -
Directory Listing
Modified
Thu Mar 17 16:26:54 2011 UTC
(8 years, 8 months ago)
by
jasonw
Made the first version of precondition reduction strategy work with AutoTest.
Revision
85857 -
Directory Listing
Modified
Sun Mar 13 09:06:46 2011 UTC
(8 years, 9 months ago)
by
mpei
Added AutoTest strategy for precondition reduction.
Revision
85838 -
Directory Listing
Modified
Thu Mar 10 15:44:52 2011 UTC
(8 years, 9 months ago)
by
jasonw
Added a feature to deserialized objects from an array of data.
Revision
85826 -
Directory Listing
Modified
Wed Mar 9 16:29:03 2011 UTC
(8 years, 9 months ago)
by
jasonw
1. Added code to perform expression evaluation in AutoTest, and connected the code with precondition reduction strategy.
2. Some refactoring in the interpreter by replacing constant values with the proper constant features.
Revision
85692 -
Directory Listing
Modified
Wed Feb 23 12:22:02 2011 UTC
(8 years, 9 months ago)
by
jasonw
1. Refactoring in mysql library.
2. Added classes to support precondition-reduction strategy in AutoTest, supported loading of invariant-violating objects from semantic database.
3. Changed the syntax level of the AutoTest library to "provisional".
Revision
85496 -
Directory Listing
Modified
Fri Jan 28 14:31:42 2011 UTC
(8 years, 10 months ago)
by
jasonw
<<Merged from trunk#85495.>>
Revision
85118 -
Directory Listing
Modified
Fri Dec 10 17:07:19 2010 UTC
(9 years ago)
by
gabster
Added argument count attribute
Revision
85044 -
Directory Listing
Modified
Fri Dec 3 12:03:12 2010 UTC
(9 years ago)
by
jasonw
<<Merged from trunk#85043.>>
Revision
84991 -
Directory Listing
Modified
Mon Nov 29 14:54:48 2010 UTC
(9 years ago)
by
jasonw
1. Distinguish between functions and attributes for test case deserialization.
2. Added missing code for newly introduced agent creation flag.
Revision
84986 -
Directory Listing
Modified
Mon Nov 29 04:09:56 2010 UTC
(9 years ago)
by
gabster
Agent creation support for auto-test.
First commit. walchg (gabster)
Revision
84959 -
Directory Listing
Modified
Fri Nov 19 12:04:26 2010 UTC
(9 years ago)
by
jasonw
Commented some code to avoid a bug in EiffelStudio. (Suggested by Julian.)
Revision
84952 -
Directory Listing
Modified
Thu Nov 18 13:56:07 2010 UTC
(9 years ago)
by
picmarco
Added classes to use feature "assert_deep_equal" when unit testing. Contribution by Arno Fiva.
Revision
84933 -
Directory Listing
Modified
Tue Nov 16 20:55:54 2010 UTC
(9 years ago)
by
jasonw
Added classes to support agent objects in Autotest test case serialization and deserialization.
Revision
84707 -
Directory Listing
Modified
Mon Oct 25 14:26:11 2010 UTC
(9 years, 1 month ago)
by
jasonw
1. Supported failing test cases in semantic search system.
2. Refactoring.
Revision
84657 -
Directory Listing
Modified
Wed Oct 20 21:07:06 2010 UTC
(9 years, 1 month ago)
by
jasonw
1. Rearranged statements in deserialized test cases.
2. Added support for new expression syntax for semantic search.
Revision
84655 -
Directory Listing
Modified
Wed Oct 20 14:38:28 2010 UTC
(9 years, 1 month ago)
by
jasonw
Refactored test case extractor to facilitate object state retrieval.
Revision
84623 -
Directory Listing
Modified
Mon Oct 18 12:35:21 2010 UTC
(9 years, 1 month ago)
by
jasonw
Fixed a bug which causes object post-state information to be retrieved even if this option is disabled.
Revision
84573 -
Directory Listing
Modified
Thu Oct 14 09:03:57 2010 UTC
(9 years, 1 month ago)
by
mpei
Test case execution trace collecting, and program states ranking.
Revision
84557 -
Directory Listing
Modified
Mon Oct 11 21:01:52 2010 UTC
(9 years, 2 months ago)
by
jasonw
<<Merged from trunk#84547.>>
Revision
84489 -
Directory Listing
Modified
Mon Oct 4 13:29:46 2010 UTC
(9 years, 2 months ago)
by
jasonw
Refactoring: updated object and transition representations in semantic search library. Removed the notion of boost from those representations since boost should be associated with search instead of the searchable elements.
Revision
84477 -
Directory Listing
Modified
Sat Oct 2 15:09:12 2010 UTC
(9 years, 2 months ago)
by
jasonw
Fixed a bug in precondition satisfaction which caused the predicate pool failed to populate for some features.
Revision
84400 -
Directory Listing
Modified
Tue Sep 14 20:18:15 2010 UTC
(9 years, 2 months ago)
by
jasonw
Added new classes for semantic search document serialization/deserialization.
Revision
84338 -
Directory Listing
Modified
Tue Aug 31 15:26:11 2010 UTC
(9 years, 3 months ago)
by
mpei
1. Exception trace explainer.
2. Expression collector.
Revision
84320 -
Directory Listing
Modified
Sat Aug 28 22:14:01 2010 UTC
(9 years, 3 months ago)
by
jasonw
Added an option in contract inference framework to retrieve object serialization information during test case re-execution to support semantic search.
Revision
84318 -
Directory Listing
Modified
Sat Aug 28 12:27:11 2010 UTC
(9 years, 3 months ago)
by
jasonw
1. Added support for post-state serialization in test case extraction from AutoTest logs.
2. Added queries to return object types in extracted test cases.
Revision
84281 -
Directory Listing
Modified
Wed Aug 25 10:37:30 2010 UTC
(9 years, 3 months ago)
by
jasonw
Made AutoTest work again.
Revision
84280 -
Directory Listing
Modified
Wed Aug 25 08:08:51 2010 UTC
(9 years, 3 months ago)
by
jasonw
Changed the ITP_INTERPRETER to make the whole system compile. Note: AutoTest is broken for the moment.
Revision
84268 -
Directory Listing
Modified
Tue Aug 24 14:02:11 2010 UTC
(9 years, 3 months ago)
by
jasonw
<<Merged from trunk#84267.>>
Revision
84165 -
Directory Listing
Modified
Fri Aug 13 11:31:54 2010 UTC
(9 years, 3 months ago)
by
jasonw
<<Merged from trunk#84164>>
Revision
84126 -
Directory Listing
Modified
Fri Aug 6 10:02:37 2010 UTC
(9 years, 4 months ago)
by
jasonw
<<Merged from trunk#84124.>>
Revision
84109 -
Directory Listing
Modified
Wed Aug 4 13:31:57 2010 UTC
(9 years, 4 months ago)
by
jasonw
Various bug fixes in contract inference library.
Revision
84076 -
Directory Listing
Modified
Fri Jul 30 14:34:23 2010 UTC
(9 years, 4 months ago)
by
wests
<<Merged from trunk#84075.>>
Revision
84016 -
Directory Listing
Modified
Mon Jul 26 09:16:52 2010 UTC
(9 years, 4 months ago)
by
wests
<<Merged from trunk#84001.>>
Revision
83981 -
Directory Listing
Modified
Thu Jul 22 13:22:41 2010 UTC
(9 years, 4 months ago)
by
jasonw
Fixed a bug in AutoTest during state retrieval, caused by non-existing FUNCTION type.
Revision
83980 -
Directory Listing
Modified
Thu Jul 22 11:31:40 2010 UTC
(9 years, 4 months ago)
by
jasonw
1. Added implication inferrer.
2. Fixed a class invariant violation in serialized test cases.
3. Some refactoring in Weka library.
Revision
83928 -
Directory Listing
Modified
Fri Jul 16 15:21:01 2010 UTC
(9 years, 4 months ago)
by
mpei
<<Merged from trunk#83927>>
Revision
83826 -
Directory Listing
Modified
Wed Jul 7 11:33:55 2010 UTC
(9 years, 5 months ago)
by
mpei
<<Merged from trunk#83825>>
Revision
83740 -
Directory Listing
Modified
Tue Jun 29 10:47:08 2010 UTC
(9 years, 5 months ago)
by
julian
<<Merged from trunk#83736.>>
Revision
83702 -
Directory Listing
Modified
Fri Jun 25 13:00:44 2010 UTC
(9 years, 5 months ago)
by
julian
<<Merged from trunk#83700.>>
Revision
83594 -
Directory Listing
Modified
Thu Jun 17 09:23:33 2010 UTC
(9 years, 5 months ago)
by
julian
<<Merged from trunk#83593.>>
Revision
83524 -
Directory Listing
Modified
Fri Jun 11 08:12:14 2010 UTC
(9 years, 6 months ago)
by
jasonw
<<Merged from trunk#83523.>>
Revision
83465 -
Directory Listing
Modified
Tue Jun 8 15:05:53 2010 UTC
(9 years, 6 months ago)
by
jasonw
Added classes to generate Weka relations from test cases.
Revision
83445 -
Directory Listing
Modified
Sat Jun 5 15:29:40 2010 UTC
(9 years, 6 months ago)
by
jasonw
<<Merged from trunk@83442.>>
Revision
83441 -
Directory Listing
Modified
Sat Jun 5 13:52:53 2010 UTC
(9 years, 6 months ago)
by
jasonw
Renamed branch eve3 to eve. The eve branch serves as the new branch for the EVE project.
Revision
83404 -
Directory Listing
Modified
Tue Jun 1 13:47:53 2010 UTC
(9 years, 6 months ago)
by
jasonw
Original Path:
branches/eth/eve3/Src/library/testing
1. Cleaned up AutoTest library.
2. Provided a walkaround to make test case serialization work.
3. Made test case deserialization work.
4. Used the same naming convention to for types in all AutoTest related logs.
5. Refactoring in TEST_GENERATOR.
Revision
82118 -
Directory Listing
Modified
Tue Jan 19 22:09:20 2010 UTC
(9 years, 10 months ago)
by
fivaa
Original Path:
trunk/Src/experimental/library/testing
Introduced a new interface {TEST_RESULT_I} representing results from any test execution. {EQA_TEST_RESULT} is therefore only used for ETEST and are wrapped into an {TEST_RESULT_I}. This is a preparations for making exporting and comparing test result simpler.
Revision
81790 -
Directory Listing
Modified
Wed Dec 9 13:28:50 2009 UTC
(10 years ago)
by
fivaa
Original Path:
trunk/Src/experimental/library/testing
Using class_name_of_type instead of type_name_of_type as otherwise the stack trace parsing fails when analysing a test results for a void-safe project (type name is prefixed by a !).
Revision
81680 -
Directory Listing
Modified
Fri Nov 27 13:40:18 2009 UTC
(10 years ago)
by
fivaa
Original Path:
trunk/Src/experimental/library/testing
Simple workaround in order to make test execution and generation work for void-safe projects. Instead of performing an object test on TUPLE [STRING, STRING] as this is what we expect to get, we do it for TUPLE [detachable STRING, detachable STRING]. The first does not work if the tuple was sent from a non void-safe system.
Revision
80918 -
Directory Listing
Modified
Sun Sep 27 19:22:28 2009 UTC
(10 years, 2 months ago)
by
fivaa
Original Path:
trunk/Src/experimental/library/testing
Extended test execution so that a unique working directory is created for each test and cleaned up afterwards. Creation is done by the on_prepare routine of the test itself, deleting the directory is done by the test service to make sure it is deleted even if the test does not complete.
Revision
80478 -
Directory Listing
Modified
Fri Aug 28 12:05:52 2009 UTC
(10 years, 3 months ago)
by
fivaa
Original Path:
trunk/Src/experimental/library/testing
Made test generation interpreter socket blocking so sleep statement is no longer needed. Also made sure socket is only closed if it is still open in rescue clause.
--this line, and those below, will be ignored--
M testing/etf/interpreter/itp_interpreter.e
Revision
80257 -
Directory Listing
Modified
Thu Aug 13 22:58:44 2009 UTC
(10 years, 3 months ago)
by
fivaa
Original Path:
trunk/Src/experimental/library/testing
Second surgery on the testing service. Changes mainly affect the way test are executed and how the test results are stored and reported. For the test execution byte code is produced on the fly and sent to the evaluator to be executed. This was used before only by AutoTest, but could potentially be used for anything the test serivce decides to execute (planned: executing newly extracted tests while the debugger is still running). Changes also include many minor execution improvements, also in the testing library.
For any test session run, records are produced which are stored in a record repository. The repository will be responsible for storing the records to disc which will allow displaying test results from earlier executions.
-- testing service interface
* added records which contain generic information about the execution of a {TEST_SESSION_I} (that could be testing results, created tests, aso...)
* added interface for record repository
* added observer for record repository changes
* added interface for testing statistics, which will be used to display any information of previous test results
* added factories for instantiating test sesssion given a type
* changed execution model so that {TEST_I} instances are responsible for providing an execute that is capable of executing test instances of that type. that way one can add any type of test to the test suite, as long an execute is provided for executing the test.
* added new session of type {TEST_EXECUTION_I} responsible for executing any tests that are assigned to it, also making sure that serial tests are not executed in parallel
* added new test execution observer
* {TEST_I} instances accept a {TEXT_FORMATTER} for displaying the test name or one of the results
-- testing service implementation
* added functional record repository, but does not store them permanently yet
* added stub for test statistics, not implemented yet (thinking of using new sql library for this)
* improved test execution through new interface, less multithreaded code, less states
* added new {ETEST} executors, which generate the byte code needed to call test routines in the evaluator
* when launching an isolated test, the evaluator process is restarted
* when compiling the project during test execution, the running tests are simply paused and restarted after compilation is done
* all {TEST_SESSION_I} make use of the output manager service for detailed information about what's going on
* made output printing for {TEST_SESSION}s simpler
-- testing library
* added abstract {EQA_RESULT} which only contains information pass/fail/unresolved and optionally a error tag/text
* changed {EQA_TEST_SET} that `on_prepare' is called during creation, that makes it simpler to initialize attached attributes
* removed notion of test name currently being executed, this will have to be put into a new global class {EQA_EVALUATION_INFO} which can also provide the paths used by system level tests
* only one output per test execution, not for each `on_prepare', test routine and `on_clean'
* added an {EQA_EMPTY_RESULT} for any failed test execution
* no longer using argument parser library since it is not possible to execute tests manually -> arguments are assumed to be valid
-- widgets
* adopted testing tool to new execution model
* replaced processor tabs (one tab per processor) by tabs which show record of different types (multiple records per tab) -> for now there is only one tab which displays execution records (very basic)
-- tty (-loop)
* Adopted tty menu to work with new tag tree and execution model, using same filter option as in testing tool panel
* Simplyfied tty testing menu by removing filter/prefix commands, the filter is now set be providing arguments with the command
* Using same testing output in outputs tool or tty
-- rota service
* using cursor instaed of container directly for iterating through task list (a lot less error-prone.....)
Revision
80113 -
Directory Listing
Modified
Wed Aug 5 09:11:26 2009 UTC
(10 years, 4 months ago)
by
fivaa
Original Path:
trunk/Src/experimental/library/testing
Moved actual test routine call into corresponding {EQA_TEST_SET} object. For now this is used for Vision2 tests which need to start the event loop before calling the test routine. Patch for this was provided by Daniel Furrer, thanks!
Revision
80111 -
Directory Listing
Modified
Wed Aug 5 08:47:29 2009 UTC
(10 years, 4 months ago)
by
fivaa
Original Path:
trunk/Src/experimental/library/testing
Changed testing library and test execution so that `on_prepare' is called when the test set is created through `default_create'. That way attached attributes can be initialized in `on_prepare'.
Revision
78965 -
Directory Listing
Modified
Fri May 29 22:17:00 2009 UTC
(10 years, 6 months ago)
by
fivaa
Original Path:
trunk/Src/library/testing
Using attribute for DATE_TIME since such objects can be retrieved now from a void-safe system.
Revision
78850 -
Directory Listing
Modified
Sat May 23 19:56:33 2009 UTC
(10 years, 6 months ago)
by
fivaa
Original Path:
trunk/Src/library/testing
Previous approach didn't quite work out, so now only the seconds are stored in EQA_TEST_RESULT.
There still seems to be a problem with strings, when accessing the actual content `area' is Void. We had the same problem with AutoTest, where creating a new instance of the string helped, in this case though it didn't...
Revision
78849 -
Directory Listing
Modified
Sat May 23 18:23:22 2009 UTC
(10 years, 6 months ago)
by
fivaa
Original Path:
trunk/Src/library/testing
Implemented correct_mismatch for classes sent through socket. Test execution now also works for void-safe projects.
Note: because DATE_TIME can not be retrieved, there is a work around in EQA_TEST_RESULT that stores the number of seconds since the epoche. That way the actual DATE_TIME can be reconstructed on the other side.
Revision
78705 -
Directory Listing
Modified
Fri May 15 13:07:08 2009 UTC
(10 years, 6 months ago)
by
fivaa
Original Path:
trunk/Src/library/testing
Make sure actual exception is propagated so correct exception information is shown in testing tool.
Revision
78598 -
Directory Listing
Modified
Sat May 9 15:03:08 2009 UTC
(10 years, 7 months ago)
by
fivaa
Original Path:
trunk/Src/library/testing
Made testing service use loopback network sockets so firewalls will not complain.
Note: some platforms had an issue when clients tried to connect to "localhost" instead of creating an actual loopback address.
Revision
77915 -
Directory Listing
Modified
Thu Mar 26 07:13:23 2009 UTC
(10 years, 8 months ago)
by
manus
Original Path:
trunk/Src/library/testing
Fixed a failure in `set_blocking' because we have to make sure that `connect' was successful before.
Revision
77760 -
Directory Listing
Modified
Mon Mar 16 23:29:52 2009 UTC
(10 years, 8 months ago)
by
manus
Original Path:
trunk/Src/library/testing
Added safe version of some Eiffel librairies.
Do not use `gobo.ecf' anymore, but one of its smaller subparts.
Revision
77679 -
Directory Listing
Modified
Tue Mar 10 12:28:56 2009 UTC
(10 years, 9 months ago)
by
jasonw
Original Path:
trunk/Src/library/testing
Refactored AUT_EXCEPTION to use EQA_TEST_INVOCATION_EXCEPTION to avoid code duplication.
Revision
77608 -
Directory Listing
Modified
Fri Mar 6 14:49:21 2009 UTC
(10 years, 9 months ago)
by
fivaa
Original Path:
trunk/Src/library/testing
Refactored {EQA_TEST_INVOCATION_EXCEPTION} so it can also be used by AutoTest for determining the outcome of a generated test (breakpoint slot information needed).
Revision
77436 -
Directory Listing
Modified
Sat Feb 28 11:42:59 2009 UTC
(10 years, 9 months ago)
by
fivaa
Original Path:
trunk/Src/library/testing
Fixed bug #15410 where output generated by a test routine was appended to the output buffer making the buffer smaller when overflowing.
Revision
77435 -
Directory Listing
Modified
Sat Feb 28 10:34:59 2009 UTC
(10 years, 9 months ago)
by
fivaa
Original Path:
trunk/Src/library/testing
Void safe version for testing library. In order to use testing tool EiffelStudio must be compiled with new version of testing library.
Revision
77363 -
Directory Listing
Modified
Thu Feb 26 19:46:23 2009 UTC
(10 years, 9 months ago)
by
jasonw
Original Path:
trunk/Src/library/testing
1. Added checks for class invariant violation on feature entry: the interpreter will exit if an object with violated invariant is found.
2. Modified the communication protocol between the proxy and the interpreter: The proxy will first send a NATURAL_32 to the interpretor indicating the next request type, and then send data of type ANY to the interpreter. In response, the interpreter will send a NATURAL_32 indicating the error type, and then send data of type ANY back to the interpreter.
Revision
77230 -
Directory Listing
Modified
Fri Feb 20 05:47:46 2009 UTC
(10 years, 9 months ago)
by
tedf
Original Path:
trunk/Src/library/testing
* Added a new test to demo an output buffer bug.
invariant violation in {EQA_TEST_OUTPUT_BUFFER}:
truncated_implies_buffer_full: is_truncated implies (buffer.count = buffer_size)
* Enabled multi-threaded for {EQA_SYSTEM_TEST_SET}.
Revision
76993 -
Directory Listing
Modified
Thu Feb 5 01:14:17 2009 UTC
(10 years, 10 months ago)
by
fivaa
Original Path:
trunk/Src/library/testing
Added missing "not" which made "unresolved" tests appear as "failing" and the other way around. Also added TODO comment for exception trace extraction.
Revision
76909 -
Directory Listing
Modified
Fri Jan 30 20:03:57 2009 UTC
(10 years, 10 months ago)
by
fivaa
Original Path:
trunk/Src/library/testing
Improved implementation of testing library (exception trace parsing) and replaced more occurrences of "outcome" with "result"
Revision
76879 -
Directory Listing
Modified
Thu Jan 29 01:22:27 2009 UTC
(10 years, 10 months ago)
by
fivaa
Original Path:
trunk/Src/library/testing
Refactored exception part of testing library. When a test throws an exception, it is checked more specifically whether it the test or the targeted system is to blame.
Revision
76820 -
Directory Listing
Modified
Sat Jan 24 01:31:43 2009 UTC
(10 years, 10 months ago)
by
fivaa
Original Path:
trunk/Src/library/testing
Updated all test project files (enabling assertions and adding {ANY}.default_create as creation routine)
Revision
76697 -
Directory Listing
Modified
Wed Jan 14 21:24:22 2009 UTC
(10 years, 10 months ago)
by
manus
Original Path:
trunk/Src/library/testing
Fixed broken code due to addition of `is_attached_type' in INTERNAL. In the process removed inheritance
to ISE_RUNTIME and use `field_conforms_to' new feature of INTERNAL to perform reattachment conformance.
Revision
76682 -
Directory Listing
Modified
Wed Jan 14 17:08:09 2009 UTC
(10 years, 10 months ago)
by
fivaa
Original Path:
trunk/Src/library/testing
Must provide a STRING_8 since there is no conversion from !READABLE_STRING_8 to ?STRING_8
Revision
76609 -
Directory Listing
Modified
Thu Jan 8 06:39:03 2009 UTC
(10 years, 11 months ago)
by
manus
Original Path:
trunk/Src/library/testing
Removed useless attachment marks (for constants)
Fixed full class checking compilation by removing ! when parent does not have any.
Revision
76420 -
Directory Listing
Modified
Mon Dec 29 20:27:11 2008 UTC
(10 years, 11 months ago)
by
manus
Original Path:
trunk/Src/library/testing
Removal of `is' keyword.
Replacement of `is' by `=' for constant definitions.
Replaced `indexing' by `note'.
Revision
76266 -
Directory Listing
Modified
Thu Dec 18 01:35:41 2008 UTC
(10 years, 11 months ago)
by
fivaa
Original Path:
trunk/Src/library/testing
Improved system level testing library:
* Added routines for comparing contents of files
* Added convenient routines in {EQA_SYSTEM_TEST_SET} for launching system and comparing output
* Changed creation and equality testing for {EQA_SYSTEM_PATH} for making true copies of a path
Revision
76246 -
Directory Listing
Modified
Wed Dec 17 22:57:54 2008 UTC
(10 years, 11 months ago)
by
fivaa
Original Path:
trunk/Src/library/testing
Fixed postconditions and blocking issue where {EQA_SYSTEM_EXECUTION_PROCESS} was not notified that process has terminated.
Revision
76230 -
Directory Listing
Modified
Wed Dec 17 19:50:53 2008 UTC
(10 years, 11 months ago)
by
fivaa
Original Path:
trunk/Src/library/testing
Added first version of classes providing system level testing. Currently you can create directories/files and launch the system which also contains the test.
Revision
76228 -
Directory Listing
Modified
Wed Dec 17 19:47:59 2008 UTC
(10 years, 11 months ago)
by
fivaa
Original Path:
trunk/Src/library/testing
When a test set class is prepared, the name of the test which will be executed is passed. Also after testing the `clean' routine gets a flag passed whether the test has failed or not. That also enables a test set to formulate assertions whether it is currently set up properly for testing.
Note: to execute tests with the testing tool and this version of the testing library, EiffelStudio in which the testing tool is used must be at least rev. 76226.
Revision
76210 -
Directory Listing
Modified
Wed Dec 17 19:04:49 2008 UTC
(10 years, 11 months ago)
by
manus
Original Path:
trunk/Src/library/testing
Removed non-used local.
Replace a call to `apply' by `call (Void)' since the former is only for advanced users and in this case
done wrong since it was not preceded by a call to set_operands.
Revision
76109 -
Directory Listing
Modified
Mon Dec 8 22:11:52 2008 UTC
(11 years ago)
by
fivaa
Original Path:
trunk/Src/library/testing
Improved testing library (contracts and typing for extracted test cases). Removed obsolete {TEST_SET} class.
Revision
75911 -
Directory Listing
Modified
Thu Nov 27 00:38:13 2008 UTC
(11 years ago)
by
fivaa
Original Path:
trunk/Src/library/testing
Added ancestor for generated tests which allows executing instructions and recovering from any exceptions raised by the instructions.
Revision
75789 -
Directory Listing
Modified
Thu Nov 20 00:32:11 2008 UTC
(11 years ago)
by
fivaa
Original Path:
trunk/Src/library/testing
Fixed multiple issues with AutoTest:
* root class is always generated. it can not be in the library since AutoTest can only test classes which are visible the root class.
* made routine which finds root class more robust by using root cluster to locate it
* reduced number of access to `interpreter_root_class'
* fixed bad english in interpreter error message
Revision
75641 -
Directory Listing
Modified
Sat Nov 15 00:51:32 2008 UTC
(11 years ago)
by
fivaa
Original Path:
trunk/Src/library/testing
Removed all assignment attempts and `as_attached' queries and replaced them with Void safe code. Also improved SPECIAL creation for extracted test cases.
Revision
75635 -
Directory Listing
Modified
Fri Nov 14 23:44:31 2008 UTC
(11 years ago)
by
manus
Original Path:
trunk/Src/library/testing
Fixed issue with using ?= when target is attached which is now forbidden by the compiler. Solution
was either removing the need for the ! mark, or to use an object test or to use {ANY}.as_attached.
Revision
75523 -
Directory Listing
Modified
Wed Nov 12 02:02:09 2008 UTC
(11 years, 1 month ago)
by
fivaa
Original Path:
trunk/Src/library/testing
Bug fixes for failures which occurred using testing tool and AutoTest on windows:
* Implemented socket listener for AutoTest interpreter with condition variable
* Made interpreter wait until socket is `readable' (this was necessary for test execution...)
* Using correct icons in wizard
* EB_MELT_PROJECT_COMMAND should only try to focus window if sensitive
Revision
75481 -
Directory Listing
Modified
Fri Nov 7 22:49:29 2008 UTC
(11 years, 1 month ago)
by
fivaa
Original Path:
trunk/Src/library/testing
Fix from Jason for melting issue when running AutoTest. {ITP_INTERPRETER}.execute_byte_code no longer needs to be melted in order to run byte code.
Revision
75356 -
Directory Listing
Modified
Wed Oct 29 23:09:16 2008 UTC
(11 years, 1 month ago)
by
fivaa
Original Path:
trunk/Src/library/testing
Integrated modified AutoTest implementation (many thanks to Jason!), changes include:
* New runtime routine eif_override_byte_code_of_body in $EIFFEL_SRC/C/run-time/interp.c
* Added auto_test library classes as a framework in $EIFFEL_SRC/framework/auto_test
* Added interpreter classes and erl_g constants to testing library in $EIFFEL_SRC/library/testing/generation/
* Console menu contains new entry for launching AutoTest, however for ecb that is only a dummy entry since the batch version is single threaded.
Current issues: {ITP_INTERPRETER}.execute_byte_code must be melted in order to run AutoTest. To do so, make sure testing library is not read only and then modify the routine by hand before launching auto test.
Revision
75335 -
Directory Listing
Modified
Tue Oct 28 22:30:07 2008 UTC
(11 years, 1 month ago)
by
fivaa
Original Path:
trunk/Src/library/testing
Made evaluator remove bottom part of exception stack trace which calls test routine. That way user only gets relevant part of stack trace.
Revision
75146 -
Directory Listing
Modified
Thu Oct 16 23:55:02 2008 UTC
(11 years, 1 month ago)
by
fivaa
Original Path:
trunk/Src/library/testing
Added regression tests for {EQA_EXTRACTED_TEST_SET}. Also serving as an example how an extracted test class is stuctured.
Revision
75145 -
Directory Listing
Modified
Thu Oct 16 23:52:17 2008 UTC
(11 years, 1 month ago)
by
fivaa
Original Path:
trunk/Src/library/testing
Revised extracted test ancestor class. Got rid of most {STRING} usage for storing the context.
for example:
* Types are stored in the form
{VECTOR [REAL_64]} (before "VECTOR [REAL_64]")
* Attribute/value pairs are stored in a tuple
TUPLE ["x", {REAL_64} 7.7, "y", {REAL_64} 5.3, "z", {REAL_64} 69.2]
This makes restoring the application state simpler and more efficient (no need to parse strings).
See next commit for example test class using {EQA_EXTRACTION_TEST_SET}.
Revision
75099 -
Directory Listing
Modified
Tue Oct 14 23:17:51 2008 UTC
(11 years, 1 month ago)
by
fivaa
Original Path:
trunk/Src/library/testing
Added extracted test set ancestor class, originally called CDD_EXTRACTED_TEST_CASE. Modified in a way that calling the actual test routine and using the extracted content is more intuitive to the user. This should make it a little easier to modify extracted test cases by hand.
Revision
75067 -
Directory Listing
Modified
Sat Oct 11 01:18:58 2008 UTC
(11 years, 2 months ago)
by
fivaa
Original Path:
trunk/Src/library/testing
Changed the way test are executed which makes everything a lot simpler and more efficient:
* Evaluator controller only get one test at a time assigned
* Evaluator process connects and receives test index over socket, executes test and sends result back before receiving next test index.
* Evaluator status object keeps track of how many time a test has been launched, that way it can also relaunch a test if the process has died without sending an outcome back.
Revision
75048 -
Directory Listing
Modified
Thu Oct 9 18:33:40 2008 UTC
(11 years, 2 months ago)
by
fivaa
Original Path:
trunk/Src/library/testing
Renamed most classes in testing library to have EQA_ prefix (eiffel quality assurance). Replaced `setup' and `tear_down' with `prepare' and `clean' to match eiffel terminology. However these routines are frozen but call routines `on_prepare' and `on_clean' which can be redefined by descendants.
Revision
74758 -
Directory Listing
Modified
Sat Sep 20 00:19:53 2008 UTC
(11 years, 2 months ago)
by
fivaa
Original Path:
trunk/Src/library/testing
Improved testing tool widgets showing tests and outcomes. Test output and stack traces are shown displayed in a proper window. Tests have a column showing how much time has passed since it was executed last.
Revision
74745 -
Directory Listing
Modified
Fri Sep 19 00:09:31 2008 UTC
(11 years, 2 months ago)
by
fivaa
Original Path:
trunk/Src/library/testing
Improved graphical part of testing tool:
* Added tabs showing testing results and execution status. Tabs are ES_WINDOW_WIDGETS so they could be used as separate tools.
* The outcome tab lists all outcomes of an selected tests. Output and failure stack trace can be seen by double clicking.
* Abstracted grids which list tests (or in general items of type TAGABLE_I), so there is no code duplication.
* Improved comments and made sure translated constants are used for all text in testing tool.
* Added bit to communication protocol before test result is sent to testing tool. This prevents EiffelStudio from blocking when waiting for a single test result.
Revision
74655 -
Directory Listing
Modified
Thu Sep 4 16:34:59 2008 UTC
(11 years, 3 months ago)
by
fivaa
Original Path:
trunk/Src/library/testing
Mostly bug fixing to get test execution work properly. For now the debugee gets frozen before testing to avoid strange behaviors when melted.
Revision
74633 -
Directory Listing
Modified
Fri Aug 29 16:33:41 2008 UTC
(11 years, 3 months ago)
by
fivaa
Original Path:
trunk/Src/library/testing
Initial implementation for executing tests in a external process. Results are received in a separate thread.
Notes:
* Test suite is permanently registered to idle action of EV_APPLICATION. This way test results and execution status are kept up to date.
* For now compilation is initialized directly, GUI needs to be synchronized properly.
* No visible change yet for tests which have been tested, but soon to come....
Revision
74567 -
Directory Listing
Modified
Tue Aug 26 18:03:42 2008 UTC
(11 years, 3 months ago)
by
fivaa
Original Path:
trunk/Src/library/testing
First implementation of test execution:
* Testing engine writes root class which returns instance of {TEST_SET} and corresponding agent for test routine.
* To start testing application is launched providing indexes for tests previously written to root class through arguments.
* The testing outcome is determined on the testing library side, outcome objects {TEST_OUTCOME} are then sent back to the testing engine through a socket.
* Result retreival is done in separate thread.
Revision
74520 -
Directory Listing
Modified
Thu Aug 21 16:55:56 2008 UTC
(11 years, 3 months ago)
by
fivaa
Original Path:
trunk/Src/library/testing
Extented testing library:
* Added evaluator which runs tests and provides results (TEST_OUTCOME).
* Base class {TEST_INTERPRETER} for standalone application that runs a list of tests. Results are then stored to a file or sent through a socket using independent store. This will mostly be used by the testing service for executing tests in the background but also in the debugger.