public enum RuntimeVariable extends Enum<RuntimeVariable>
This enumeration defines all the runtime variables we want to store in the CSV files. A runtime variable is either an output of the search (e.g., obtained branch coverage) or something that can only be determined once the CUT is analyzed (e.g., the number of branches)
Note, it is perfectly fine to add new runtime variables in this enum, in any position. But it is essential to provide JavaDoc descriptions for each new variable
WARNING: do not change the name of any variable! If you do, current R scripts will break. If you really need to change a name, please first contact Andrea Arcuri.
| Enum Constant and Description |
|---|
AliasingInterMethodPairs |
AliasingIntraClassPairs |
AliasingIntraMethodPairs |
AliasingParameterPairs |
AllDefCoverage |
AllDefCoverageBitString |
AllPermission |
AmbiguityScore
The obtained ambiguity coverage
|
AmbiguityScore_T0 |
AmbiguityScoreTimeline |
Analyzed_Classes
Number of classes analyzed for test cluster
|
AssertionContract |
AudioPermission |
AuthPermission |
AWTPermission |
BC_dcmpg |
BC_dcmpl |
BC_fcmpg |
BC_fcmpl |
BC_lcmp
Count of bytecode instructions (static)
|
BranchCoverage
Not only the covered branches ratio, but also including the branchless methods.
|
BranchCoverageBitString
A bit string (0/1) representing whether branches (in order) are covered
|
BranchCoverageTimeline |
Branchless_Methods
Number of methods without any predicates
|
CarvedCoverage
The branch coverage of the carved tests
|
CarvedTests
How many tests were carved, ie used as input seeds for the search
|
CBranchCoverage |
CBranchCoverageBitString |
CBranchCoverageTimeline |
CBranchFitnessTimeline |
Classpath_Classes
Number of classes in classpath
|
Cmp_IntInt |
Cmp_IntZero
Count of branch comparison types in bytecode (static)
|
Cmp_RefNull |
Cmp_RefRef |
Contract_Violations |
Coverage
Obtained coverage of the chosen testing criterion
|
Coverage_New |
Coverage_Old |
CoverageBitString
A bit string (0/1) representing whether goals (in order) are covered
|
CoverageTimeline
Obtained coverage (of the chosen testing criterion) at different points in time
|
Covered_Branches
Number of covered branches in CUT
|
Covered_Branches_Instrumented |
Covered_Branches_Real |
Covered_Branchless_Methods
Number of methods without predicates covered
|
Covered_dcmpg |
Covered_dcmpl |
Covered_fcmpg |
Covered_fcmpl |
Covered_Goals
Total number of covered goals
|
Covered_IntInt |
Covered_IntZero
Count of branch comparisons covered (dynamic)
|
Covered_lcmp
Count of bytecode instructions reached (dynamic)
|
Covered_Lines
The actual covered line numbers
|
Covered_Methods
Number of methods covered
|
Covered_RefNull |
Covered_RefRef |
CoveredAliasInterMethodPairs |
CoveredAliasIntraClassPairs |
CoveredAliasIntraMethodPairs |
CoveredAliasParameterPairs |
CoveredInterMethodPairs |
CoveredIntraClassPairs |
CoveredIntraMethodPairs |
CoveredParameterPairs |
Data_File |
Definitions |
DefUseCoverage |
DefUseCoverageBitString |
DefUsePairs |
DiversityTimeline
Population similarity values at different points in time
|
EqualsContract |
EqualsHashcodeContract |
EqualsNullContract |
EqualsSymmetricContract |
Error_Branches_Covered |
Error_Branchless_Methods |
Error_Branchless_Methods_Covered |
Error_Predicates |
Exception_Difference |
ExceptionCoverage
The obtained exception coverage
|
ExceptionCoverageBitString |
ExceptionCoverageTimeline |
ExceptionFitnessTimeline |
Explicit_MethodExceptions
Number of top-level methods throwing an undeclared exception explicitly with a 'throw new'
|
Explicit_TypeExceptions
Number of undeclared exception types that were explicitly thrown with a 'throw new' at least once
|
FilePermission |
Fitness
Fitness value of the best individual
|
Fitness_Evaluations
The total number of fitness evaluations during the search
|
FitnessTimeline
Obtained fitness values at different points in time
|
Generated_Assertions
Regression-related Variables
|
Generations
Number of generations the search algorithm has been evolving
|
Generators
Total number of generators
|
Gradient_Branches
Total number of gradient branches
|
Gradient_Branches_Covered
Total number of covered gradient branches
|
HadUnstableTests
Was any test unstable in the generated JUnit files?
|
HashCodeReturnsNormallyContract |
IBranchCoverage |
IBranchCoverageBitString |
IBranchGoalsTimeline |
IBranchInitialGoals |
IBranchInitialGoalsInTargetClass |
Implicit_MethodExceptions
Number of top-level methods throwing an undeclared exception implicitly (ie, no 'new throw')
|
Implicit_TypeExceptions
Number of undeclared exception types that were implicitly thrown (ie, no 'new throw') at least once
|
InputCoverage
The input value coverage
|
InputCoverageBitString |
InputCoverageTimeline |
InputFitnessTimeline |
Instrumented_Predicates
Number of added jump conditions through instrumentation
|
IntegerAndRealConstraints
The number of constraint made of integer and real constraints
|
IntegerAndStringConstraints
The number of constraint made of integer and string constraints
|
IntegerOnlyConstraints
The number of constraint made of integer constraints and no other type
|
IntegerRealAndStringConstraints
Number of constraints containing all three types altogether
|
InterMethodPairs |
IntraClassPairs |
IntraMethodPairs |
JCrasherExceptionContract |
LCSAJs |
Length
Total number of statements in final test suite
|
LengthTimeline
Obtained length values at different points in time
|
LineCoverage
The obtained line coverage
|
LineCoverageBitString |
LineCoverageTimeline |
LineFitnessTimeline |
Lines
The number of lines in the CUT
|
LoggingPermission |
MethodCoverage
The obtained method coverage
|
MethodCoverageBitString |
MethodCoverageTimeline |
MethodFitnessTimeline |
MethodNoExceptionCoverage
The obtained method coverage (only normal behaviour)
|
MethodNoExceptionCoverageBitString |
MethodNoExceptionCoverageTimeline |
MethodNoExceptionFitnessTimeline |
MethodTraceCoverage
The obtained method coverage (method calls anywhere in trace)
|
MethodTraceCoverageBitString |
MethodTraceCoverageTimeline |
MethodTraceFitnessTimeline |
Minimized_Length
Deprecated.
|
Minimized_Size
Deprecated.
|
Modifiers
Total number of modifiers
|
Mutants
Number of mutants
|
MutationCoverageBitString |
MutationScore
The obtained score for (strong) mutation testing
|
NetPermission |
NullPointerExceptionContract |
NumberOfInputPoolObjects
(FIXME: need to be implemented) The number of serialized objects that EvoSuite is going to use for seeding strategies
|
NumberOfSATQueries
The number of SAT answers to Solver queries
|
NumberOfTimeoutQueries
The number of TIMEOUTs when solving queries
|
NumberOfUNSATQueries
The number of UNSAT answers to Solver queries
|
NumberOfUnusefulNewTests
How many SAT queries led to Unuseful (i.e.
|
NumberOfUsefulNewTests
How many SAT queries led to Useful (i.e.
|
NumRegressionTestCases
Number of regression test cases
|
NumUnstableTests
Number of unstable tests in the generated JUnit files
|
OnlyBranchCoverage
Only the covered branches ratio.
|
OnlyBranchCoverageBitString |
OnlyBranchCoverageTimeline |
OnlyBranchFitnessTimeline |
OnlyMutationCoverageBitString |
OnlyMutationCoverageTimeline |
OnlyMutationFitnessTimeline |
OnlyMutationScore
Only mutation = only infection distance
|
OtherPermission |
OutputCoverage
The obtained output value coverage
|
OutputCoverageBitString |
OutputCoverageTimeline |
OutputFitnessTimeline |
ParameterPairs |
Predicates
Number of predicates in CUT
|
PropertyPermission |
Random_Seed
The random seed used during the search.
|
Reached_dcmpg |
Reached_dcmpl |
Reached_fcmpg |
Reached_fcmpl |
Reached_IntInt |
Reached_IntZero
Count of branch comparisons reached (dynamic)
|
Reached_lcmp
Count of bytecode instructions reached (dynamic)
|
Reached_RefNull |
Reached_RefRef |
RealAndStringConstraints
The number of constraint made of real and string constraints
|
RealOnlyConstraints
The number of constraint made of real constraints and no other type
|
ReflectPermission |
Result_Length
Total number of statements in final test suite before minimization
|
Result_Size
Number of tests in resulting test suite before minimization
|
RhoScore
The obtained rho coverage
|
RhoScore_T0 |
RhoScoreTimeline |
RSM_OverMinimized
For sanity-checking purposes
|
RuntimePermission |
SecurityPermission |
SerializablePermission |
Size
Number of tests in resulting test suite
|
Size_T0
Obtained size values at different points in time
|
SizeTimeline |
SocketPermission |
SQLPermission |
SSLPermission |
State_Distance |
StatementCoverage
The obtained statement coverage
|
StatementCoverageBitString
A bit string (0/1) representing whether statements (in order) are covered
|
Statements_Executed
Total number of statements executed
|
StringOnlyConstraints
The number of constraint made of real constraints and no other type
|
Tests_Executed
The total number of tests executed during the search
|
Testsuite_Diversity |
Threads
An estimate (ie not precise) of the maximum number of threads running at the same time in the CUT
|
Time_Assertion
Timings
|
Time_Coverage |
Time_Diversity |
Time_StateDistance |
ToStringReturnsNormallyContract |
Total_Branches
Total number of branches in CUT
|
Total_Branches_Instrumented |
Total_Branches_Real
Coverage of instrumented branches
|
Total_Goals
Total number of coverage goals for current criterion
|
Total_Methods
Total number of methods in CUT
|
Total_Time
The total time EvoSuite spent generating the test cases
|
TotalExceptionsTimeline
Total number of exceptions covered
|
TotalNumberOfConstraints
This total should be the sum of all the other types of constraints
|
TryCatchCoverage |
UndeclaredExceptionContract |
Unique_Violations |
UnresolvedPermission |
Uses |
WeakMutationCoverageBitString |
WeakMutationCoverageTimeline |
WeakMutationScore
The obtained score for weak mutation testing
|
| Modifier and Type | Method and Description |
|---|---|
static boolean |
validateRuntimeVariables(Map<String,OutputVariable<?>> map)
check if the variables do satisfy a set of predefined constraints: eg, the
number of covered targets cannot be higher than their total number
|
static RuntimeVariable |
valueOf(String name)
Returns the enum constant of this type with the specified name.
|
static RuntimeVariable[] |
values()
Returns an array containing the constants of this enum type, in
the order they are declared.
|
public static final RuntimeVariable Predicates
public static final RuntimeVariable Instrumented_Predicates
public static final RuntimeVariable Classpath_Classes
public static final RuntimeVariable Analyzed_Classes
public static final RuntimeVariable Generators
public static final RuntimeVariable Modifiers
public static final RuntimeVariable Total_Branches
public static final RuntimeVariable Covered_Branches
public static final RuntimeVariable Gradient_Branches
public static final RuntimeVariable Gradient_Branches_Covered
public static final RuntimeVariable Lines
public static final RuntimeVariable Covered_Lines
public static final RuntimeVariable Total_Methods
public static final RuntimeVariable Covered_Methods
public static final RuntimeVariable Branchless_Methods
public static final RuntimeVariable Covered_Branchless_Methods
public static final RuntimeVariable Total_Goals
public static final RuntimeVariable Covered_Goals
public static final RuntimeVariable Mutants
public static final RuntimeVariable Statements_Executed
public static final RuntimeVariable Tests_Executed
public static final RuntimeVariable Fitness_Evaluations
public static final RuntimeVariable Generations
public static final RuntimeVariable Coverage
public static final RuntimeVariable CoverageBitString
public static final RuntimeVariable Fitness
public static final RuntimeVariable CoverageTimeline
public static final RuntimeVariable FitnessTimeline
public static final RuntimeVariable DiversityTimeline
public static final RuntimeVariable Size_T0
public static final RuntimeVariable SizeTimeline
public static final RuntimeVariable LengthTimeline
public static final RuntimeVariable StatementCoverage
public static final RuntimeVariable StatementCoverageBitString
public static final RuntimeVariable RhoScore
public static final RuntimeVariable RhoScore_T0
public static final RuntimeVariable RhoScoreTimeline
public static final RuntimeVariable AmbiguityScore
public static final RuntimeVariable AmbiguityScore_T0
public static final RuntimeVariable AmbiguityScoreTimeline
public static final RuntimeVariable BranchCoverage
public static final RuntimeVariable Total_Branches_Real
public static final RuntimeVariable Total_Branches_Instrumented
public static final RuntimeVariable Covered_Branches_Real
public static final RuntimeVariable Covered_Branches_Instrumented
public static final RuntimeVariable TryCatchCoverage
public static final RuntimeVariable BranchCoverageTimeline
public static final RuntimeVariable BranchCoverageBitString
public static final RuntimeVariable OnlyBranchCoverage
public static final RuntimeVariable OnlyBranchFitnessTimeline
public static final RuntimeVariable OnlyBranchCoverageTimeline
public static final RuntimeVariable OnlyBranchCoverageBitString
public static final RuntimeVariable CBranchCoverage
public static final RuntimeVariable CBranchFitnessTimeline
public static final RuntimeVariable CBranchCoverageTimeline
public static final RuntimeVariable CBranchCoverageBitString
public static final RuntimeVariable IBranchCoverage
public static final RuntimeVariable IBranchInitialGoals
public static final RuntimeVariable IBranchInitialGoalsInTargetClass
public static final RuntimeVariable IBranchGoalsTimeline
public static final RuntimeVariable IBranchCoverageBitString
public static final RuntimeVariable MethodTraceCoverage
public static final RuntimeVariable MethodTraceFitnessTimeline
public static final RuntimeVariable MethodTraceCoverageTimeline
public static final RuntimeVariable MethodTraceCoverageBitString
public static final RuntimeVariable MethodCoverage
public static final RuntimeVariable MethodFitnessTimeline
public static final RuntimeVariable MethodCoverageTimeline
public static final RuntimeVariable MethodCoverageBitString
public static final RuntimeVariable MethodNoExceptionCoverage
public static final RuntimeVariable MethodNoExceptionFitnessTimeline
public static final RuntimeVariable MethodNoExceptionCoverageTimeline
public static final RuntimeVariable MethodNoExceptionCoverageBitString
public static final RuntimeVariable LineCoverage
public static final RuntimeVariable LineFitnessTimeline
public static final RuntimeVariable LineCoverageTimeline
public static final RuntimeVariable LineCoverageBitString
public static final RuntimeVariable OutputCoverage
public static final RuntimeVariable OutputFitnessTimeline
public static final RuntimeVariable OutputCoverageTimeline
public static final RuntimeVariable OutputCoverageBitString
public static final RuntimeVariable InputCoverage
public static final RuntimeVariable InputFitnessTimeline
public static final RuntimeVariable InputCoverageTimeline
public static final RuntimeVariable InputCoverageBitString
public static final RuntimeVariable ExceptionCoverage
public static final RuntimeVariable ExceptionFitnessTimeline
public static final RuntimeVariable ExceptionCoverageTimeline
public static final RuntimeVariable ExceptionCoverageBitString
public static final RuntimeVariable WeakMutationScore
public static final RuntimeVariable WeakMutationCoverageTimeline
public static final RuntimeVariable WeakMutationCoverageBitString
public static final RuntimeVariable OnlyMutationScore
public static final RuntimeVariable OnlyMutationFitnessTimeline
public static final RuntimeVariable OnlyMutationCoverageTimeline
public static final RuntimeVariable OnlyMutationCoverageBitString
public static final RuntimeVariable MutationScore
public static final RuntimeVariable MutationCoverageBitString
public static final RuntimeVariable Total_Time
public static final RuntimeVariable Size
public static final RuntimeVariable Length
public static final RuntimeVariable Result_Size
public static final RuntimeVariable Result_Length
@Deprecated public static final RuntimeVariable Minimized_Size
Size@Deprecated public static final RuntimeVariable Minimized_Length
Lengthpublic static final RuntimeVariable Random_Seed
public static final RuntimeVariable CarvedTests
public static final RuntimeVariable CarvedCoverage
public static final RuntimeVariable HadUnstableTests
public static final RuntimeVariable NumUnstableTests
public static final RuntimeVariable NumRegressionTestCases
public static final RuntimeVariable Threads
public static final RuntimeVariable Explicit_MethodExceptions
public static final RuntimeVariable Explicit_TypeExceptions
public static final RuntimeVariable Implicit_MethodExceptions
public static final RuntimeVariable Implicit_TypeExceptions
public static final RuntimeVariable TotalExceptionsTimeline
public static final RuntimeVariable AllPermission
public static final RuntimeVariable SecurityPermission
public static final RuntimeVariable UnresolvedPermission
public static final RuntimeVariable AWTPermission
public static final RuntimeVariable FilePermission
public static final RuntimeVariable SerializablePermission
public static final RuntimeVariable ReflectPermission
public static final RuntimeVariable RuntimePermission
public static final RuntimeVariable NetPermission
public static final RuntimeVariable SocketPermission
public static final RuntimeVariable SQLPermission
public static final RuntimeVariable PropertyPermission
public static final RuntimeVariable LoggingPermission
public static final RuntimeVariable SSLPermission
public static final RuntimeVariable AuthPermission
public static final RuntimeVariable AudioPermission
public static final RuntimeVariable OtherPermission
public static final RuntimeVariable Generated_Assertions
public static final RuntimeVariable Coverage_Old
public static final RuntimeVariable Coverage_New
public static final RuntimeVariable Exception_Difference
public static final RuntimeVariable State_Distance
public static final RuntimeVariable Testsuite_Diversity
public static final RuntimeVariable Time_Assertion
public static final RuntimeVariable Time_Coverage
public static final RuntimeVariable Time_StateDistance
public static final RuntimeVariable Time_Diversity
public static final RuntimeVariable Cmp_IntZero
public static final RuntimeVariable Cmp_IntInt
public static final RuntimeVariable Cmp_RefNull
public static final RuntimeVariable Cmp_RefRef
public static final RuntimeVariable Reached_IntZero
public static final RuntimeVariable Reached_IntInt
public static final RuntimeVariable Reached_RefNull
public static final RuntimeVariable Reached_RefRef
public static final RuntimeVariable Covered_IntZero
public static final RuntimeVariable Covered_IntInt
public static final RuntimeVariable Covered_RefNull
public static final RuntimeVariable Covered_RefRef
public static final RuntimeVariable BC_lcmp
public static final RuntimeVariable BC_fcmpl
public static final RuntimeVariable BC_fcmpg
public static final RuntimeVariable BC_dcmpl
public static final RuntimeVariable BC_dcmpg
public static final RuntimeVariable Reached_lcmp
public static final RuntimeVariable Reached_fcmpl
public static final RuntimeVariable Reached_fcmpg
public static final RuntimeVariable Reached_dcmpl
public static final RuntimeVariable Reached_dcmpg
public static final RuntimeVariable Covered_lcmp
public static final RuntimeVariable Covered_fcmpl
public static final RuntimeVariable Covered_fcmpg
public static final RuntimeVariable Covered_dcmpl
public static final RuntimeVariable Covered_dcmpg
public static final RuntimeVariable RSM_OverMinimized
public static final RuntimeVariable NumberOfInputPoolObjects
public static final RuntimeVariable Error_Predicates
public static final RuntimeVariable Error_Branches_Covered
public static final RuntimeVariable Error_Branchless_Methods
public static final RuntimeVariable Error_Branchless_Methods_Covered
public static final RuntimeVariable AssertionContract
public static final RuntimeVariable EqualsContract
public static final RuntimeVariable EqualsHashcodeContract
public static final RuntimeVariable EqualsNullContract
public static final RuntimeVariable EqualsSymmetricContract
public static final RuntimeVariable HashCodeReturnsNormallyContract
public static final RuntimeVariable JCrasherExceptionContract
public static final RuntimeVariable NullPointerExceptionContract
public static final RuntimeVariable ToStringReturnsNormallyContract
public static final RuntimeVariable UndeclaredExceptionContract
public static final RuntimeVariable Contract_Violations
public static final RuntimeVariable Unique_Violations
public static final RuntimeVariable Data_File
public static final RuntimeVariable AllDefCoverage
public static final RuntimeVariable AllDefCoverageBitString
public static final RuntimeVariable DefUseCoverage
public static final RuntimeVariable DefUseCoverageBitString
public static final RuntimeVariable Definitions
public static final RuntimeVariable Uses
public static final RuntimeVariable DefUsePairs
public static final RuntimeVariable IntraMethodPairs
public static final RuntimeVariable InterMethodPairs
public static final RuntimeVariable IntraClassPairs
public static final RuntimeVariable ParameterPairs
public static final RuntimeVariable LCSAJs
public static final RuntimeVariable AliasingIntraMethodPairs
public static final RuntimeVariable AliasingInterMethodPairs
public static final RuntimeVariable AliasingIntraClassPairs
public static final RuntimeVariable AliasingParameterPairs
public static final RuntimeVariable CoveredIntraMethodPairs
public static final RuntimeVariable CoveredInterMethodPairs
public static final RuntimeVariable CoveredIntraClassPairs
public static final RuntimeVariable CoveredParameterPairs
public static final RuntimeVariable CoveredAliasIntraMethodPairs
public static final RuntimeVariable CoveredAliasInterMethodPairs
public static final RuntimeVariable CoveredAliasIntraClassPairs
public static final RuntimeVariable CoveredAliasParameterPairs
public static final RuntimeVariable IntegerOnlyConstraints
public static final RuntimeVariable RealOnlyConstraints
public static final RuntimeVariable StringOnlyConstraints
public static final RuntimeVariable IntegerAndRealConstraints
public static final RuntimeVariable IntegerAndStringConstraints
public static final RuntimeVariable RealAndStringConstraints
public static final RuntimeVariable IntegerRealAndStringConstraints
public static final RuntimeVariable TotalNumberOfConstraints
public static final RuntimeVariable NumberOfSATQueries
public static final RuntimeVariable NumberOfUNSATQueries
public static final RuntimeVariable NumberOfTimeoutQueries
public static final RuntimeVariable NumberOfUsefulNewTests
public static final RuntimeVariable NumberOfUnusefulNewTests
public static RuntimeVariable[] values()
for (RuntimeVariable c : RuntimeVariable.values()) System.out.println(c);
public static RuntimeVariable valueOf(String name)
name - the name of the enum constant to be returned.IllegalArgumentException - if this enum type has no constant with the specified nameNullPointerException - if the argument is nullpublic static boolean validateRuntimeVariables(Map<String,OutputVariable<?>> map)
map - from (key->variable name) to (value -> output variable)Copyright © 2010–2017 EvoSuite. All rights reserved.