Benchmark

non-incremental/QF_LRA/LassoRanker/CooperatingT2/elmhes.t2.c_Iteration2_Loop_7-phaseTemplate.smt2 

SMT script generated by Ultimate LassoRanker [1]
Ultimate LassoRanker is a tool that synthesizes ranking functions for 
linear lasso programs and implements the techniques presented in [2] and [3].
For generating these SMT scripts Ultimate LassoRanker was used as a sub 
procedure of the termination analyzer Ultimate BuchiAutomizer [4] which 
implements the techniques presented in [5].

This SMT script belongs to a set of SMT scripts that was generated by applying
revision 11505 of BuchiAutomizer to
- the benchmarks from the demonstration category on termination of the SV-COMP 
2014 [6] available at [7],
- the benchmarks from [8] which are available at [9] and,
- benchmarks from the repository of Ultimate LassoRanker.
This set of SMT scripts contains only SMT scripts that we considered to be 
difficult because LassoRanker run into a timeout after 10 seconds.

2014-05-03, Matthias Heizmann (heizmann@informatik.uni-freiburg.de)


[1] http://ultimate.informatik.uni-freiburg.de/LassoRanker/
[2] Jan Leike and Matthias Heizmann. Ranking Templates for Linear Loops. In 
TACAS 2014.
[3] Matthias Heizmann, Jochen Hoenicke, Jan Leike and Andreas Podelski. Linear 
Ranking for Linear Lasso Programs. In ATVA 2013.
[4] http://ultimate.informatik.uni-freiburg.de/BuchiAutomizer/
[5] Matthias Heizmann, Jochen Hoenicke and Andreas Podelski. Termination 
Analysis by Learning Terminating Programs. Accepted at CAV 2014
[6] Dirk Beyer: Status Report on Software Verification - (Competition Summary 
SV-COMP 2014). TACAS 2014
[7] https://svn.sosy-lab.org/software/sv-benchmarks/trunk/c/termination-crafted/
[8] Marc Brockschmidt, Byron Cook, Carsten Fuhs: Better Termination Proving 
through Cooperation. CAV 2013:413-429
[9] http://verify.rwth-aachen.de/brockschmidt/Cooperating-T2/
Benchmark
Size1083209
Compressed Size86608
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2014-07-21
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK—
check-sat calls1
Query 1
Status sat
Inferred Status sat
Size 1083201
Compressed Size86594
Max. Term Depth132
Asserts 71
Declared Functions0
Declared Constants583
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

or956 and956 =11913 let1472
+13883 -1572 *4594 <844
<=908 >103 >=448

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2014 CVC4 CVC4 f7118b2 default sat ✅ 26.67430 26.66890
MathSAT MathSAT-5.2.12-Main default sat ✅ 131.46900 131.49000
SMTInterpol smtinterpol-2.1-118-g3dada2f default sat ✅ 5.62715 13.75890
veriT veriT-smtcomp2014 default sat ✅ 37.56060 37.55430
Yices2 Yices-2.2.1-smtcomp2014 default sat ✅ 1.11758 1.10883
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default sat ✅ 737.45800 737.71900
SMT-COMP 2015 CVC4 CVC4-master-2015-06-15-9b32405-main default sat ✅ 9.32737 9.32858
CVC4-experimental-2015-06-15-ff5745a-main default sat ✅ 9.32459 9.32358
MathSAT MathSat 5.3.6 main smtcomp2015_main sat ✅ 102.46400 102.50500
SMTInterpol SMTInterpol v2.1-206-g86e9531 default sat ✅ 5.15308 11.52720
SMT-RAT SMT-RAT-final default sat ✅ 6.07603 6.07708
veriT veriT default sat ✅ 47.75880 47.77770
Yices2 Yices default sat ✅ 1.65405 1.65375
Z3 z3 4.4.0 default sat ✅ 1224.21000 1224.66000
SMT-COMP 2016 0.33 (6/9) CVC4 CVC4-master-2016-05-27-cfef263-main default sat ✅ 21.42810 21.43910
MathSAT mathsat-5.3.11-linux-x86_64-Main default sat ✅ 100.68700 100.68600
OpenSMT OpenSMT2-2016-05-12 default unknown ❌ 2400.01000 2401.34000
SMTInterpol smtinterpol-2.1-258-g92ab3df default sat ✅ 3.81627 14.00600
SMT-RAT SMT-RAT default unknown ❌ 2400.03000 2401.36000
Toysmt toysmt default unknown ❌ 2400.03000 2401.19000
veriT veriT-dev default sat ✅ 130.84200 130.90900
Yices2 Yices-2.4.2 default sat ✅ 2.02222 2.02335
Z3 z3-4.4.1 default sat ✅ 747.90700 748.30500
SMT-COMP 2017 0.25 (6/8) CVC4 CVC4-smtcomp2017-main default sat ✅ 16.52310 16.52270
MathSAT mathsat-5.4.1-linux-x86_64-Main default sat ✅ 2.19660 2.19645
OpenSMT opensmt2-2017-06-04 default unknown ❌ 600.10200 600.08500
SMTInterpol SMTInterpol default sat ✅ 3.55961 12.23340
SMT-RAT SMTRAT-comp2017_2 default unknown ❌ 600.02200 599.95400
veriT veriT-2017-06-17 default sat ✅ 47.51430 47.51140
Yices2 Yices2-Main default sat ✅ 0.25480 0.25372
Z3 z3-4.5.0 default sat ✅ 498.35200 498.29400
SMT-COMP 2018 0.22 (7/9) Ctrl-Ergo Ctrl-Ergo-SMTComp-2018_default sat ✅ 10.83670 42.42000
CVC4 master-2018-06-10-b19c840-competition-default_default sat ✅ 22.39070 22.38700
MathSAT mathsat-5.5.2-linux-x86_64-Main_default sat ✅ 5.27327 5.27413
OpenSMT opensmt2_default unknown ❌ 1200.02000 1199.94000
SMTInterpol SMTInterpol-2.5-19-g0d39cdee_default sat ✅ 3.53575 10.72540
SMT-RAT SMTRAT-Rat-final_default unknown ❌ 1200.02000 1199.83000
SMTRAT-MCSAT-final_default unknown ❌ 1200.01000 1199.95000
veriT veriT_default sat ✅ 59.88450 59.88020
Yices2 Yices 2.6.0_default sat ✅ 94.82370 94.81600
Z3 z3-4.7.1_default sat ✅ 120.55900 120.55700
SMT-COMP 2019 Ctrl-Ergo Ctrl-Ergo-2019-wrapped-sq_default sat ✅ 7.87031 30.71000
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default sat ✅ 6.76033 6.75994
CVC4-SymBreak_03_06_2019-wrapped-sq_default sat ✅ 58.21090 57.68010
master-2018-06-10-b19c840-competition-default_default sat ✅ 19.65720 19.65410
OpenSMT OpenSMT-wrapped-sq_default sat ✅ 1780.93000 1780.87000
Par4 Par4-wrapped-sq_default sat ✅ 2.44421 9.44000
SMTInterpol smtinterpol-2.5-514-wrapped-sq_default sat ✅ 5.94542 18.07610
veriT veriT-wrapped-sq_default sat ✅ 71.48180 71.48140
Yices2 Yices 2.6.2-wrapped-sq_default sat ✅ 5.81144 5.81087
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default sat ✅ 53.20050 53.19460
SMT-COMP 2020 CVC4 CVC4-sq-final_default sat ✅ 7.14671 7.14537
MathSAT MathSAT5_default.sh sat ✅ 1.89289 1.89283
OpenSMT OpenSMT_default sat ✅ 3.41869 3.41852
Par4 Par4-wrapped-sq_default sat ✅ 2.71426 10.32230
SMTInterpol smtinterpol-2.5-679-gacfde87a_default sat ✅ 7.96826 23.31880
veriT veriT_default sat ✅ 53.81680 53.81690
Yices2 Yices 2.6.2 bug fix_default sat ✅ 2.24836 2.24833
Z3 z3-4.8.8_default sat ✅ 3.05519 3.05507
SMT-COMP 2022 cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq sat ✅ 17.58660 17.57980
MathSAT MathSAT-5.6.8_default sat ✅ 5.00218 4.99151
veriT veriT_default sat ✅ 44.07090 44.04090
Yices2 Yices 2.6.2 for SMTCOMP 2021_default sat ✅ 1.03754 1.03652
Yices 2.6.2 for SMTCOMP 2021_default sat ✅ 1.03114 1.03111
Z3 z3-4.8.17_default sat ✅ 2.44900 2.45073
SMT-COMP 2023 cvc5 cvc5-default-2023-05-16-ea045f305_sq sat ✅ 5.63454 5.63477
OpenSMT OpenSMT a78dcf01_default sat ✅ 2.10878 2.10839
SMTInterpol smtinterpol-2.5-1272-g2d6d356c_default sat ✅ 7.71567 22.70740
Yaga Yaga_SMT-COMP-2023_presubmition_default sat ✅ 0.38023 0.38016
Yices2 Yices 2 for SMTCOMP 2023_default sat ✅ 0.41346 0.41331
Yices 2.6.2 for SMTCOMP 2021_default sat ✅ 0.41449 0.41435
Yices 2.6.2 for SMTCOMP 2021_default sat ✅ 0.41537 0.41530
SMT-COMP 2024 cvc5 cvc5 sat ✅ 4.53899 4.43682
OpenSMT OpenSMT sat ✅ 3.81552 3.71553
SMTInterpol SMTInterpol sat ✅ 6.75058 18.96751
Yices2 Yices2 sat ✅ 1.16008 1.05996
Z3alpha Z3-alpha sat ✅ 2.47551 2.37479