Benchmark

non-incremental/QF_LRA/LassoRanker/SV-COMP/NoriSharma-2013FSE-Fig8_true-termination.c_Iteration1_Loop_7-phaseTemplate.smt2

SMT script generated by Ultimate LassoRanker [1]
Ultimate LassoRanker is a tool that synthesizes ranking functions for 
linear lasso programs and implements the techniques presented in [2] and [3].
For generating these SMT scripts Ultimate LassoRanker was used as a sub 
procedure of the termination analyzer Ultimate BuchiAutomizer [4] which 
implements the techniques presented in [5].

This SMT script belongs to a set of SMT scripts that was generated by applying
revision 11505 of BuchiAutomizer to
- the benchmarks from the demonstration category on termination of the SV-COMP 
2014 [6] available at [7],
- the benchmarks from [8] which are available at [9] and,
- benchmarks from the repository of Ultimate LassoRanker.
This set of SMT scripts contains only SMT scripts that we considered to be 
difficult because LassoRanker run into a timeout after 10 seconds.

2014-05-03, Matthias Heizmann (heizmann@informatik.uni-freiburg.de)


[1] http://ultimate.informatik.uni-freiburg.de/LassoRanker/
[2] Jan Leike and Matthias Heizmann. Ranking Templates for Linear Loops. In 
TACAS 2014.
[3] Matthias Heizmann, Jochen Hoenicke, Jan Leike and Andreas Podelski. Linear 
Ranking for Linear Lasso Programs. In ATVA 2013.
[4] http://ultimate.informatik.uni-freiburg.de/BuchiAutomizer/
[5] Matthias Heizmann, Jochen Hoenicke and Andreas Podelski. Termination 
Analysis by Learning Terminating Programs. Accepted at CAV 2014
[6] Dirk Beyer: Status Report on Software Verification - (Competition Summary 
SV-COMP 2014). TACAS 2014
[7] https://svn.sosy-lab.org/software/sv-benchmarks/trunk/c/termination-crafted/
[8] Marc Brockschmidt, Byron Cook, Carsten Fuhs: Better Termination Proving 
through Cooperation. CAV 2013:413-429
[9] http://verify.rwth-aachen.de/brockschmidt/Cooperating-T2/
Benchmark
Size1952109
Compressed Size125842
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2014-07-21
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 1952101
Compressed Size125848
Max. Term Depth50
Asserts 391
Declared Functions0
Declared Constants3330
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

or3828 and3828 =11539 let3279
+17185 -4536 *8766 <2916
<=3492 >679 >=3240

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2015 0.57 (3/7) CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 856.98700 857.22900
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 867.26600 867.66800
MathSAT MathSat 5.3.6 main smtcomp2015_main unsat ✅ 538.98700 539.13700
SMTInterpol SMTInterpol v2.1-206-g86e9531 default unknown ❌ 2400.02000 2428.33000
SMT-RAT SMT-RAT-final default unknown ❌ 2400.01000 2401.12000
veriT veriT default unknown ❌ 2400.01000 2400.97000
Yices2 Yices default unsat ✅ 846.20800 846.53400
Z3 z3 4.4.0 default unknown ❌ 2400.01000 2400.98000
SMT-COMP 2016 0.56 (4/9) CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 845.11900 843.73200
MathSAT mathsat-5.3.11-linux-x86_64-Main default unsat ✅ 739.67400 740.12200
OpenSMT OpenSMT2-2016-05-12 default unknown ❌ 2400.03000 2401.27000
SMTInterpol smtinterpol-2.1-258-g92ab3df default unsat ✅ 680.98800 831.31500
SMT-RAT SMT-RAT default unknown ❌ 2400.10000 2401.41000
Toysmt toysmt default unknown ❌ 2034.01000 2034.42000
veriT veriT-dev default unknown ❌ 2400.10000 2401.28000
Yices2 Yices-2.4.2 default unsat ✅ 2309.38000 2310.67000
Z3 z3-4.4.1 default unknown ❌ 2400.02000 2401.37000
SMT-COMP 2017 1.00 (0/8) CVC4 CVC4-smtcomp2017-main default unknown ❌ 600.05100 598.81000
MathSAT mathsat-5.4.1-linux-x86_64-Main default unknown ❌ 600.10600 600.00000
OpenSMT opensmt2-2017-06-04 default unknown ❌ 600.02800 599.89000
SMTInterpol SMTInterpol default unknown ❌ 600.03600 730.14000
SMT-RAT SMTRAT-comp2017_2 default unknown ❌ 600.01000 599.91600
veriT veriT-2017-06-17 default unknown ❌ 600.01200 599.95900
Yices2 Yices2-Main default unknown ❌ 600.11200 600.04500
Z3 z3-4.5.0 default unknown ❌ 600.02100 599.99300
SMT-COMP 2018 0.67 (3/9) Ctrl-Ergo Ctrl-Ergo-SMTComp-2018_default unsat ✅ 38.77790 153.52000
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 880.44000 878.77400
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unknown ❌ 1200.01000 1199.92000
OpenSMT opensmt2_default unknown ❌ 1200.01000 1199.84000
SMTInterpol SMTInterpol-2.5-19-g0d39cdee_default unsat ✅ 738.73500 914.89100
SMT-RAT SMTRAT-Rat-final_default unknown ❌ 1200.01000 1199.82000
SMTRAT-MCSAT-final_default unknown ❌ 1200.04000 1200.00000
veriT veriT_default unknown ❌ 1200.02000 1199.85000
Yices2 Yices 2.6.0_default unknown ❌ 1200.03000 1199.92000
Z3 z3-4.7.1_default unknown ❌ 1200.01000 1199.77000
SMT-COMP 2019 0.38 (5/8) Ctrl-Ergo Ctrl-Ergo-2019-wrapped-sq_default unsat ✅ 75.03840 297.47000
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 924.48700 922.34200
CVC4-SymBreak_03_06_2019-wrapped-sq_default unsat ✅ 1650.14000 1648.02000
master-2018-06-10-b19c840-competition-default_default unsat ✅ 727.17800 725.73600
OpenSMT OpenSMT-wrapped-sq_default unknown ❌ 2400.03000 2399.71000
Par4 Par4-wrapped-sq_default unsat ✅ 551.36600 2179.44000
SMTInterpol smtinterpol-2.5-514-wrapped-sq_default unsat ✅ 2009.91000 2037.24000
veriT veriT-wrapped-sq_default unknown ❌ 2400.05000 2399.82000
Yices2 Yices 2.6.2-wrapped-sq_default unsat ✅ 1039.16000 1039.08000
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unknown ❌ 2400.04000 2399.66000
SMT-COMP 2025 0.17 (5/6) cvc5 cvc5 unsat ✅ 818.72436 818.53417
OpenSMT OpenSMT unsat ✅ 31.05555 30.91895
SMTInterpol SMTInterpol unknown ❌ 1201.48980 1238.22465
Yices2 Yices2 unsat ✅ 603.51277 603.33422
Z3alpha Z3-alpha unsat ✅ 481.95069 1924.27682
Z3 Z3-alpha-base unsat ✅ 445.19331 445.02386