Benchmark

non-incremental/QF_NRA/UltimateAutomizer/InVarSynth_ShortCircuit-SideEffect-DoStatement-Safe.c_Iteration2_0.smt2

SMT script generated by Ultimate Automizer [1,2].
Ultimate Automizer is a software verifier for C programs that implements an
automata-based approach [3].
The commands in this SMT scripts are used for a constraint-based synthesis
of invariants [4].

2016-04-30, Matthias Heizmann (heizmann@informatik.uni-freiburg.de)


[1] http://http://ultimate.informatik.uni-freiburg.de/automizer/
[2] Matthias Heizmann, Daniel Dietsch, Marius Greitschus, Jan Leike,
Betim Musa, Claus Schätzle, Andreas Podelski: Ultimate Automizer with
Two-track Proofs - (Competition Contribution). TACAS 2016: 950-953
[3] Matthias Heizmann, Jochen Hoenicke, Andreas Podelski: Software Model
Checking for People Who Love Automata. CAV 2013:36-52
[4] Michael Colon, Sriram Sankaranarayanan, Henny Sipma: Linear Invariant
Generation Using Non-linear Constraint Solving. CAV 2003: 420-432
Benchmark
Size27565
Compressed Size2419
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2015-07-02
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status sat
Inferred Status sat
Size 27557
Compressed Size2432
Max. Term Depth8
Asserts 5
Declared Functions0
Declared Constants158
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

or10 and5 =82 +314
-92 *472 <10 <=10
>10 >=42

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2016 0.80 (1/5) CVC4 CVC4-master-2016-05-27-cfef263-main default unknown ❌ 0.04486 0.04503
raSAT raSAT 0.3 default.sh unknown ❌ 2400.02000 2401.61000
raSAT 0.4 exp - final default.py unknown ❌ 2400.03000 4810.99000
SMT-RAT SMT-RAT default unknown ❌ 2400.07000 2401.43000
Yices2 Yices-2.4.2 default sat ✅ 4.39974 4.40223
Z3 z3-4.4.1 default unknown ❌ 2400.02000 2401.36000
SMT-COMP 2017 0.60 (2/5) CVC4 CVC4-smtcomp2017-main default unknown ❌ 600.03800 599.23000
SMT-RAT SMTRAT-comp2017_2 default unknown ❌ 600.04600 600.02500
veriT veriT+raSAT+Redlog default unknown ❌ 600.03100 600.36000
Yices2 Yices2-Main default sat ✅ 3.73037 3.72884
Z3 z3-4.5.0 default sat ✅ 13.59500 13.59330
SMT-COMP 2018 1.00 (0/5) CVC4 master-2018-06-10-b19c840-competition-default_default unknown ❌ 1200.01000 1197.14000
SMT-RAT SMTRAT-Rat-final_default unknown ❌ 1200.02000 1199.81000
SMTRAT-MCSAT-final_default unknown ❌ 1200.10000 1200.00000
veriT veriT+raSAT+Reduce_default unknown ❌ 1200.11000 1200.06000
Yices2 Yices 2.6.0_default unknown ❌ 1200.11000 1200.10000
Z3 z3-4.7.1_default unknown ❌ 1200.01000 1199.80000
SMT-COMP 2019 0.86 (1/7) CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unknown ❌ 2400.07000 2393.54000
CVC4-SymBreak_03_06_2019-wrapped-sq_default unknown ❌ 2400.01000 2394.23000
MathSAT mathsat-20190601-wrapped-sq_default unknown ❌ 2400.02000 2399.79000
mathsat-na-20190601-wrapped-sq_default unknown ❌ 2400.01000 2399.74000
Par4 Par4-wrapped-sq_default unknown ❌ 2400.06000 7195.51000
SMT-RAT SMTRAT-5-wrapped-sq_default unknown ❌ 2400.07000 2399.74000
SMTRAT-MCSAT-4-wrapped-sq_default unknown ❌ 2400.03000 2400.05000
veriT veriT+raSAT+Redlog-wrapped-sq_default unknown ❌ 2400.11000 2400.23000
Yices2 Yices 2.6.2-wrapped-sq_default unknown ❌ 2400.03000 2399.92000
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default sat ✅ 14.77480 14.77410
z3-4.7.1_default unknown ❌ 2400.02000 2399.83000
SMT-COMP 2020 0.71 (2/7) CVC4 CVC4-sq-final_default unknown ❌ 1200.01000 1195.07000
MathSAT MathSAT5_default.sh unknown ❌ 1200.02000 1199.84000
Par4 Par4-wrapped-sq_default sat ✅ 2.31244 6.77000
SMT-RAT smtrat-CDCAC_default unknown ❌ 1200.03000 1199.97000
smtrat-MCSAT_default unknown ❌ 1200.04000 1199.91000
veriT veriT+raSAT+Redlog_default unknown ❌ 1200.02000 1199.85000
Yices2 Yices 2.6.2 bug fix_default sat ✅ 1.79293 3.49271
Z3 z3-4.8.8_default unknown ❌ 1200.03000 1200.04000
SMT-COMP 2022 0.56 (4/9) cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq sat ✅ 13.90480 13.90520
MathSAT MathSAT-5.6.8_default unknown ❌ 1200.03000 1200.01000
NRA-LS NRA-LS-FINAL_default sat ✅ 354.15800 354.10100
Par4 Par4-wrapped-sq_default sat ✅ 76.51730 150.75000
SMT-RAT SMT-RAT-MCSAT_default unknown ❌ 1200.03000 1199.87000
veriT veriT+raSAT+Redlog_default unknown ❌ 1200.12000 1200.04000
Yices2 Yices 2.6.2 for SMTCOMP 2021_default unknown ❌ 1200.11000 1199.93000
Z3 z3-4.8.17_default unknown ❌ 1200.03000 1199.94000
Z3++ z3++0715_default sat ✅ 9.85558 9.85469
SMT-COMP 2023 0.29 (5/7) cvc5 cvc5-default-2023-05-16-ea045f305_sq sat ✅ 6.89832 6.89336
NRA-LS cvc5-NRA-LS-sq_default sat ✅ 12.75420 12.75300
Par4 Par4-wrapped-sq_default sat ✅ 13.10440 38.99000
SMT-RAT SMT-RAT-MCSAT_default sat ✅ 24.27010 24.26840
Yices2 Yices 2 for SMTCOMP 2023_default unknown ❌ 1200.02000 1199.95000
Z3alpha z3alpha_default unknown ❌ 1200.04000 1200.10000
Z3++ z3++0715_default sat ✅ 11.52690 11.52010
Z3++_sq_0526_default sat ✅ 11.63250 11.63210
SMT-COMP 2024 0.20 (4/5) cvc5 cvc5 sat ✅ 510.95874 510.81673
SMTInterpol SMTInterpol unknown ❌ 0.58147 0.94959
SMT-RAT SMT-RAT sat ✅ 7.97727 7.87719
Yices2 Yices2 sat ✅ 0.82553 0.72527
Z3alpha Z3-alpha sat ✅ 4.12217 4.02083