Benchmark

non-incremental/UFLIA/boogie/Assumptions_Assumptions.Swap_System.Boolean.smt2

Boogie/Spec# benchmarks.
  This benchmark was translated by Michal Moskal.
Benchmark
Size42411
Compressed Size7291
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2007-07-03
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 42403
Compressed Size7301
Max. Term Depth106
Asserts 215
Declared Functions82
Declared Constants90
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true57 false1 not94 or22
and104 =>224 =437 distinct2
forall141 let36 Int308 +6
-8 *1 <21 <=43
>1 >=1

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2009 CVC3 CVC3 2.0 unsat ✅ 7.60000
Z3 Z3.2 unsat ✅ 0.20000
SMT-COMP 2012 0.50 (1/2) CVC3 CVC3 v2.4.2 unknown ❌
CVC3 v2.4.2 unknown ❌ 534.10000
CVC4 1.0rc.3931 unknown ❌ 1200.00000
CVC4 1.0rc.3931 unknown ❌ 1200.00000
Z3 Z3 unsat ✅ 0.20000
Z3 unsat ✅ 0.20000
SMT Evaluation 2013 0.25 (3/4) CVC3 CVC3-SMT-COMP-2010 default unsat ✅ 91.06320
CVC3-SMT-COMP-2011 default unsat ✅ 70.48740
CVC3-SMT-COMP-2012 default unsat ✅ 270.70700
CVC4 CVC4-SMT-COMP-2012-Resubmission default unknown ❌
CVC4-SMT-EVAL-2013 default unsat ✅ 31.34820
veriT veriT-SMT-EVAL-2013 default unknown ❌
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 0.21479
Z3-SMT-COMP-2011 default unsat ✅ 0.14871
SMT-COMP 2014 0.50 (2/4) CVC3 CVC3 default unknown ❌ 0.01653 0.00800
CVC4 CVC4 f7118b2 default unsat ✅ 27.02970 27.01090
veriT veriT-smtcomp2014 default unknown ❌ 2399.12000 2400.03000
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default unsat ✅ 0.19036 0.18097
SMT-COMP 2015 0.50 (2/4) CVC3 CVC3 default unknown ❌ 0.00968 0.00800
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 9.32234 9.32158
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 9.33856 9.33758
veriT veriT default unknown ❌ 2400.01000 2400.92000
Z3 z3 4.4.0 default unsat ✅ 0.26397 0.26396
SMT-COMP 2016 0.25 (3/4) CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 2.07035 2.07189
Vampire vampire_smt_4.1 vampire_smtcomp unknown ❌ 1000.10000 1004.98000
vampire_smt_4.1_parallel vampire_smtcomp unknown ❌ 998.07500 3327.92000
veriT veriT-dev default unsat ✅ 264.10800 264.25800
Z3 z3-4.4.1 default unsat ✅ 0.21587 0.21741
SMT-COMP 2017 0.50 (2/4) CVC4 CVC4-smtcomp2017-main default unsat ✅ 2.35153 2.35133
Vampire vampire4.2-smt vampire unknown ❌ 600.07900 2331.78000
veriT veriT-2017-06-17 default unknown ❌ 600.11000 599.96900
Z3 z3-4.5.0 default unsat ✅ 0.23313 0.23229
SMT-COMP 2018 0.25 (3/4) CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 2.00398 2.00404
Vampire vampire-4.3-smt_vampire_smtcomp unknown ❌ 1200.07000 4774.68000
veriT veriT_default unsat ✅ 6.65529 6.65505
Z3 z3-4.7.1_default unsat ✅ 0.21903 0.21883
SMT-COMP 2019 0.38 (5/8) Alt-Ergo Alt-Ergo-SMTComp-2019-wrapped-sq_default unsat ✅ 156.51800 621.08000
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 10.74800 10.74830
master-2018-06-10-b19c840-competition-default_default unsat ✅ 10.70800 10.70670
Par4 Par4-wrapped-sq_default unsat ✅ 0.30853 0.00576
SMTInterpol smtinterpol-2.5-514-wrapped-sq_default unknown ❌ 2400.11000 2404.67000
UltimateEliminator UltimateEliminator+MathSAT-5.5.4-wrapped-sq_default unknown ❌ 2.38210 3.39328
UltimateEliminator+SMTInterpol-wrapped-sq_default unknown ❌ 2.14357 3.35344
UltimateEliminator+Yices-2.6.1-wrapped-sq_default unknown ❌ 2.08957 3.33588
Vampire vampire-4.4-smtcomp-wrapped-sq_default unknown ❌ 2400.11000 9521.24000
veriT veriT-wrapped-sq_default unsat ✅ 3.70178 3.70157
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 0.23972 0.23973
SMT-COMP 2020 0.38 (5/8) Alt-Ergo Alt-Ergo-SMTComp-2020_default unsat ✅ 121.13600 480.87000
CVC4 CVC4-sq-final_default unsat ✅ 1.44733 1.44744
Par4 Par4-wrapped-sq_default unsat ✅ 0.26102 0.00600
SMTInterpol smtinterpol-2.5-679-gacfde87a_default unknown ❌ 1200.09000 1256.58000
UltimateEliminator UltimateEliminator+MathSAT-5.6.3_s_default unknown ❌ 2.38111 3.48188
Vampire vampire_smt_4.5_vampire_smtcomp unknown ❌ 1200.05000 4735.91000
veriT veriT_default unsat ✅ 204.20200 204.18600
veriT+vite_default unsat ✅ 1.38567 1.38588
Z3 z3-4.8.8_default unsat ✅ 28.39350 28.39420
SMT-COMP 2022 0.33 (4/6) CVC4 CVC4-sq-final_default unsat ✅ 1.90755 1.90777
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 2.38675 2.38714
UltimateEliminator UltimateEliminator+MathSAT-5.6.7-wrapped_default unknown ❌ 2.85349 4.90782
Vampire vampire_4.7_smt_fix-wrapped_vampire_smtcomp unknown ❌ 1200.04000 4772.75000
veriT veriT_default unsat ✅ 2.08095 2.08116
Z3 z3-4.8.17_default unsat ✅ 0.23922 0.24105
SMT-COMP 2023 0.80 (1/5) cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 4.70059 4.70119
cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 3.42329 3.42382
iProver iProver-3.8-fix_iprover_SMT unknown ❌ 1200.11000 4664.28000
SMTInterpol smtinterpol-2.5-1272-g2d6d356c_default unknown ❌ 1200.03000 1251.49000
UltimateEliminator UltimateEliminator+MathSAT-5.6.9_default unknown ❌ 2.82148 4.99097
Vampire vampire_4.8_smt_pre_vampire_smtcomp unknown ❌ 1200.10000 4771.63000
SMT-COMP 2024 0.67 (1/3) cvc5 cvc5 unsat ✅ 3.10833 3.00830
iProver iProver v3.9 unknown ❌ 1201.72596 4748.95176
SMTInterpol SMTInterpol unknown ❌ 1201.74331 1275.15122