Benchmark

non-incremental/UFLIA/sledgehammer/Arrow_Order/smtlib.785013.smt2 

Benchmarks from the paper: "Extending Sledgehammer with SMT Solvers" by Jasmin Blanchette, Sascha Bohme, and Lawrence C. Paulson, CADE 2011.  Translated to SMT2 by Andrew Reynolds and Morgan Deters.
Benchmark
Size108113
Compressed Size16424
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2014-07-21
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 108105
Compressed Size16439
Max. Term Depth15
Asserts 492
Declared Functions359
Declared Constants233
Declared Sorts 381
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true13 false122 ite6 not77
or6 and52 =>672 =1349
forall637 exists62 let64 Int98
+12 -1 <10 <=16

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2014 0.50 (2/4) CVC3 CVC3 default unknown ❌ 0.02021 0.01200
CVC4 CVC4 f7118b2 default unsat ✅ 20.91360 20.89380
veriT veriT-smtcomp2014 default unknown ❌ 2399.31000 2400.07000
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default unsat ✅ 0.11475 0.10598
SMT-COMP 2015 0.50 (2/4) CVC3 CVC3 default unknown ❌ 0.01127 0.01100
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 42.23590 42.24660
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 42.19160 42.17960
veriT veriT default unknown ❌ 2400.01000 2400.93000
Z3 z3 4.4.0 default unsat ✅ 0.12779 0.12798
SMT-COMP 2016 0.25 (3/4) CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 23.11470 21.69400
Vampire vampire_smt_4.1 vampire_smtcomp unsat ✅ 2.93430 2.94773
vampire_smt_4.1_parallel vampire_smtcomp unsat ✅ 0.11205 0.11256
veriT veriT-dev default unknown ❌ 2400.03000 2401.19000
Z3 z3-4.4.1 default unsat ✅ 0.13588 0.13762
SMT-COMP 2017 0.25 (3/4) CVC4 CVC4-smtcomp2017-main default unsat ✅ 20.42590 20.42530
Vampire vampire4.2-smt vampire unsat ✅ 0.17154 0.16705
veriT veriT-2017-06-17 default unknown ❌ 600.02600 599.94000
Z3 z3-4.5.0 default unsat ✅ 0.13609 0.13606
SMT-COMP 2018 0.25 (3/4) CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 32.22250 32.21900
Vampire vampire-4.3-smt_vampire_smtcomp unsat ✅ 0.34030 0.38990
veriT veriT_default unknown ❌ 1200.02000 1199.83000
Z3 z3-4.7.1_default unsat ✅ 0.13534 0.13527
SMT-COMP 2019 0.38 (5/8) Alt-Ergo Alt-Ergo-SMTComp-2019-wrapped-sq_default unsat ✅ 0.22584 0.22228
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 60.48240 60.48240
master-2018-06-10-b19c840-competition-default_default unsat ✅ 30.48270 30.48110
Par4 Par4-wrapped-sq_default unsat ✅ 0.16187 0.00567
SMTInterpol smtinterpol-2.5-514-wrapped-sq_default unknown ❌ 2400.08000 2404.91000
UltimateEliminator UltimateEliminator+MathSAT-5.5.4-wrapped-sq_default unknown ❌ 2.70943 4.09416
UltimateEliminator+SMTInterpol-wrapped-sq_default unknown ❌ 2.32407 3.64990
UltimateEliminator+Yices-2.6.1-wrapped-sq_default unknown ❌ 2.59176 4.08050
Vampire vampire-4.4-smtcomp-wrapped-sq_default unsat ✅ 1.06905 3.54000
veriT veriT-wrapped-sq_default unknown ❌ 2400.04000 2399.96000
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 0.15497 0.15496
SMT-COMP 2020 0.25 (6/8) Alt-Ergo Alt-Ergo-SMTComp-2020_default unsat ✅ 0.24880 0.24537
CVC4 CVC4-sq-final_default unsat ✅ 32.02340 32.01840
Par4 Par4-wrapped-sq_default unsat ✅ 0.16278 0.00754
SMTInterpol smtinterpol-2.5-679-gacfde87a_default unknown ❌ 1200.03000 1227.71000
UltimateEliminator UltimateEliminator+MathSAT-5.6.3_s_default unknown ❌ 2.65315 4.21959
Vampire vampire_smt_4.5_vampire_smtcomp unsat ✅ 0.32121 0.17469
veriT veriT_default unsat ✅ 288.09700 288.05100
veriT+vite_default unknown ❌ 1200.10000 1199.88000
Z3 z3-4.8.8_default unsat ✅ 0.18223 0.18218
SMT-COMP 2021 0.12 (7/8) CVC4 CVC4-sq-final_default unsat ✅ 30.51060 30.50970
cvc5 cvc5-fixed_default unsat ✅ 30.46490 30.46310
Par4 Par4-wrapped-sq_default unsat ✅ 0.14727 0.00875
SMTInterpol smtinterpol-2.5-823-g881e8631_default unsat ✅ 25.70500 35.02700
UltimateEliminator UltimateEliminator+MathSAT-5.6.6_default unknown ❌ 3.28290 6.20970
Vampire vampire_smt_4.6-fixed_vampire_smtcomp unsat ✅ 0.33768 0.33724
vampire_smt_4.5_vampire_smtcomp unsat ✅ 0.26377 0.20767
veriT veriT_default unsat ✅ 12.62450 12.62510
Z3 z3-4.8.11_default unsat ✅ 0.15215 0.15207
z3-4.8.8_default unsat ✅ 0.16036 0.16031
SMT-COMP 2022 0.17 (5/6) CVC4 CVC4-sq-final_default unsat ✅ 31.83840 31.83290
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 31.86100 31.68100
UltimateEliminator UltimateEliminator+MathSAT-5.6.7-wrapped_default unknown ❌ 2.91594 5.17336
Vampire vampire_4.7_smt_fix-wrapped_vampire_smtcomp unsat ✅ 0.21892 0.21799
veriT veriT_default unsat ✅ 12.62160 12.61340
Z3 z3-4.8.17_default unsat ✅ 0.15206 0.15388
SMT-COMP 2025 0.25 (3/4) cvc5 cvc5 unsat ✅ 31.32680 31.20566
iProver iProver v3.9.3 unsat ✅ 3.38993 10.89577
SMTInterpol SMTInterpol unsat ✅ 66.95301 85.66752
UltimateEliminator UltimateEliminator+MathSAT unknown ❌ 6.74175 4.44998