Benchmark

non-incremental/UF/sledgehammer/Arrow_Order/uf.777334.smt2 

Benchmarks from the paper: "Extending Sledgehammer with SMT Solvers" by Jasmin Blanchette, Sascha Bohme, and Lawrence C. Paulson, CADE 2011.  Translated to SMT2 by Andrew Reynolds and Morgan Deters.
Benchmark
Size150084
Compressed Size24494
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2014-07-21
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 150076
Compressed Size23922
Max. Term Depth15
Asserts 540
Declared Functions750
Declared Constants456
Declared Sorts 845
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true9 false156 ite6 not68
or15 and107 =>636 =1527
forall697 exists38 let58

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2014 0.25 (3/4) CVC3 CVC3 default unsat ✅ 0.26929 0.26096
CVC4 CVC4 f7118b2 default unsat ✅ 21.13470 21.12980
veriT veriT-smtcomp2014 default unknown ❌ 186.54700 186.58700
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default unsat ✅ 0.12370 0.11598
SMT-COMP 2015 0.25 (3/4) CVC3 CVC3 default unsat ✅ 0.28883 0.28796
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 41.18870 41.17170
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 41.15070 41.16170
veriT veriT default unknown ❌ 2400.01000 2400.80000
Z3 z3 4.4.0 default unsat ✅ 0.12739 0.12698
SMT-COMP 2016 0.50 (3/6) CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 20.60980 41.10950
Vampire vampire_smt_4.1 vampire_smtcomp unsat ✅ 0.23202 0.23215
vampire_smt_4.1_parallel vampire_smtcomp unsat ✅ 0.22787 0.22786
veriT veriT-dev default unknown ❌ 2400.03000 2401.41000
Z3 z3-4.4.1 default unsat ✅ 0.13474 0.13608
SMT-COMP 2017 0.50 (3/6) CVC4 CVC4-smtcomp2017-main default unsat ✅ 20.46390 20.45570
Vampire vampire4.2-smt vampire unsat ✅ 0.45509 0.42979
veriT veriT-2017-06-17 default unknown ❌ 600.02100 599.84000
Z3 z3-4.5.0 default unsat ✅ 0.14576 0.14119
SMT-COMP 2018 0.50 (3/6) CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 32.00660 32.00570
Vampire vampire-4.3-smt_vampire_smtcomp unsat ✅ 0.34850 0.22331
veriT veriT_default unknown ❌ 1200.02000 1199.80000
Z3 z3-4.7.1_default unsat ✅ 0.14513 0.14509
SMT-COMP 2019 0.38 (5/8) Alt-Ergo Alt-Ergo-SMTComp-2019-wrapped-sq_default unsat ✅ 0.29110 0.29236
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 68.90570 68.90650
master-2018-06-10-b19c840-competition-default_default unsat ✅ 39.14180 39.12600
Par4 Par4-wrapped-sq_default unsat ✅ 0.14674 0.00573
SMTInterpol smtinterpol-2.5-514-wrapped-sq_default unknown ❌ 2400.06000 2621.17000
UltimateEliminator UltimateEliminator+MathSAT-5.5.4-wrapped-sq_default unknown ❌ 2.62454 4.88395
UltimateEliminator+SMTInterpol-wrapped-sq_default unknown ❌ 2.12001 3.67382
UltimateEliminator+Yices-2.6.1-wrapped-sq_default unknown ❌ 2.70573 4.83412
Vampire vampire-4.4-smtcomp-wrapped-sq_default unsat ✅ 4.35627 16.67000
vampire-4.3-smt_vampire_smtcomp unsat ✅ 0.25730 0.24479
veriT veriT-wrapped-sq_default unknown ❌ 2400.02000 2399.96000
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 0.14600 0.14600
SMT-COMP 2020 0.43 (4/7) Alt-Ergo Alt-Ergo-SMTComp-2020_default unsat ✅ 0.29380 0.29428
CVC4 CVC4-sq-final_default unsat ✅ 39.34770 39.34680
CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 67.99510 67.96590
SMTInterpol smtinterpol-2.5-679-gacfde87a_default unknown ❌ 1200.06000 4292.96000
UltimateEliminator UltimateEliminator+MathSAT-5.6.3_s_default unknown ❌ 2.78554 4.80533
Vampire vampire_smt_4.5_vampire_smtcomp unsat ✅ 0.23177 0.16568
vampire-4.3-smt_vampire_smtcomp unsat ✅ 0.21427 0.21645
veriT veriT_default unknown ❌ 1200.02000 1199.84000
veriT+vite_default unknown ❌ 945.30900 945.15000
Z3 z3-4.8.8_default unsat ✅ 0.16108 0.16104
SMT-COMP 2021 0.14 (6/7) CVC4 CVC4-sq-final_default unsat ✅ 35.17500 35.17110
iProver iProver-v3.5-final-fix2_iProver_SMT unsat ✅ 2.33177 8.07000
SMTInterpol smtinterpol-2.5-823-g881e8631_default unsat ✅ 121.27500 134.86200
UltimateEliminator UltimateEliminator+MathSAT-5.6.6_default unknown ❌ 3.13869 5.95725
Vampire vampire_smt_4.6-fixed_vampire_smtcomp unsat ✅ 0.41992 0.23551
vampire_smt_4.5_vampire_smtcomp unsat ✅ 0.31805 0.17230
veriT veriT_default unsat ✅ 2.11931 2.11996
Z3 z3-4.8.11_default unsat ✅ 0.15132 0.15127
SMT-COMP 2023 0.33 (4/6) cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 32.49840 30.97550
cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 33.04560 66.00440
iProver iProver-3.8-fix_iprover_SMT unsat ✅ 2.65686 9.28000
SMTInterpol smtinterpol-2.5-1272-g2d6d356c_default unknown ❌ 1200.06000 1241.49000
UltimateEliminator UltimateEliminator+MathSAT-5.6.9_default unknown ❌ 3.00557 5.74364
Vampire vampire_4.8_smt_pre_vampire_smtcomp unsat ✅ 0.73125 2.60000
Yices2 Yices 2 for SMTCOMP 2023_default unsat ✅ 0.14964 0.14955