Benchmark

non-incremental/UFLIA/sledgehammer/Arrow_Order/smtlib.650920.smt2 

Benchmarks from the paper: "Extending Sledgehammer with SMT Solvers" by Jasmin Blanchette, Sascha Bohme, and Lawrence C. Paulson, CADE 2011.  Translated to SMT2 by Andrew Reynolds and Morgan Deters.
Benchmark
Size67505
Compressed Size10392
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2014-07-21
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 67497
Compressed Size10385
Max. Term Depth15
Asserts 330
Declared Functions278
Declared Constants36
Declared Sorts 179
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

false119 ite6 not45 or19
and48 =>468 =908 forall463
exists32 let32 Int2 +4
<14 <=10

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2014 0.75 (1/4) CVC3 CVC3 default unknown ❌ 0.01965 0.01100
CVC4 CVC4 f7118b2 default unsat ✅ 136.97600 136.92300
veriT veriT-smtcomp2014 default unknown ❌ 2399.31000 2400.08000
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default unknown ❌ 2399.71000 2400.07000
SMT-COMP 2015 0.75 (1/4) CVC3 CVC3 default unknown ❌ 0.01443 0.01400
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 43.84350 43.85230
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 43.85030 43.86030
veriT veriT default unknown ❌ 2400.01000 2400.96000
Z3 z3 4.4.0 default unknown ❌ 2400.01000 2400.77000
SMT-COMP 2016 0.50 (2/4) CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 23.95220 23.36860
Vampire vampire_smt_4.1 vampire_smtcomp unsat ✅ 0.97490 0.97943
vampire_smt_4.1_parallel vampire_smtcomp unsat ✅ 0.07874 0.07798
veriT veriT-dev default unknown ❌ 2400.03000 2401.29000
Z3 z3-4.4.1 default unknown ❌ 2400.03000 2401.38000
SMT-COMP 2017 0.50 (2/4) CVC4 CVC4-smtcomp2017-main default unsat ✅ 34.26140 34.25790
Vampire vampire4.2-smt vampire unsat ✅ 0.09468 0.09392
veriT veriT-2017-06-17 default unknown ❌ 600.02500 599.89000
Z3 z3-4.5.0 default unknown ❌ 600.12400 600.06000
SMT-COMP 2018 0.50 (2/4) CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 457.96300 451.50000
Vampire vampire-4.3-smt_vampire_smtcomp unsat ✅ 0.25614 0.34257
veriT veriT_default unknown ❌ 1200.02000 1199.74000
Z3 z3-4.7.1_default unknown ❌ 1200.04000 1199.75000
SMT-COMP 2019 0.62 (3/8) Alt-Ergo Alt-Ergo-SMTComp-2019-wrapped-sq_default unknown ❌ 2400.05000 9515.33000
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 647.54000 646.33200
master-2018-06-10-b19c840-competition-default_default unsat ✅ 455.49800 451.58400
Par4 Par4-wrapped-sq_default unsat ✅ 499.23500 1478.80000
SMTInterpol smtinterpol-2.5-514-wrapped-sq_default unknown ❌ 2400.06000 2449.01000
UltimateEliminator UltimateEliminator+MathSAT-5.5.4-wrapped-sq_default unknown ❌ 2.42425 3.87675
UltimateEliminator+SMTInterpol-wrapped-sq_default unknown ❌ 2.17821 3.61450
UltimateEliminator+Yices-2.6.1-wrapped-sq_default unknown ❌ 2.66554 3.92807
Vampire vampire-4.4-smtcomp-wrapped-sq_default unsat ✅ 0.28843 0.27917
veriT veriT-wrapped-sq_default unknown ❌ 2400.02000 2405.58000
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unknown ❌ 120.44000 120.42900
SMT-COMP 2020 0.50 (4/8) Alt-Ergo Alt-Ergo-SMTComp-2020_default unknown ❌ 1200.09000 4764.48000
CVC4 CVC4-sq-final_default unsat ✅ 32.47640 32.47250
Par4 Par4-wrapped-sq_default unsat ✅ 33.23440 99.48000
SMTInterpol smtinterpol-2.5-679-gacfde87a_default unknown ❌ 1200.03000 1260.52000
UltimateEliminator UltimateEliminator+MathSAT-5.6.3_s_default unknown ❌ 2.48112 3.87306
Vampire vampire_smt_4.5_vampire_smtcomp unsat ✅ 0.09954 0.09935
veriT veriT_default unsat ✅ 183.22800 183.21800
veriT+vite_default unsat ✅ 14.12170 14.12030
Z3 z3-4.8.8_default unknown ❌ 1200.01000 1199.63000
SMT-COMP 2021 0.38 (5/8) CVC4 CVC4-sq-final_default unsat ✅ 32.49790 32.49750
cvc5 cvc5-fixed_default unsat ✅ 33.54960 33.37360
Par4 Par4-wrapped-sq_default unsat ✅ 33.91690 100.74000
SMTInterpol smtinterpol-2.5-823-g881e8631_default unsat ✅ 31.02110 48.02400
UltimateEliminator UltimateEliminator+MathSAT-5.6.6_default unknown ❌ 2.90326 5.25174
Vampire vampire_smt_4.6-fixed_vampire_smtcomp unsat ✅ 0.15802 0.15617
vampire_smt_4.5_vampire_smtcomp unsat ✅ 0.15218 0.15382
veriT veriT_default unknown ❌ 1200.09000 1200.02000
Z3 z3-4.8.11_default unknown ❌ 1200.02000 1199.74000
z3-4.8.8_default unknown ❌ 1200.02000 1199.73000
SMT-COMP 2023 0.20 (4/5) cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 33.61650 31.06570
cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 32.57370 32.53540
iProver iProver-3.8-fix_iprover_SMT unsat ✅ 1.15224 3.53000
SMTInterpol smtinterpol-2.5-1272-g2d6d356c_default unsat ✅ 60.25600 79.02250
UltimateEliminator UltimateEliminator+MathSAT-5.6.9_default unknown ❌ 3.09612 4.98505
Vampire vampire_4.8_smt_pre_vampire_smtcomp unsat ✅ 0.13321 0.13275