Benchmark

non-incremental/UFLIA/sledgehammer/Arrow_Order/smtlib.638137.smt2 

Benchmarks from the paper: "Extending Sledgehammer with SMT Solvers" by Jasmin Blanchette, Sascha Bohme, and Lawrence C. Paulson, CADE 2011.  Translated to SMT2 by Andrew Reynolds and Morgan Deters.
Benchmark
Size94814
Compressed Size13491
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2014-07-21
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 94806
Compressed Size13482
Max. Term Depth15
Asserts 468
Declared Functions214
Declared Constants36
Declared Sorts 89
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true8 false164 ite6 not124
or27 and68 =>893 =1523
forall731 exists50 let113 Int2
+10 <21 <=20

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2014 0.50 (2/4) CVC3 CVC3 default unknown ❌ 0.01904 0.01100
CVC4 CVC4 f7118b2 default unsat ✅ 0.35094 0.33895
veriT veriT-smtcomp2014 default unsat ✅ 0.12696 0.11798
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default unknown ❌ 2400.01000 2400.07000
SMT-COMP 2015 0.50 (2/4) CVC3 CVC3 default unknown ❌ 0.01067 0.01000
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 0.29583 0.29395
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 0.30052 0.29795
veriT veriT default unsat ✅ 0.14258 0.14198
Z3 z3 4.4.0 default unknown ❌ 2400.01000 2400.84000
SMT-COMP 2016 0.25 (3/4) CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 0.36127 0.36164
Vampire vampire_smt_4.1 vampire_smtcomp unsat ✅ 128.13700 128.76800
vampire_smt_4.1_parallel vampire_smtcomp unsat ✅ 14.41960 56.90000
veriT veriT-dev default unsat ✅ 0.10849 0.10888
Z3 z3-4.4.1 default unknown ❌ 1415.73000 1416.06000
SMT-COMP 2017 0.25 (3/4) CVC4 CVC4-smtcomp2017-main default unsat ✅ 0.35398 0.35416
Vampire vampire4.2-smt vampire unsat ✅ 3.76372 14.06000
veriT veriT-2017-06-17 default unsat ✅ 0.36659 0.36550
Z3 z3-4.5.0 default unknown ❌ 600.01800 599.78000
SMT-COMP 2018 0.25 (3/4) CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 0.38607 0.38629
Vampire vampire-4.3-smt_vampire_smtcomp unsat ✅ 43.00550 170.92000
veriT veriT_default unsat ✅ 0.34520 0.34536
Z3 z3-4.7.1_default unknown ❌ 1158.64000 1158.00000
SMT-COMP 2019 0.38 (5/8) Alt-Ergo Alt-Ergo-SMTComp-2019-wrapped-sq_default unsat ✅ 0.65471 2.38000
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 0.38128 0.38163
master-2018-06-10-b19c840-competition-default_default unsat ✅ 0.39162 0.39172
Par4 Par4-wrapped-sq_default unsat ✅ 0.38423 0.00609
SMTInterpol smtinterpol-2.5-514-wrapped-sq_default unknown ❌ 2400.06000 2408.27000
UltimateEliminator UltimateEliminator+MathSAT-5.5.4-wrapped-sq_default unknown ❌ 2.39852 3.73490
UltimateEliminator+SMTInterpol-wrapped-sq_default unknown ❌ 2.30932 3.47469
UltimateEliminator+Yices-2.6.1-wrapped-sq_default unknown ❌ 2.50843 3.81983
Vampire vampire-4.4-smtcomp-wrapped-sq_default unsat ✅ 32.49090 128.54000
veriT veriT-wrapped-sq_default unsat ✅ 0.35595 0.35632
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unknown ❌ 1224.06000 1219.74000
SMT-COMP 2020 0.38 (5/8) Alt-Ergo Alt-Ergo-SMTComp-2020_default unsat ✅ 0.70420 2.48000
CVC4 CVC4-sq-final_default unsat ✅ 0.42868 0.42897
Par4 Par4-wrapped-sq_default unsat ✅ 0.38383 0.00890
SMTInterpol smtinterpol-2.5-679-gacfde87a_default unknown ❌ 1200.07000 1211.12000
UltimateEliminator UltimateEliminator+MathSAT-5.6.3_s_default unknown ❌ 2.45366 3.85781
Vampire vampire_smt_4.5_vampire_smtcomp unsat ✅ 14.85380 58.38000
veriT veriT_default unsat ✅ 0.42284 0.42316
veriT+vite_default unsat ✅ 0.13008 0.13038
Z3 z3-4.8.8_default unknown ❌ 832.28700 832.12100
SMT-COMP 2021 0.38 (5/8) CVC4 CVC4-sq-final_default unsat ✅ 0.43199 0.43231
cvc5 cvc5-fixed_default unsat ✅ 0.37540 0.37598
Par4 Par4-wrapped-sq_default unsat ✅ 0.40883 0.00650
SMTInterpol smtinterpol-2.5-823-g881e8631_default unknown ❌ 1200.04000 1254.70000
UltimateEliminator UltimateEliminator+MathSAT-5.6.6_default unknown ❌ 3.00436 5.38412
Vampire vampire_smt_4.6-fixed_vampire_smtcomp unsat ✅ 23.10270 90.98000
vampire_smt_4.5_vampire_smtcomp unsat ✅ 14.33980 56.69000
veriT veriT_default unsat ✅ 0.17476 0.17512
Z3 z3-4.8.11_default unknown ❌ 609.07100 608.90200
z3-4.8.8_default unknown ❌ 742.19300 742.05700
SMT-COMP 2022 0.33 (4/6) CVC4 CVC4-sq-final_default unsat ✅ 0.43079 0.43111
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 0.40489 0.40544
UltimateEliminator UltimateEliminator+MathSAT-5.6.7-wrapped_default unknown ❌ 2.96854 5.06668
Vampire vampire_4.7_smt_fix-wrapped_vampire_smtcomp unsat ✅ 22.50840 89.14000
veriT veriT_default unsat ✅ 0.15401 0.15438
Z3 z3-4.8.17_default unknown ❌ 1200.03000 1199.93000
SMT-COMP 2025 0.75 (1/4) cvc5 cvc5 unsat ✅ 0.50746 0.37476
iProver iProver v3.9.3 unknown ❌ 1201.74984 4762.49619
SMTInterpol SMTInterpol unknown ❌ 1201.44994 1266.06000
UltimateEliminator UltimateEliminator+MathSAT unknown ❌ 1.99114 4.34880