Benchmark

non-incremental/UFLIA/sledgehammer/TwoSquares/smtlib.887130.smt2

Benchmarks from the paper: "Extending Sledgehammer with SMT Solvers" by Jasmin Blanchette, Sascha Bohme, and Lawrence C. Paulson, CADE 2011.  Translated to SMT2 by Andrew Reynolds and Morgan Deters.
Benchmark
Size38743
Compressed Size5986
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2014-07-21
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 38735
Compressed Size6035
Max. Term Depth11
Asserts 279
Declared Functions15
Declared Constants25
Declared Sorts 11
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

false20 ite31 not41 or17
and32 =>219 =483 forall243
exists6 let125 Int349 +114
-100 *45 <127 <=55

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2014 0.50 (2/4) CVC3 CVC3 default unknown ❌ 0.01629 0.00800
CVC4 CVC4 f7118b2 default unsat ✅ 12.07840 12.06020
veriT veriT-smtcomp2014 default unsat ✅ 209.00200 209.04900
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default unknown ❌ 2399.31000 2400.02000
SMT-COMP 2015 0.50 (2/4) CVC3 CVC3 default unknown ❌ 0.00884 0.00800
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 12.37890 12.37910
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 12.38460 12.38510
veriT veriT default unsat ✅ 251.18100 251.24100
Z3 z3 4.4.0 default unknown ❌ 2400.01000 2400.98000
SMT-COMP 2016 0.25 (3/4) CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 256.17500 225.17200
Vampire vampire_smt_4.1 vampire_smtcomp unsat ✅ 8.47371 16.90420
vampire_smt_4.1_parallel vampire_smtcomp unsat ✅ 1.08656 3.92980
veriT veriT-dev default unsat ✅ 0.15232 0.15305
Z3 z3-4.4.1 default unknown ❌ 2400.02000 2401.41000
SMT-COMP 2017 0.25 (3/4) CVC4 CVC4-smtcomp2017-main default unsat ✅ 65.19960 64.56490
Vampire vampire4.2-smt vampire unsat ✅ 11.57680 45.76000
veriT veriT-2017-06-17 default unsat ✅ 9.95779 9.95688
Z3 z3-4.5.0 default unknown ❌ 197.09200 197.01300
SMT-COMP 2018 0.25 (3/4) CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 66.51310 65.92980
Vampire vampire-4.3-smt_vampire_smtcomp unsat ✅ 321.62100 1279.17000
veriT veriT_default unsat ✅ 5.88418 5.88398
Z3 z3-4.7.1_default unknown ❌ 184.97400 184.93900
SMT-COMP 2019 0.38 (5/8) Alt-Ergo Alt-Ergo-SMTComp-2019-wrapped-sq_default unsat ✅ 50.39320 199.99000
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 7.41170 7.40978
master-2018-06-10-b19c840-competition-default_default unsat ✅ 5.66039 5.66057
Par4 Par4-wrapped-sq_default unsat ✅ 6.35829 18.92000
SMTInterpol smtinterpol-2.5-514-wrapped-sq_default unknown ❌ 2400.05000 2680.70000
UltimateEliminator UltimateEliminator+MathSAT-5.5.4-wrapped-sq_default unknown ❌ 2.32032 3.43172
UltimateEliminator+SMTInterpol-wrapped-sq_default unknown ❌ 2.07355 3.39641
UltimateEliminator+Yices-2.6.1-wrapped-sq_default unknown ❌ 2.48683 3.24404
Vampire vampire-4.4-smtcomp-wrapped-sq_default unsat ✅ 32.45590 128.47000
veriT veriT-wrapped-sq_default unsat ✅ 9.62093 9.62082
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unknown ❌ 148.87200 148.86100
SMT-COMP 2020 0.25 (6/8) Alt-Ergo Alt-Ergo-SMTComp-2020_default unsat ✅ 23.80720 94.38000
CVC4 CVC4-sq-final_default unsat ✅ 280.90500 271.76800
Par4 Par4-wrapped-sq_default unsat ✅ 34.07940 100.45000
SMTInterpol smtinterpol-2.5-679-gacfde87a_default unsat ✅ 1.49430 4.12487
UltimateEliminator UltimateEliminator+MathSAT-5.6.3_s_default unknown ❌ 2.31964 3.55667
Vampire vampire_smt_4.5_vampire_smtcomp unsat ✅ 25.34170 100.43000
veriT veriT_default unsat ✅ 8.00946 8.01050
veriT+vite_default unsat ✅ 42.91410 42.91460
Z3 z3-4.8.8_default unknown ❌ 198.66800 198.65900
SMT-COMP 2021 0.38 (5/8) CVC4 CVC4-sq-final_default unsat ✅ 94.58700 93.28710
cvc5 cvc5-fixed_default unknown ❌ 1200.08000 30.01210
Par4 Par4-wrapped-sq_default unsat ✅ 65.78780 196.52000
SMTInterpol smtinterpol-2.5-823-g881e8631_default unsat ✅ 1.60857 4.50468
UltimateEliminator UltimateEliminator+MathSAT-5.6.6_default unknown ❌ 2.94070 4.94983
Vampire vampire_smt_4.6-fixed_vampire_smtcomp unsat ✅ 2.05994 7.74000
vampire_smt_4.5_vampire_smtcomp unsat ✅ 25.31310 100.22000
veriT veriT_default unsat ✅ 154.10900 154.10500
Z3 z3-4.8.11_default unknown ❌ 177.45000 177.42900
z3-4.8.8_default unknown ❌ 182.60600 182.56300
SMT-COMP 2022 0.33 (4/6) CVC4 CVC4-sq-final_default unsat ✅ 10.64430 10.64300
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 97.19550 96.79450
UltimateEliminator UltimateEliminator+MathSAT-5.6.7-wrapped_default unknown ❌ 2.80460 5.42061
Vampire vampire_4.7_smt_fix-wrapped_vampire_smtcomp unsat ✅ 3.97574 15.43000
veriT veriT_default unsat ✅ 8.29882 8.29762
Z3 z3-4.8.17_default unknown ❌ 194.21000 194.19400
SMT-COMP 2023 0.40 (3/5) cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 316.45600 302.12400
cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 308.24400 301.99800
iProver iProver-3.8-fix_iprover_SMT unknown ❌ 1200.06000 4745.23000
SMTInterpol smtinterpol-2.5-1272-g2d6d356c_default unsat ✅ 50.31110 101.20600
UltimateEliminator UltimateEliminator+MathSAT-5.6.9_default unknown ❌ 2.89399 4.74387
Vampire vampire_4.8_smt_pre_vampire_smtcomp unsat ✅ 2.87056 11.02000
SMT-COMP 2025 0.25 (3/4) cvc5 cvc5 unsat ✅ 1.98431 1.86402
iProver iProver v3.9.3 unsat ✅ 91.57102 354.23542
SMTInterpol SMTInterpol unsat ✅ 5.20948 12.80282
UltimateEliminator UltimateEliminator+MathSAT unknown ❌ 1.93410 4.04680