Benchmark

non-incremental/UFLIA/sledgehammer/TwoSquares/smtlib.681899.smt2

Benchmarks from the paper: "Extending Sledgehammer with SMT Solvers" by Jasmin Blanchette, Sascha Bohme, and Lawrence C. Paulson, CADE 2011.  Translated to SMT2 by Andrew Reynolds and Morgan Deters.
Benchmark
Size9041
Compressed Size1863
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2014-07-21
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 9033
Compressed Size1823
Max. Term Depth10
Asserts 68
Declared Functions12
Declared Constants12
Declared Sorts 9
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

false6 ite12 not6 or3
and12 =>24 =79 forall44
exists1 let37 Int72 +48
-52 *32 <34 <=10

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2014 1.00 (0/4) CVC3 CVC3 default unknown ❌ 0.01659 0.00800
CVC4 CVC4 f7118b2 default unknown ❌ 2399.61000 2400.03000
veriT veriT-smtcomp2014 default unknown ❌ 2399.02000 2400.03000
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default unknown ❌ 2399.31000 2400.05000
SMT-COMP 2015 1.00 (0/4) CVC3 CVC3 default unknown ❌ 0.00870 0.00800
CVC4 CVC4-master-2015-06-15-9b32405-main default unknown ❌ 2400.01000 2400.74000
CVC4-experimental-2015-06-15-ff5745a-main default unknown ❌ 2400.01000 2388.00000
veriT veriT default unknown ❌ 2400.01000 2401.03000
Z3 z3 4.4.0 default unknown ❌ 2400.01000 2400.82000
SMT-COMP 2016 0.75 (1/4) CVC4 CVC4-master-2016-05-27-cfef263-main default unknown ❌ 2400.12000 2337.19000
Vampire vampire_smt_4.1 vampire_smtcomp unsat ✅ 10.44840 10.49450
vampire_smt_4.1_parallel vampire_smtcomp unsat ✅ 3.32934 12.90560
veriT veriT-dev default unknown ❌ 2400.02000 2401.37000
Z3 z3-4.4.1 default unknown ❌ 2400.04000 2401.17000
SMT-COMP 2017 0.75 (1/4) CVC4 CVC4-smtcomp2017-main default unknown ❌ 600.02000 590.86000
Vampire vampire4.2-smt vampire unsat ✅ 118.74300 471.97000
veriT veriT-2017-06-17 default unknown ❌ 600.02200 599.99000
Z3 z3-4.5.0 default unknown ❌ 600.57500 600.40000
SMT-COMP 2018 0.50 (2/4) CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 62.88950 62.47320
Vampire vampire-4.3-smt_vampire_smtcomp unknown ❌ 1200.05000 4767.97000
veriT veriT_default unsat ✅ 471.76000 471.71600
Z3 z3-4.7.1_default unknown ❌ 1200.03000 1200.00000
SMT-COMP 2019 0.50 (4/8) Alt-Ergo Alt-Ergo-SMTComp-2019-wrapped-sq_default unsat ✅ 79.17400 313.33000
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 603.40700 596.93600
master-2018-06-10-b19c840-competition-default_default unknown ❌ 2400.04000 2390.23000
Par4 Par4-wrapped-sq_default unknown ❌ 2400.11000 7188.88000
SMTInterpol smtinterpol-2.5-514-wrapped-sq_default unknown ❌ 2400.08000 2407.22000
UltimateEliminator UltimateEliminator+MathSAT-5.5.4-wrapped-sq_default unknown ❌ 2.32584 3.46431
UltimateEliminator+SMTInterpol-wrapped-sq_default unknown ❌ 2.06801 3.34697
UltimateEliminator+Yices-2.6.1-wrapped-sq_default unknown ❌ 2.12441 3.24370
Vampire vampire-4.4-smtcomp-wrapped-sq_default unsat ✅ 91.69360 363.72000
veriT veriT-wrapped-sq_default unsat ✅ 474.93700 474.92200
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unknown ❌ 2400.07000 2399.79000
SMT-COMP 2020 0.62 (3/8) Alt-Ergo Alt-Ergo-SMTComp-2020_default unsat ✅ 70.01820 277.16000
CVC4 CVC4-sq-final_default unknown ❌ 1200.02000 1189.25000
Par4 Par4-wrapped-sq_default unsat ✅ 506.85500 1510.81000
SMTInterpol smtinterpol-2.5-679-gacfde87a_default unknown ❌ 1200.09000 1419.46000
UltimateEliminator UltimateEliminator+MathSAT-5.6.3_s_default unknown ❌ 2.25579 3.37889
Vampire vampire_smt_4.5_vampire_smtcomp unsat ✅ 83.46700 330.71000
veriT veriT_default unknown ❌ 1200.05000 1200.02000
veriT+vite_default unknown ❌ 1200.08000 1200.02000
Z3 z3-4.8.8_default unknown ❌ 1200.08000 1200.01000
SMT-COMP 2021 0.50 (4/8) CVC4 CVC4-sq-final_default unsat ✅ 319.35500 313.86400
cvc5 cvc5-fixed_default unknown ❌ 1200.04000 633.22300
Par4 Par4-wrapped-sq_default unsat ✅ 331.85400 989.05000
SMTInterpol smtinterpol-2.5-823-g881e8631_default unknown ❌ 1200.05000 3426.95000
UltimateEliminator UltimateEliminator+MathSAT-5.6.6_default unknown ❌ 2.79907 9.45726
Vampire vampire_smt_4.6-fixed_vampire_smtcomp unsat ✅ 232.48400 922.77000
vampire_smt_4.5_vampire_smtcomp unknown ❌ 1200.08000 4751.42000
veriT veriT_default unsat ✅ 524.58500 524.54200
Z3 z3-4.8.11_default unknown ❌ 1200.03000 1199.87000
z3-4.8.8_default unknown ❌ 1200.08000 1199.98000
SMT-COMP 2023 0.60 (2/5) cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 435.83900 424.35100
cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 431.82800 424.42400
iProver iProver-3.8-fix_iprover_SMT unknown ❌ 1200.06000 4746.06000
SMTInterpol smtinterpol-2.5-1272-g2d6d356c_default unknown ❌ 1200.06000 3860.34000
UltimateEliminator UltimateEliminator+MathSAT-5.6.9_default unknown ❌ 2.99327 4.65499
Vampire vampire_4.8_smt_pre_vampire_smtcomp unsat ✅ 29.45990 116.79000
SMT-COMP 2025 0.75 (1/4) cvc5 cvc5 unsat ✅ 401.65796 401.46575
iProver iProver v3.9.3 unknown ❌ 1201.75739 4773.44297
SMTInterpol SMTInterpol unknown ❌ 1120.24963 4065.73486
UltimateEliminator UltimateEliminator+MathSAT unknown ❌ 1.93418 3.88552