Benchmark

non-incremental/AUFLIRA/peter/symmetric_unsat_66.smt2

Example extracted from Peter Baumgartner's talk at CADE-21: Logical Engineering with Instance-Based Methods.

It was translated to SMT-LIB by Leonardo de Moura
Benchmark
Size9703
Compressed Size1461
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categorycrafted
First Occurrence2008-07-07
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 9695
Compressed Size1407
Max. Term Depth7
Asserts 68
Declared Functions1
Declared Constants133
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

not1 and1 =>1 =67
forall2 Int5 Real1 <=4
Array2 select69 store130

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2008 Alt-Ergo Alt-Ergo sat ✅ 2.00000
Alt-Ergo (revised) unknown ❌ 2.00000
CVC3 CVC3 1.2 unsat ✅ 144.90000
CVC3-1.5 unsat ✅ 96.80000
Z3 Z3.2 unsat ✅ 2.70000
SMT Evaluation 2013 0.25 (3/4) CVC3 CVC3-SMT-COMP-2010 default unsat ✅ 120.68800
CVC3-SMT-COMP-2011 default unsat ✅ 559.01700
CVC3-SMT-COMP-2012 default unsat ✅ 413.94700
CVC4 CVC4-SMT-COMP-2012-Resubmission default unknown ❌
CVC4-SMT-EVAL-2013 default unsat ✅ 50.78180
veriT veriT-SMT-EVAL-2013 default unknown ❌
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 0.62020
Z3-SMT-COMP-2011 default unsat ✅ 0.52253
SMT-COMP 2014 0.25 (3/4) CVC3 CVC3 default unsat ✅ 1256.42000 1256.68000
CVC4 CVC4 f7118b2 default unsat ✅ 82.83010 82.79240
veriT veriT-smtcomp2014 default unknown ❌ 2399.51000 2400.08000
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default unsat ✅ 0.63154 0.62590
SMT-COMP 2015 0.25 (3/4) CVC3 CVC3 default unsat ✅ 1567.01000 1567.13000
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 959.51700 959.57100
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 991.12500 991.35600
veriT veriT default unknown ❌ 2400.01000 2401.17000
Z3 z3 4.4.0 default unsat ✅ 0.58506 0.58491
SMT-COMP 2016 0.25 (3/4) CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 637.78800 633.82300
Vampire vampire_smt_4.1 vampire_smtcomp unsat ✅ 26.86420 27.00020
vampire_smt_4.1_parallel vampire_smtcomp unsat ✅ 15.02620 36.03560
veriT veriT-dev default unknown ❌ 2400.01000 2401.66000
Z3 z3-4.4.1 default unsat ✅ 0.56948 0.57105
SMT-COMP 2017 0.50 (2/4) CVC4 CVC4-smtcomp2017-main default unknown ❌ 600.02000 595.88800
Vampire vampire4.2-smt vampire unsat ✅ 23.55130 58.82000
veriT veriT-2017-06-17 default unknown ❌ 600.08500 600.08400
Z3 z3-4.5.0 default unsat ✅ 0.65673 0.65570
SMT-COMP 2018 0.40 (3/5) Alt-Ergo Alt-Ergo-SMTComp-2018_default unknown ❌ 1200.05000 2299.87000
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 810.96600 805.12700
Vampire vampire-4.3-smt_vampire_smtcomp unsat ✅ 43.95620 174.60000
veriT veriT_default unknown ❌ 1200.05000 1200.06000
Z3 z3-4.7.1_default unsat ✅ 0.57190 0.57179
SMT-COMP 2021 0.38 (5/8) CVC4 CVC4-sq-final_default unsat ✅ 66.90170 64.92640
cvc5 cvc5-fixed_default unsat ✅ 107.26600 105.32900
Par4 Par4-wrapped-sq_default unsat ✅ 0.55042 0.00728
SMTInterpol smtinterpol-2.5-823-g881e8631_default unknown ❌ 1200.04000 1717.08000
UltimateEliminator UltimateEliminator+MathSAT-5.6.6_default unknown ❌ 3.78767 5.67280
Vampire vampire_smt_4.6-fixed_vampire_smtcomp unsat ✅ 462.06900 1766.88000
vampire_smt_4.5_vampire_smtcomp unsat ✅ 398.83800 1496.42000
veriT veriT_default unknown ❌ 91.31520 91.25000
Z3 z3-4.8.11_default unsat ✅ 3.90681 3.90663
z3-4.8.8_default unsat ✅ 0.71687 0.71674
SMT-COMP 2022 0.57 (3/7) CVC4 CVC4-sq-final_default unsat ✅ 65.26280 64.54110
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 102.89400 101.61800
SMTInterpol smtinterpol-fixed-2.5-1148-gf2d8e6b0_default unknown ❌ 1200.06000 1253.14000
UltimateEliminator UltimateEliminator+MathSAT-5.6.7-wrapped_default unknown ❌ 3.21049 5.43559
Vampire vampire_4.7_smt_fix-wrapped_vampire_smtcomp unknown ❌ 1200.04000 4766.01000
veriT veriT_default unknown ❌ 90.18270 90.13000
Z3 z3-4.8.17_default unsat ✅ 0.82953 0.83135
SMT-COMP 2023 0.80 (1/5) cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 103.79800 100.84500
cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 102.16500 100.00800
iProver iProver-3.8-fix_iprover_SMT unknown ❌ 1200.08000 4722.72000
SMTInterpol smtinterpol-2.5-1272-g2d6d356c_default unknown ❌ 1200.03000 1256.05000
UltimateEliminator UltimateEliminator+MathSAT-5.6.9_default unknown ❌ 3.50999 6.07904
Vampire vampire_4.8_smt_pre_vampire_smtcomp unknown ❌ 1200.04000 4769.42000
SMT-COMP 2024 0.67 (1/3) cvc5 cvc5 unsat ✅ 98.15966 98.05451
iProver iProver v3.9 unknown ❌ 1201.73671 4749.69426
SMTInterpol SMTInterpol unknown ❌ 1202.21559 2066.16559
SMT-COMP 2025 0.75 (1/4) cvc5 cvc5 unsat ✅ 96.33220 96.20059
iProver iProver v3.9.3 unknown ❌ 1201.79359 4762.67292
SMTInterpol SMTInterpol unknown ❌ 1201.54916 1722.73139
UltimateEliminator UltimateEliminator+MathSAT unknown ❌ 2.65267 5.49588