Benchmark

non-incremental/AUFLIRA/peter/symmetric_unsat_74.smt2

Example extracted from Peter Baumgartner's talk at CADE-21: Logical Engineering with Instance-Based Methods.

It was translated to SMT-LIB by Leonardo de Moura
Benchmark
Size10815
Compressed Size1562
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categorycrafted
First Occurrence2008-07-07
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 10807
Compressed Size1509
Max. Term Depth7
Asserts 76
Declared Functions1
Declared Constants149
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

not1 and1 =>1 =75
forall2 Int5 Real1 <=4
Array2 select77 store146

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2011 0.50 (1/2) CVC3 CVC3 v2.4 unknown ❌ 1200.10000
Z3 Z3 unsat ✅ 1.00000
SMT Evaluation 2013 0.25 (3/4) CVC3 CVC3-SMT-COMP-2010 default unsat ✅ 172.61300
CVC3-SMT-COMP-2011 default unsat ✅ 865.57000
CVC3-SMT-COMP-2012 default unsat ✅ 637.20900
CVC4 CVC4-SMT-COMP-2012-Resubmission default unknown ❌
CVC4-SMT-EVAL-2013 default unsat ✅ 542.85700
veriT veriT-SMT-EVAL-2013 default unknown ❌
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 0.84348
Z3-SMT-COMP-2011 default unsat ✅ 0.70707
SMT-COMP 2014 0.50 (2/4) CVC3 CVC3 default unknown ❌ 2401.40000 2402.12000
CVC4 CVC4 f7118b2 default unsat ✅ 88.44580 88.37860
veriT veriT-smtcomp2014 default unknown ❌ 2399.01000 2400.02000
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default unsat ✅ 0.86703 0.85887
SMT-COMP 2015 0.25 (3/4) CVC3 CVC3 default unsat ✅ 2239.48000 2240.24000
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 1115.04000 1115.19000
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 1137.36000 1137.48000
veriT veriT default unknown ❌ 2400.01000 2401.03000
Z3 z3 4.4.0 default unsat ✅ 0.79290 0.79288
SMT-COMP 2016 0.25 (3/4) CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 635.31500 632.99000
Vampire vampire_smt_4.1 vampire_smtcomp unsat ✅ 34.78140 34.96350
vampire_smt_4.1_parallel vampire_smtcomp unsat ✅ 23.81530 44.95470
veriT veriT-dev default unknown ❌ 2400.01000 2401.61000
Z3 z3-4.4.1 default unsat ✅ 0.79502 0.79673
SMT-COMP 2017 0.50 (2/4) CVC4 CVC4-smtcomp2017-main default unknown ❌ 600.08100 479.07900
Vampire vampire4.2-smt vampire unsat ✅ 23.77870 59.32000
veriT veriT-2017-06-17 default unknown ❌ 600.04500 600.06200
Z3 z3-4.5.0 default unsat ✅ 0.88470 0.88433
SMT-COMP 2018 0.40 (3/5) Alt-Ergo Alt-Ergo-SMTComp-2018_default unknown ❌ 1200.11000 2029.08000
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 990.71400 987.86600
Vampire vampire-4.3-smt_vampire_smtcomp unsat ✅ 61.01420 242.48000
veriT veriT_default unknown ❌ 1200.09000 1200.01000
Z3 z3-4.7.1_default unsat ✅ 0.79081 0.79070
SMT-COMP 2019 0.50 (4/8) Alt-Ergo Alt-Ergo-SMTComp-2019-wrapped-sq_default unknown ❌ 2400.03000 7711.75000
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 127.76700 126.34200
CVC4-SymBreak_03_06_2019-wrapped-sq_default unsat ✅ 128.19600 126.46300
Par4 Par4-wrapped-sq_default unsat ✅ 0.77814 1.36000
SMTInterpol smtinterpol-2.5-514-wrapped-sq_default unknown ❌ 2400.05000 3220.50000
UltimateEliminator UltimateEliminator+MathSAT-5.5.4-wrapped-sq_default unknown ❌ 2.37208 3.84215
UltimateEliminator+SMTInterpol-wrapped-sq_default unknown ❌ 2.35402 3.58418
UltimateEliminator+Yices-2.6.1-wrapped-sq_default unknown ❌ 2.01287 3.31568
Vampire vampire-4.4-smtcomp-wrapped-sq_default unsat ✅ 64.46600 255.87000
veriT veriT-wrapped-sq_default unknown ❌ 2400.03000 2400.16000
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 0.76711 0.76709
z3-4.7.1_default unsat ✅ 0.78068 0.78058
SMT-COMP 2021 0.38 (5/8) CVC4 CVC4-sq-final_default unsat ✅ 66.95130 66.30500
cvc5 cvc5-fixed_default unsat ✅ 113.12000 109.94800
Par4 Par4-wrapped-sq_default unsat ✅ 0.75672 1.39000
SMTInterpol smtinterpol-2.5-823-g881e8631_default unknown ❌ 1200.07000 1818.89000
UltimateEliminator UltimateEliminator+MathSAT-5.6.6_default unknown ❌ 3.08298 5.18374
Vampire vampire_smt_4.6-fixed_vampire_smtcomp unsat ✅ 484.78000 1862.92000
vampire_smt_4.5_vampire_smtcomp unsat ✅ 378.33100 1468.30000
veriT veriT_default unknown ❌ 89.41750 89.37000
Z3 z3-4.8.11_default unsat ✅ 5.13430 5.13363
z3-4.8.8_default unsat ✅ 0.94276 0.94268
SMT-COMP 2023 0.80 (1/5) cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 120.06700 116.30500
cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 104.08100 103.26200
iProver iProver-3.8-fix_iprover_SMT unknown ❌ 1200.10000 4677.45000
SMTInterpol smtinterpol-2.5-1272-g2d6d356c_default unknown ❌ 1200.05000 1258.74000
UltimateEliminator UltimateEliminator+MathSAT-5.6.9_default unknown ❌ 4.21579 7.33458
Vampire vampire_4.8_smt_pre_vampire_smtcomp unknown ❌ 1200.09000 4762.24000
SMT-COMP 2024 0.67 (1/3) cvc5 cvc5 unsat ✅ 100.65181 100.54807
iProver iProver v3.9 unknown ❌ 1201.74150 4743.18758
SMTInterpol SMTInterpol unknown ❌ 1202.71979 2069.08739
SMT-COMP 2025 0.75 (1/4) cvc5 cvc5 unsat ✅ 102.25675 102.10865
iProver iProver v3.9.3 unknown ❌ 1201.80062 4761.36060
SMTInterpol SMTInterpol unknown ❌ 1201.75210 1720.51715
UltimateEliminator UltimateEliminator+MathSAT unknown ❌ 2.26130 4.67931