Benchmark

non-incremental/AUFLIRA/peter/symmetric_unsat_82.smt2

Example extracted from Peter Baumgartner's talk at CADE-21: Logical Engineering with Instance-Based Methods.

It was translated to SMT-LIB by Leonardo de Moura
Benchmark
Size11927
Compressed Size1669
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categorycrafted
First Occurrence2008-07-07
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 11919
Compressed Size1610
Max. Term Depth7
Asserts 84
Declared Functions1
Declared Constants165
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

not1 and1 =>1 =83
forall2 Int5 Real1 <=4
Array2 select85 store162

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2008 Alt-Ergo Alt-Ergo sat ✅ 2.90000
Alt-Ergo (revised) unknown ❌ 2.90000
CVC3 CVC3 1.2 unsat ✅ 297.40000
CVC3-1.5 unsat ✅ 201.40000
Z3 Z3.2 unsat ✅ 2.70000
SMT-COMP 2010 CVC3 CVC3 2.0 unsat ✅ 404.60000
CVC3 2.3 unsat ✅ 493.30000
Z3 Z3.2 unsat ✅ 2.60000
SMT-COMP 2011 0.50 (1/2) CVC3 CVC3 v2.4 unknown ❌ 1200.00000
Z3 Z3 unsat ✅ 1.40000
SMT Evaluation 2013 1.00 (0/4) CVC3 CVC3-SMT-COMP-2010 default unknown ❌
CVC3-SMT-COMP-2011 default unknown ❌
CVC3-SMT-COMP-2012 default unknown ❌
CVC4 CVC4-SMT-COMP-2012-Resubmission default unknown ❌
CVC4-SMT-EVAL-2013 default unknown ❌
veriT veriT-SMT-EVAL-2013 default unknown ❌
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unknown ❌
Z3-SMT-COMP-2011 default unknown ❌
SMT-COMP 2014 0.50 (2/4) CVC3 CVC3 default unknown ❌ 2400.67000 2401.36000
CVC4 CVC4 f7118b2 default unsat ✅ 625.94400 625.99000
veriT veriT-smtcomp2014 default unknown ❌ 2399.01000 2400.05000
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default unsat ✅ 1.13183 1.12283
SMT-COMP 2015 0.50 (2/4) CVC3 CVC3 default unknown ❌ 2402.56000 2401.29000
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 823.27800 823.10800
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 855.14900 855.26900
veriT veriT default unknown ❌ 2400.01000 2400.65000
Z3 z3 4.4.0 default unsat ✅ 1.03924 1.03984
SMT-COMP 2016 0.25 (3/4) CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 694.61100 691.89200
Vampire vampire_smt_4.1 vampire_smtcomp unsat ✅ 44.90680 45.13720
vampire_smt_4.1_parallel vampire_smtcomp unsat ✅ 37.68020 58.90070
veriT veriT-dev default unknown ❌ 2400.02000 2401.62000
Z3 z3-4.4.1 default unsat ✅ 0.98652 0.98826
SMT-COMP 2017 0.50 (2/4) CVC4 CVC4-smtcomp2017-main default unknown ❌ 600.02500 596.99000
Vampire vampire4.2-smt vampire unsat ✅ 53.31860 111.63400
veriT veriT-2017-06-17 default unknown ❌ 600.07000 599.92800
Z3 z3-4.5.0 default unsat ✅ 1.18021 1.17953
SMT-COMP 2018 0.60 (2/5) Alt-Ergo Alt-Ergo-SMTComp-2018_default unknown ❌ 1200.02000 2077.46000
CVC4 master-2018-06-10-b19c840-competition-default_default unknown ❌ 1200.10000 1195.65000
Vampire vampire-4.3-smt_vampire_smtcomp unsat ✅ 91.49560 363.86000
veriT veriT_default unknown ❌ 1200.02000 1199.94000
Z3 z3-4.7.1_default unsat ✅ 1.00614 1.00601
SMT-COMP 2019 0.50 (4/8) Alt-Ergo Alt-Ergo-SMTComp-2019-wrapped-sq_default unknown ❌ 2400.01000 7737.84000
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 128.90100 128.26500
CVC4-SymBreak_03_06_2019-wrapped-sq_default unsat ✅ 129.00300 128.44300
Par4 Par4-wrapped-sq_default unsat ✅ 0.97680 1.80000
SMTInterpol smtinterpol-2.5-514-wrapped-sq_default unknown ❌ 2400.05000 3233.39000
UltimateEliminator UltimateEliminator+MathSAT-5.5.4-wrapped-sq_default unknown ❌ 2.53561 4.09062
UltimateEliminator+SMTInterpol-wrapped-sq_default unknown ❌ 2.50813 3.97000
UltimateEliminator+Yices-2.6.1-wrapped-sq_default unknown ❌ 2.21965 3.38393
Vampire vampire-4.4-smtcomp-wrapped-sq_default unsat ✅ 375.61500 1490.57000
veriT veriT-wrapped-sq_default unknown ❌ 2400.02000 2399.67000
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 0.98794 0.98790
z3-4.7.1_default unsat ✅ 1.00252 1.00237
SMT-COMP 2021 0.38 (5/8) CVC4 CVC4-sq-final_default unsat ✅ 68.30100 67.75580
cvc5 cvc5-fixed_default unsat ✅ 121.82300 118.32800
Par4 Par4-wrapped-sq_default unsat ✅ 1.00015 1.95000
SMTInterpol smtinterpol-2.5-823-g881e8631_default unknown ❌ 1200.05000 1931.86000
UltimateEliminator UltimateEliminator+MathSAT-5.6.6_default unknown ❌ 3.30852 5.54950
Vampire vampire_smt_4.6-fixed_vampire_smtcomp unsat ✅ 805.25500 3122.62000
vampire_smt_4.5_vampire_smtcomp unsat ✅ 712.23200 2768.77000
veriT veriT_default unknown ❌ 89.50900 89.39000
Z3 z3-4.8.11_default unsat ✅ 8.99297 8.98766
z3-4.8.8_default unsat ✅ 1.20364 1.20352
SMT-COMP 2022 0.57 (3/7) CVC4 CVC4-sq-final_default unsat ✅ 69.10080 68.32920
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 111.28500 109.86500
SMTInterpol smtinterpol-fixed-2.5-1148-gf2d8e6b0_default unknown ❌ 1200.05000 1270.94000
UltimateEliminator UltimateEliminator+MathSAT-5.6.7-wrapped_default unknown ❌ 3.11747 5.41045
Vampire vampire_4.7_smt_fix-wrapped_vampire_smtcomp unknown ❌ 1200.09000 4757.45000
veriT veriT_default unknown ❌ 89.71300 89.66000
Z3 z3-4.8.17_default unsat ✅ 1.38980 1.39153
SMT-COMP 2025 0.75 (1/4) cvc5 cvc5 unsat ✅ 108.87246 108.73414
iProver iProver v3.9.3 unknown ❌ 1201.80261 4760.66108
SMTInterpol SMTInterpol unknown ❌ 1201.37204 1936.32330
UltimateEliminator UltimateEliminator+MathSAT unknown ❌ 2.12610 4.72167