Benchmark

non-incremental/AUFLIA/misc/set2.smt2 

Assertion verification of simple set manipulation operations.
Benchmark
Size1742
Compressed Size566
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categorycrafted
First Occurrence2006-08-21
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status sat
Inferred Status None
Size 1734
Compressed Size562
Max. Term Depth5
Asserts 15
Declared Functions5
Declared Constants13
Declared Sorts 1
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

ite1 not4 =>6 =12
forall10 Int11 <2 <=1
>3 select4

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2006 1.00 (0/2) CVC3 CVC3 unknown ❌ 45.70000 —
Yices Yices 1.0 timeout ✅ 1207.60000 —
SMT-COMP 2007 1.00 (0/4) CVC3 CVC3 1.2 unknown ❌ 799.70000 —
Fx7 Fx7 unknown ❌ 652.60000 —
Yices Yices 1.0 unknown ❌ 1801.00000 —
Yices 1.0.10 unknown ❌ 1801.00000 —
Z3 Z3 0.1 unknown ❌ 1801.00000 —
SMT-COMP 2008 1.00 (0/3) Alt-Ergo Alt-Ergo unknown ❌ 781.50000 —
Alt-Ergo unknown ❌ 781.00000 —
Alt-Ergo (revised) unknown ❌ 781.50000 —
Alt-Ergo (revised) unknown ❌ 781.00000 —
CVC3 CVC3-1.5 unknown ❌ 1200.80000 —
CVC3-1.5 unknown ❌ 1200.80000 —
Z3 Z3 0.1 unknown ❌ 1201.00000 —
Z3 0.1 unknown ❌ 1201.00000 —
Z3.2 unknown ❌ 1201.00000 —
Z3.2 unknown ❌ 1201.00000 —
SMT-COMP 2009 1.00 (0/2) CVC3 CVC3 2.0 unknown ❌ 12.40000 —
CVC3 2.0 unknown ❌ 12.40000 —
Z3 Z3.2 unknown ❌ 900.10000 —
Z3.2 unknown ❌ 900.10000 —
SMT-COMP 2010 1.00 (0/2) CVC3 CVC3 2.0 unknown ❌ 12.20000 —
CVC3 2.0 unknown ❌ 12.20000 —
CVC3 2.3 unknown ❌ 267.10000 —
CVC3 2.3 unknown ❌ 266.90000 —
Z3 Z3.2 unknown ❌ 1200.10000 —
Z3.2 unknown ❌ 1200.00000 —
SMT-COMP 2012 1.00 (0/2) CVC3 CVC3 v2.4.2 unknown ❌ 50.70000 —
CVC3 v2.4.2 unknown ❌ 50.80000 —
CVC4 1.0rc.3931 unknown ❌ 1200.00000 —
CVC4 1.0rc.3931 unknown ❌ 1200.00000 —
Z3 Z3 unknown ❌ 1200.00000 —
Z3 unknown ❌ 1200.00000 —
SMT-COMP 2011 1.00 (0/2) CVC3 CVC3 v2.4 unknown ❌ 1200.10000 —
CVC3 v2.4 unknown ❌ 1200.10000 —
Z3 Z3 unknown ❌ 1200.00000 —
Z3 unknown ❌ 1200.00000 —
SMT Evaluation 2013 1.00 (0/4) CVC3 CVC3-SMT-COMP-2010 default unknown ❌ 39.44820 —
CVC3-SMT-COMP-2011 default unknown ❌ 243.79000 —
CVC3-SMT-COMP-2012 default unknown ❌ 10.36520 —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unknown ❌ — —
CVC4-SMT-EVAL-2013 default unknown ❌ — —
veriT veriT-SMT-EVAL-2013 default unknown ❌ — —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unknown ❌ — —
Z3-SMT-COMP-2011 default unknown ❌ — —
SMT-COMP 2014 1.00 (0/4) CVC3 CVC3 default unknown ❌ 2401.23000 2402.09000
CVC4 CVC4 f7118b2 default unknown ❌ 2400.01000 2399.52000
veriT veriT-smtcomp2014 default unknown ❌ 2399.22000 2400.07000
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default unknown ❌ 2399.21000 2400.05000
SMT-COMP 2015 1.00 (0/4) CVC3 CVC3 default unknown ❌ 2402.11000 2402.99000
CVC4 CVC4-master-2015-06-15-9b32405-main default unknown ❌ 2400.01000 2400.53000
CVC4-experimental-2015-06-15-ff5745a-main default unknown ❌ 2400.01000 2400.99000
veriT veriT default unknown ❌ 2400.01000 2400.52000
Z3 z3 4.4.0 default unknown ❌ 2400.01000 2400.98000
SMT-COMP 2016 1.00 (0/4) CVC4 CVC4-master-2016-05-27-cfef263-main default unknown ❌ 2400.02000 2389.16000
Vampire vampire_smt_4.1 vampire_smtcomp unknown ❌ 1000.12000 1005.15000
vampire_smt_4.1_parallel vampire_smtcomp unknown ❌ 1037.77000 4012.84000
veriT veriT-dev default unknown ❌ 2400.01000 2581.13000
Z3 z3-4.4.1 default unknown ❌ 2400.02000 2401.21000
SMT-COMP 2017 1.00 (0/4) CVC4 CVC4-smtcomp2017-main default unknown ❌ 600.12300 597.62000
Vampire vampire4.2-smt vampire unknown ❌ 600.03300 2381.29000
veriT veriT-2017-06-17 default unknown ❌ 600.12700 599.98000
Z3 z3-4.5.0 default unknown ❌ 600.03500 599.95000
SMT-COMP 2018 1.00 (0/5) Alt-Ergo Alt-Ergo-SMTComp-2018_default unknown ❌ 1200.04000 4767.60000
CVC4 master-2018-06-10-b19c840-competition-default_default unknown ❌ 1200.10000 1194.96000
Vampire vampire-4.3-smt_vampire_smtcomp unknown ❌ 1200.05000 4774.44000
veriT veriT_default unknown ❌ 1200.04000 1199.72000
Z3 z3-4.7.1_default unknown ❌ 1200.05000 1199.90000
SMT-COMP 2019 1.00 (0/7) Alt-Ergo Alt-Ergo-SMTComp-2019-wrapped-sq_default unknown ❌ 2400.09000 9534.64000
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unknown ❌ 2400.11000 2393.72000
CVC4-SymBreak_03_06_2019-wrapped-sq_default unknown ❌ 2400.12000 2391.19000
master-2018-06-10-b19c840-competition-default_default unknown ❌ 2400.10000 2392.60000
SMTInterpol smtinterpol-2.5-514-wrapped-sq_default unknown ❌ 2400.09000 2465.63000
UltimateEliminator UltimateEliminator+MathSAT-5.5.4-wrapped-sq_default unknown ❌ 2.40719 3.30249
UltimateEliminator+SMTInterpol-wrapped-sq_default unknown ❌ 2.12692 3.24378
UltimateEliminator+Yices-2.6.1-wrapped-sq_default unknown ❌ 2.39968 3.27528
Vampire vampire-4.4-smtcomp-wrapped-sq_default unknown ❌ 2400.07000 9429.30000
veriT veriT-wrapped-sq_default unknown ❌ 2400.01000 2399.63000
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unknown ❌ 2233.73000 2233.55000
SMT-COMP 2020 1.00 (0/7) Alt-Ergo Alt-Ergo-SMTComp-2020_default unknown ❌ 1200.05000 4765.63000
CVC4 CVC4-sq-final_default unknown ❌ 1200.02000 1194.40000
master-2018-06-10-b19c840-competition-default_default unknown ❌ 1200.01000 1192.04000
SMTInterpol smtinterpol-2.5-679-gacfde87a_default unknown ❌ 1200.03000 1241.99000
UltimateEliminator UltimateEliminator+MathSAT-5.6.3_s_default unknown ❌ 2.27666 3.42559
Vampire vampire_smt_4.5_vampire_smtcomp unknown ❌ 1200.10000 4762.61000
veriT veriT_default unknown ❌ 1200.02000 1199.91000
veriT+vite_default unknown ❌ 1200.02000 1199.80000
Z3 z3-4.8.8_default unknown ❌ 1200.04000 1199.73000
SMT-COMP 2021 1.00 (0/7) CVC4 CVC4-sq-final_default unknown ❌ 1200.03000 1191.73000
master-2018-06-10-b19c840-competition-default_default unknown ❌ 1200.02000 1177.82000
cvc5 cvc5-fixed_default unknown ❌ 1200.03000 1190.71000
SMTInterpol smtinterpol-2.5-823-g881e8631_default unknown ❌ 1200.08000 1979.12000
UltimateEliminator UltimateEliminator+MathSAT-5.6.6_default unknown ❌ 2.82110 4.64954
Vampire vampire_smt_4.6-fixed_vampire_smtcomp unknown ❌ 1200.04000 4696.28000
vampire_smt_4.5_vampire_smtcomp unknown ❌ 1200.11000 4729.57000
veriT veriT_default unknown ❌ 1200.02000 1199.77000
Z3 z3-4.8.11_default unknown ❌ 1200.06000 1199.86000
z3-4.8.8_default unknown ❌ 1200.02000 1199.88000
SMT-COMP 2023 1.00 (0/5) cvc5 cvc5-default-2023-05-16-ea045f305_sq unknown ❌ 1200.11000 1192.78000
cvc5-default-2022-07-02-b15e116-wrapped_sq unknown ❌ 1200.11000 1195.31000
iProver iProver-3.8-fix_iprover_SMT unknown ❌ 1200.08000 4747.20000
SMTInterpol smtinterpol-2.5-1272-g2d6d356c_default unknown ❌ 1200.12000 1681.08000
UltimateEliminator UltimateEliminator+MathSAT-5.6.9_default unknown ❌ 2.96288 4.71930
Vampire vampire_4.8_smt_pre_vampire_smtcomp unknown ❌ 1200.04000 4765.12000
SMT-COMP 2024 1.00 (0/3) cvc5 cvc5 unknown ❌ 1201.71592 1200.52395
iProver iProver v3.9 unknown ❌ 1201.72398 4747.63231
SMTInterpol SMTInterpol unknown ❌ 1202.71868 2729.66552