Benchmark

non-incremental/AUFDTLIA/20172804-Barrett/fmf-cav2013/agreement/agree340.smt2

Publications: "Finite Model Finding in SMT" by Andrew Reynolds, Cesare Tinelli, Amit Goel, and Sava Krstic, CAV 2013.
Benchmark
Size12981
Compressed Size2303
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2017-07-23
Generated ByAndrew Reynolds
Generated On2017-04-28 00:00:00
GeneratorDVF, converted to v2.6 by CVC4
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unknown
Inferred Status unsat
Size 12972
Compressed Size2315
Max. Term Depth25
Asserts 48
Declared Functions15
Declared Constants29
Declared Sorts 4
Defined Functions2
Defined Recursive Functions 0
Defined Sorts0
Constants7
Declared Datatypes4

Symbols

ite16 not20 or6 and23
=>39 =129 forall55 exists1
+5 -2 >1 >=2
Array7 select111 store5

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2017 CVC4 CVC4-smtcomp2017-main default unsat ✅ 0.05849 0.05788
Vampire vampire4.2-smt vampire unsat ✅ 3.03798 8.78000
SMT-COMP 2018 0.50 (1/2) CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 0.03412 0.03432
Vampire vampire-4.3-smt_vampire_smtcomp unknown ❌ 1200.05000 4773.38000
SMT-COMP 2019 Alt-Ergo Alt-Ergo-SMTComp-2019-wrapped-sq_default unsat ✅ 0.05731 0.05864
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 0.04122 0.04152
master-2018-06-10-b19c840-competition-default_default unsat ✅ 0.03824 0.03854
Vampire vampire-4.4-smtcomp-wrapped-sq_default unsat ✅ 1.39293 5.38000
SMT-COMP 2020 0.25 (3/4) Alt-Ergo Alt-Ergo-SMTComp-2020_default unsat ✅ 0.05067 0.04838
CVC4 CVC4-sq-final_default unsat ✅ 0.04464 0.04497
master-2018-06-10-b19c840-competition-default_default unsat ✅ 0.04034 0.04057
UltimateEliminator UltimateEliminator+MathSAT-5.6.3_s_default unknown ❌ 2.12253 3.15872
Vampire vampire_smt_4.5_vampire_smtcomp unsat ✅ 4.03667 9.37000
SMT-COMP 2021 CVC4 CVC4-sq-final_default unsat ✅ 0.04634 0.04663
master-2018-06-10-b19c840-competition-default_default unsat ✅ 0.04068 0.04102
cvc5 cvc5-fixed_default unsat ✅ 0.04783 0.04842
Vampire vampire_smt_4.6-fixed_vampire_smtcomp unsat ✅ 1.90065 4.93000
vampire_smt_4.5_vampire_smtcomp unsat ✅ 2.81433 6.82000
SMT-COMP 2022 0.17 (5/6) CVC4 CVC4-sq-final_default unsat ✅ 0.04749 0.04775
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 0.05592 0.05642
SMTInterpol smtinterpol-fixed-2.5-1148-gf2d8e6b0_default unsat ✅ 35.03260 55.02690
UltimateEliminator UltimateEliminator+MathSAT-5.6.7-wrapped_default unknown ❌ 2.67109 4.44999
Vampire vampire_4.7_smt_fix-wrapped_vampire_smtcomp unsat ✅ 0.65917 2.39000
Z3 z3-4.8.17_default unsat ✅ 0.04552 0.04740
SMT-COMP 2023 cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 0.04649 0.04694
cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 0.05770 0.05826
iProver iProver-3.8-fix_iprover_SMT unsat ✅ 107.76200 421.58000
SMTInterpol smtinterpol-2.5-1272-g2d6d356c_default unsat ✅ 46.04360 60.60550
Vampire vampire_4.8_smt_pre_vampire_smtcomp unsat ✅ 1.64032 7.92237
SMT-COMP 2024 cvc5 cvc5 unsat ✅ 0.23675 0.13733
iProver iProver v3.9 unsat ✅ 62.52214 235.76449
SMTInterpol SMTInterpol unsat ✅ 88.20373 108.00237