Benchmark

non-incremental/UFNIA/lahiri-cav09-storm-queries/daytona_example_2_3_4_4.smt2

Shuvendu K. Lahiri, Shaz Qadeer, Zvonimir Rakamaric, Static and Precise 
    Detection of Concurrency Errors in Systems Code Using SMT Solvers, in 
    Computer Aided Verification (CAV '09), Springer Verlag, February 2009
    <http://research.microsoft.com/apps/pubs/default.aspx?id=80360>
Benchmark
Size432760
Compressed Size51872
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 432752
Compressed Size51884
Max. Term Depth171
Asserts 19
Declared Functions180
Declared Constants1826
Declared Sorts 3
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true559 not90 or16 and279
=>2113 =3328 distinct2 forall461
exists3 let118 Int246 +38
-39 *13 <26 <=18
>10 >=7

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 0.50 (1/2) CVC3 CVC3-SMT-COMP-2010 default unknown ❌
CVC3-SMT-COMP-2011 default unknown ❌
CVC3-SMT-COMP-2012 default unknown ❌
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 0.78823
Z3-SMT-COMP-2011 default unsat ✅ 0.66171
SMT-COMP 2015 0.33 (2/3) CVC3 CVC3 default unknown ❌ 2401.21000 2402.12000
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 503.36500 469.55000
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 531.58400 500.54100
Z3 z3 4.4.0 default unsat ✅ 0.83379 0.83387
SMT-COMP 2016 CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 753.62900 499.87600
Vampire vampire_smt_4.1 vampire_smtcomp unsat ✅ 165.38500 166.19400
vampire_smt_4.1_parallel vampire_smtcomp unsat ✅ 139.92300 386.14400
Z3 z3-4.4.1 default unsat ✅ 0.62111 0.62302
SMT-COMP 2017 0.33 (2/3) CVC4 CVC4-smtcomp2017-main default unknown ❌ 600.18700 411.80000
Vampire vampire4.2-smt vampire unsat ✅ 23.45610 91.79880
Z3 z3-4.5.0 default unsat ✅ 1.21390 1.20655
SMT-COMP 2018 0.33 (2/3) CVC4 master-2018-06-10-b19c840-competition-default_default unknown ❌ 1200.03000 819.40000
Vampire vampire-4.3-smt_vampire_smtcomp unsat ✅ 1088.74000 4325.69000
Z3 z3-4.7.1_default unsat ✅ 0.69310 0.69293
SMT-COMP 2019 0.17 (5/6) Alt-Ergo Alt-Ergo-SMTComp-2019-wrapped-sq_default unsat ✅ 8.50471 33.30000
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 53.84160 53.83830
CVC4-SymBreak_03_06_2019-wrapped-sq_default unsat ✅ 53.43470 53.43160
Par4 Par4-wrapped-sq_default unsat ✅ 0.71425 1.33000
UltimateEliminator UltimateEliminator+MathSAT-5.5.4-wrapped-sq_default unknown ❌ 2.27907 3.40361
UltimateEliminator+Yices-2.6.1-wrapped-sq_default unknown ❌ 2.41487 3.35915
Vampire vampire-4.4-smtcomp-wrapped-sq_default unsat ✅ 305.74700 1209.17000
vampire-4.3-smt_vampire_smtcomp unsat ✅ 355.21500 1408.19000
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 0.71310 0.71307
z3-4.7.1_default unsat ✅ 0.70006 0.69998
SMT-COMP 2020 0.33 (4/6) Alt-Ergo Alt-Ergo-SMTComp-2020_default unsat ✅ 7.19616 28.22000
CVC4 CVC4-sq-final_default unknown ❌ 1200.03000 876.27000
Par4 Par4-wrapped-sq_default unsat ✅ 0.71027 1.27000
UltimateEliminator UltimateEliminator+MathSAT-5.6.3_s_default unknown ❌ 2.47434 3.54707
Vampire vampire_smt_4.5_vampire_smtcomp unsat ✅ 41.53540 162.94000
vampire-4.3-smt_vampire_smtcomp unsat ✅ 1016.04000 4025.09000
Z3 z3-4.8.8_default unsat ✅ 0.71561 0.71461
SMT-COMP 2022 0.60 (2/5) CVC4 CVC4-sq-final_default unknown ❌ 1200.04000 884.97000
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unknown ❌ 1200.02000 782.33000
UltimateEliminator UltimateEliminator+MathSAT-5.6.7-wrapped_default unknown ❌ 2.80992 4.77164
Vampire vampire_4.7_smt_fix-wrapped_vampire_smtcomp unsat ✅ 315.53100 1247.57000
Z3 z3-4.8.17_default unsat ✅ 0.85894 0.86066
SMT-COMP 2023 0.75 (1/4) cvc5 cvc5-default-2023-05-16-ea045f305_sq unknown ❌ 1200.06000 766.07000
cvc5-default-2022-07-02-b15e116-wrapped_sq unknown ❌ 1201.57000 644.20700
iProver iProver-3.8-fix_iprover_SMT unknown ❌ 1200.05000 4730.85000
UltimateEliminator UltimateEliminator+MathSAT-5.6.9_default unknown ❌ 2.94461 4.93550
Vampire vampire_4.8_smt_pre_vampire_smtcomp unsat ✅ 396.99300 1572.27000
SMT-COMP 2024 0.67 (1/3) cvc5 cvc5 unsat ✅ 29.81133 29.70193
iProver iProver v3.9 unknown ❌ 1201.72360 4707.99270
SMTInterpol SMTInterpol unknown ❌ 1202.74737 3701.27519
SMT-COMP 2025 0.75 (1/4) cvc5 cvc5 unsat ✅ 29.52925 29.40748
iProver iProver v3.9.3 unknown ❌ 1201.74404 4720.03331
SMTInterpol SMTInterpol unknown ❌ 612.39122 1670.03130
UltimateEliminator UltimateEliminator+MathSAT unknown ❌ 1.91732 4.15413