Benchmark

non-incremental/UFNIA/lahiri-cav09-storm-queries/serial_read_example_2_1_8_2.smt2

Shuvendu K. Lahiri, Shaz Qadeer, Zvonimir Rakamaric, Static and Precise 
    Detection of Concurrency Errors in Systems Code Using SMT Solvers, in 
    Computer Aided Verification (CAV '09), Springer Verlag, February 2009
    <http://research.microsoft.com/apps/pubs/default.aspx?id=80360>
Benchmark
Size3387228
Compressed Size343754
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 3387220
Compressed Size343761
Max. Term Depth1725
Asserts 19
Declared Functions669
Declared Constants9886
Declared Sorts 3
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true5702 not631 or107 and1837
=>28938 =19955 distinct2 forall2109
exists3 let1013 Int1081 +241
-158 *13 <150 <=148
>91 >=10

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 0.50 (1/2) CVC3 CVC3-SMT-COMP-2010 default unknown ❌
CVC3-SMT-COMP-2011 default unknown ❌
CVC3-SMT-COMP-2012 default unknown ❌
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 40.96680
Z3-SMT-COMP-2011 default unsat ✅ 13.87860
SMT-COMP 2014 0.33 (2/3) CVC3 CVC3 default unknown ❌ 2400.35000 2401.59000
CVC4 CVC4 f7118b2 default unsat ✅ 762.65100 762.62200
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default unsat ✅ 92.67220 92.68490
SMT-COMP 2015 0.33 (2/3) CVC3 CVC3 default unknown ❌ 2401.90000 2402.90000
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 1113.73000 1107.67000
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 1140.19000 1138.88000
Z3 z3 4.4.0 default unsat ✅ 18.74280 18.74120
SMT-COMP 2016 CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 867.96900 615.18300
Vampire vampire_smt_4.1 vampire_smtcomp unsat ✅ 133.81500 134.44000
vampire_smt_4.1_parallel vampire_smtcomp unsat ✅ 113.12300 383.20000
Z3 z3-4.4.1 default unsat ✅ 29.28940 29.30760
SMT-COMP 2017 0.33 (2/3) CVC4 CVC4-smtcomp2017-main default unknown ❌ 600.06600 384.41000
Vampire vampire4.2-smt vampire unsat ✅ 270.42800 1025.87000
Z3 z3-4.5.0 default unsat ✅ 26.38590 26.36840
SMT-COMP 2018 0.67 (1/3) CVC4 master-2018-06-10-b19c840-competition-default_default unknown ❌ 1200.02000 808.74000
Vampire vampire-4.3-smt_vampire_smtcomp unknown ❌ 1200.07000 4762.75000
Z3 z3-4.7.1_default unsat ✅ 29.05590 29.05340
SMT-COMP 2021 0.71 (2/7) CVC4 CVC4-sq-final_default unknown ❌ 1200.47000 717.42300
cvc5 cvc5-fixed_default unknown ❌ 1200.03000 391.24000
Par4 Par4-wrapped-sq_default unsat ✅ 21.49400 42.93000
SMTInterpol smtinterpol-2.5-823-g881e8631_default unknown ❌ 0.79471 1.88855
UltimateEliminator UltimateEliminator+MathSAT-5.6.6_default unknown ❌ 2.90574 4.84413
Vampire vampire_smt_4.6-fixed_vampire_smtcomp unknown ❌ 1200.07000 4696.93000
vampire_smt_4.5_vampire_smtcomp unknown ❌ 313.18500 1194.06000
Z3 z3-4.8.11_default unsat ✅ 13.10910 13.10890
SMT-COMP 2022 0.80 (1/5) CVC4 CVC4-sq-final_default unknown ❌ 1200.02000 646.16000
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unknown ❌ 1200.61000 722.05500
UltimateEliminator UltimateEliminator+MathSAT-5.6.7-wrapped_default unknown ❌ 2.84314 4.71384
Vampire vampire_4.7_smt_fix-wrapped_vampire_smtcomp unknown ❌ 1200.12000 4773.87000
Z3 z3-4.8.17_default unsat ✅ 13.11050 13.11190
SMT-COMP 2023 1.00 (0/4) cvc5 cvc5-default-2023-05-16-ea045f305_sq unknown ❌ 1200.29000 658.92200
cvc5-default-2022-07-02-b15e116-wrapped_sq unknown ❌ 1200.65000 623.95200
iProver iProver-3.8-fix_iprover_SMT unknown ❌ 1200.10000 4730.92000
UltimateEliminator UltimateEliminator+MathSAT-5.6.9_default unknown ❌ 2.87245 4.73346
Vampire vampire_4.8_smt_pre_vampire_smtcomp unknown ❌ 1200.12000 4750.94000