Benchmark

non-incremental/UFNIA/lahiri-cav09-storm-queries/usbsamp_example_2_2_6_4.smt2 

Shuvendu K. Lahiri, Shaz Qadeer, Zvonimir Rakamaric, Static and Precise 
    Detection of Concurrency Errors in Systems Code Using SMT Solvers, in 
    Computer Aided Verification (CAV '09), Springer Verlag, February 2009
    <http://research.microsoft.com/apps/pubs/default.aspx?id=80360>
Benchmark
Size1878396
Compressed Size196645
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 1878388
Compressed Size196654
Max. Term Depth1009
Asserts 19
Declared Functions281
Declared Constants6158
Declared Sorts 3
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true3224 false1 not317 or68
and998 =>17876 =10381 distinct2
forall851 exists3 let504 Int448
+101 -65 *13 <98
<=104 >48 >=13

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 0.50 (1/2) CVC3 CVC3-SMT-COMP-2010 default unknown ❌ — —
CVC3-SMT-COMP-2011 default unknown ❌ — —
CVC3-SMT-COMP-2012 default unknown ❌ — —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 21.00210 —
Z3-SMT-COMP-2011 default unsat ✅ 14.17640 —
SMT-COMP 2014 0.33 (2/3) CVC3 CVC3 default unknown ❌ 2400.54000 2401.56000
CVC4 CVC4 f7118b2 default unsat ✅ 367.74000 367.65400
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default unsat ✅ 25.99920 26.00100
SMT-COMP 2015 0.33 (2/3) CVC3 CVC3 default unknown ❌ 2401.83000 2402.68000
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 1085.38000 1030.41000
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 1079.54000 1062.95000
Z3 z3 4.4.0 default unsat ✅ 33.16810 33.18100
SMT-COMP 2016 CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 853.50400 624.22900
Vampire vampire_smt_4.1 vampire_smtcomp unknown ❌ 994.37100 999.81900
vampire_smt_4.1_parallel vampire_smtcomp unsat ✅ 718.45100 2316.55000
Z3 z3-4.4.1 default unsat ✅ 27.41670 27.43180
SMT-COMP 2017 0.33 (2/3) CVC4 CVC4-smtcomp2017-main default unknown ❌ 600.02100 358.87000
Vampire vampire4.2-smt vampire unsat ✅ 51.51340 200.41000
Z3 z3-4.5.0 default unsat ✅ 25.37550 25.37520
SMT-COMP 2018 0.67 (1/3) CVC4 master-2018-06-10-b19c840-competition-default_default unknown ❌ 1200.02000 715.09000
Vampire vampire-4.3-smt_vampire_smtcomp unknown ❌ 1200.08000 4769.90000
Z3 z3-4.7.1_default unsat ✅ 12.94710 12.94650
SMT-COMP 2019 0.50 (3/6) Alt-Ergo Alt-Ergo-SMTComp-2019-wrapped-sq_default unknown ❌ 177.99300 705.37000
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unknown ❌ 2400.03000 1416.30000
CVC4-SymBreak_03_06_2019-wrapped-sq_default unknown ❌ 2400.05000 864.99000
Par4 Par4-wrapped-sq_default unsat ✅ 14.40100 28.70000
UltimateEliminator UltimateEliminator+MathSAT-5.5.4-wrapped-sq_default unknown ❌ 2.20965 3.39347
UltimateEliminator+Yices-2.6.1-wrapped-sq_default unknown ❌ 2.43888 3.36852
Vampire vampire-4.4-smtcomp-wrapped-sq_default unknown ❌ 2400.07000 9517.82000
vampire-4.3-smt_vampire_smtcomp unsat ✅ 2207.47000 8795.72000
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 11.88260 11.88200
z3-4.7.1_default unsat ✅ 12.46120 12.45910
SMT-COMP 2020 0.50 (3/6) Alt-Ergo Alt-Ergo-SMTComp-2020_default unknown ❌ 163.19000 647.79000
CVC4 CVC4-sq-final_default unknown ❌ 1200.03000 651.37000
Par4 Par4-wrapped-sq_default unsat ✅ 25.35320 50.58000
UltimateEliminator UltimateEliminator+MathSAT-5.6.3_s_default unknown ❌ 2.42150 3.40551
Vampire vampire_smt_4.5_vampire_smtcomp unsat ✅ 293.22300 1124.54000
vampire-4.3-smt_vampire_smtcomp unknown ❌ 1200.03000 4753.25000
Z3 z3-4.8.8_default unsat ✅ 10.99680 10.99660
SMT-COMP 2021 0.71 (2/7) CVC4 CVC4-sq-final_default unknown ❌ 1200.33000 629.68200
cvc5 cvc5-fixed_default unknown ❌ 1200.03000 459.56000
Par4 Par4-wrapped-sq_default unsat ✅ 17.35490 34.55000
SMTInterpol smtinterpol-2.5-823-g881e8631_default unknown ❌ 0.63965 1.40069
UltimateEliminator UltimateEliminator+MathSAT-5.6.6_default unknown ❌ 2.97480 4.85101
Vampire vampire_smt_4.6-fixed_vampire_smtcomp unknown ❌ 420.70200 1612.77000
vampire_smt_4.5_vampire_smtcomp unknown ❌ 289.47700 1104.70000
Z3 z3-4.8.11_default unsat ✅ 11.33610 11.33590
SMT-COMP 2022 0.60 (2/5) CVC4 CVC4-sq-final_default unknown ❌ 1200.03000 616.80000
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unknown ❌ 1200.02000 670.34000
UltimateEliminator UltimateEliminator+MathSAT-5.6.7-wrapped_default unknown ❌ 38.97560 4.78751
Vampire vampire_4.7_smt_fix-wrapped_vampire_smtcomp unsat ✅ 395.26500 1565.08000
Z3 z3-4.8.17_default unsat ✅ 12.25190 12.25310
SMT-COMP 2023 0.75 (1/4) cvc5 cvc5-default-2023-05-16-ea045f305_sq unknown ❌ 1200.10000 746.63000
cvc5-default-2022-07-02-b15e116-wrapped_sq unknown ❌ 1200.08000 757.90000
iProver iProver-3.8-fix_iprover_SMT unknown ❌ 1200.13000 4725.92000
UltimateEliminator UltimateEliminator+MathSAT-5.6.9_default unknown ❌ 3.01382 4.90183
Vampire vampire_4.8_smt_pre_vampire_smtcomp unsat ✅ 382.02500 1494.45000
SMT-COMP 2024 0.67 (1/3) cvc5 cvc5 unsat ✅ 1026.49160 1026.33286
iProver iProver v3.9 unknown ❌ 1201.77034 4723.78931
SMTInterpol SMTInterpol unknown ❌ 1202.74804 2140.63478
SMT-COMP 2025 0.75 (1/4) cvc5 cvc5 unsat ✅ 1015.30523 1015.04265
iProver iProver v3.9.3 unknown ❌ 1201.78633 4721.71536
SMTInterpol SMTInterpol unknown ❌ 1201.87810 2770.84383
UltimateEliminator UltimateEliminator+MathSAT unknown ❌ 1.93267 3.89225