Benchmark

non-incremental/QF_BV/Sage2/bench_3461.smt2

Patrice Godefroid, SAGE (systematic dynamic test generation). For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size75646
Compressed Size4642
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2015-07-02
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 75638
Compressed Size4659
Max. Term Depth41
Asserts 60
Declared Functions0
Declared Constants92
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 not18 =19 let1690
bvadd616 bvmul704 bvslt19 bvsge21
zero_extend352

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2017 0.12 (7/8) Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 32.42080 32.39950
Boolector SMT17 final boolector unsat ✅ 78.38220 78.36360
CVC4 CVC4-smtcomp2017-main default unsat ✅ 5.20363 10.34850
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 42.95360 42.94550
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 1.59509 1.57485
Q3B Q3B default unknown ❌ 600.02600 1799.28000
STP stp_st default unsat ✅ 1.90578 1.90576
stp_mt default unsat ✅ 1.87807 6.16095
Yices2 Yices2-Main default unsat ✅ 0.07569 0.07379
Z3 z3-4.5.0 default unsat ✅ 8.79588 8.79470
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 25.98730 25.98610
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 3.85116 3.85092
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 43.68890 43.68460
MinkeyRink Minkeyrink MT_mt unsat ✅ 0.91868 1.92841
Minkeyrink ST_st unsat ✅ 0.85389 0.85004
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 1.57588 1.57592
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 1.67949 5.48757
STP-Riss-st-2018_riss-no-stderr unsat ✅ 2.86829 2.86801
Yices2 Yices 2.6.0_default unsat ✅ 0.07680 0.07673
Z3 z3-4.7.1_default unsat ✅ 8.15114 8.15013
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default unsat ✅ 32.94130 32.94160
Poolector-wrapped-sq_default unsat ✅ 37.87730 149.70000
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default unsat ✅ 82.91990 82.88300
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 3.67076 3.67049
MinkeyRink MinkeyRink MT-wrapped-sq_default unsat ✅ 1.10965 2.67422
MinkeyRink ST-wrapped-sq_default unsat ✅ 1.03214 1.03228
Par4 Par4-wrapped-sq_default unsat ✅ 0.09776 0.00627
STP STP-2019-wrapped-sq_default unsat ✅ 1.37787 1.37818
stp-mergesat-fixed-wrapped-sq_default unsat ✅ 12.87720 12.87830
stp-minisat-wrapped-sq_default unsat ✅ 2.50320 2.50347
stp-mt-wrapped-sq_default unsat ✅ 1.39914 4.29927
stp-portfolio-fixed-wrapped-sq_default unsat ✅ 12.61110 15.88610
stp-riss-wrapped-sq_default unknown ❌ 0.40799 0.40817
Yices2 Yices 2.6.2-wrapped-sq_default unsat ✅ 0.09047 0.09048
Yices 2.6.2 Cadical-wrapped-sq_default unsat ✅ 1.09173 1.08398
Yices 2.6.2 Cryptominisat-wrapped-sq_default unsat ✅ 0.79805 0.79731
Yices 2.6.2 MCSAT BV-wrapped-sq_default unknown ❌ 2400.02000 2399.87000
Yices 2.6.2 new bvsolver-wrapped-sq_default unsat ✅ 0.21049 0.21049
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 8.47002 8.46945
SMT-COMP 2023 0.17 (5/6) Bitwuzla Bitwuzla-fixed_default unsat ✅ 6.77022 6.76663
cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 13.40490 13.39800
STP STP 2022.4_default unsat ✅ 5.02268 4.98859
STP 2022.4_default unsat ✅ 4.99008 4.99040
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unknown ❌ 4.37395 11.60370
Yices2 Yices 2 for SMTCOMP 2023_default unsat ✅ 0.09914 0.09910
Z3-Owl z3-Owl-Final_default unsat ✅ 51.00330 51.00070
z3-Owl-Final_default unsat ✅ 31.81010 31.80610
SMT-COMP 2024 0.17 (5/6) Bitwuzla Bitwuzla unsat ✅ 3.41774 3.31339
cvc5 cvc5 unsat ✅ 16.32357 16.20173
SMTInterpol SMTInterpol unknown ❌ 1201.75477 1214.92625
STP STP unsat ✅ 7.79536 7.69145
Yices2 Yices2 unsat ✅ 0.50270 0.40229
Z3alpha Z3-alpha unsat ✅ 1.12344 1.02306