Benchmark

non-incremental/QF_BV/sage/app7/bench_1885.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation)
 For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size1081271
Compressed Size87564
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 1081263
Compressed Size87572
Max. Term Depth4153
Asserts 1
Declared Functions0
Declared Constants42
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 ite10 not1465 and1
=1986 let4096 extract1172 bvand9898
bvor6359 bvxor1320 bvadd11336 bvmul1
bvsub3647 bvult421 bvule433 bvslt186
bvsle96 bvshl3494 bvashr6056 zero_extend889

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 4Simp 4Simp-SMT-COMP-2012 default unsat ✅ 0.15531 —
Abziz abziz_portfolio_2011_minfeatures_2 default unsat ✅ 0.20571 —
abziz_portfolio_2011_solvers_2 default unsat ✅ 0.21104 —
abziz_portfolio_2012_minfeatures default unsat ✅ 0.20917 —
abziz_portfolio_2012_solvers default unsat ✅ 0.21259 —
AbzizPortfolio-SMT-COMP-2012 default unsat ✅ 0.21443 —
Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 0.20907 —
Boolector-SMT-COMP-2011 default unsat ✅ 0.24906 —
Boolector-SMT-COMP-2012 default unsat ✅ 0.21918 —
CVC3 CVC3-SMT-COMP-2010 default unsat ✅ 106.14100 —
CVC3-SMT-COMP-2011 default unsat ✅ 88.70350 —
CVC3-SMT-COMP-2012 default unsat ✅ 92.48050 —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 0.95562 —
CVC4-SMT-EVAL-2013 default unsat ✅ 1.59174 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 0.32452 —
MathSAT5-HeavyBV-SMT-COMP-2012 default unsat ✅ 0.31069 —
MathSAT5-SMT-COMP-2011 default unsat ✅ 0.41747 —
MathSAT5-SMT-COMP-2012 default unsat ✅ 0.40114 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unsat ✅ 0.29506 —
SONOLAR-SMT-COMP-2010 default unsat ✅ 1.66092 —
SONOLAR-SMT-COMP-2011 default unsat ✅ 1.91084 —
SONOLAR-SMT-COMP-2012 default unsat ✅ 0.42600 —
STP STP2-SMT-COMP-2011 default unsat ✅ 0.16320 —
STP2-SMT-COMP-2012 default unsat ✅ 0.15363 —
simplifyingSTP-SMT-COMP-2010 default unsat ✅ 0.15979 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 0.24353 —
Z3-SMT-COMP-2011 default unsat ✅ 0.20483 —
SMT-COMP 2015 0.14 (6/7) Boolector Boolector SMT15 QF_BV final boolector_qf_bv unsat ✅ 0.27753 0.27596
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 1.47151 2.40463
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 1.47815 2.41763
MathSAT MathSat 5.3.6 main smtcomp2015_main unsat ✅ 0.23673 0.23596
SMT-RAT SMT-RAT-final default unknown ❌ 2400.01000 2401.12000
STP stp-cryptominisat4 default unsat ✅ 0.14176 0.14098
stp-cmsat4-v15 default unsat ✅ 0.14144 0.13998
stp-cmsat4-mt-v15 default unsat ✅ 0.14327 0.14198
stp-minisat-v15 default unsat ✅ 0.14055 0.13998
Yices2 Yices default unsat ✅ 0.06837 0.06699
Z3 z3 4.4.0 default unsat ✅ 0.19562 0.19597
SMT-COMP 2016 ABC ABC_default default_abc unsat ✅ 0.62261 0.62269
ABC_glucose glucose unsat ✅ 0.61213 0.61228
Boolector Boolector boolector unsat ✅ 0.32449 0.32462
Boolector preprop boolector unsat ✅ 0.31331 0.31377
CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 1.43332 2.35156
MapleSTP MapleSTP default unsat ✅ 0.14181 0.14186
MapleSTP-mt default unsat ✅ 0.13567 0.13568
MathSAT mathsat-5.3.11-linux-x86_64-Main default unsat ✅ 0.21111 0.21216
MinkeyRink Minkeyrink 2016 default unsat ✅ 0.18737 0.18740
Q3B Q3B default unsat ✅ 0.39319 0.91015
STP stp-cms-exp-2016 default unsat ✅ 0.13732 0.13733
stp-cms-mt-2016 default unsat ✅ 0.13976 0.13980
stp-cms-st-2016 default unsat ✅ 0.27739 0.27744
stp-minisat-st-2016 default unsat ✅ 0.14066 0.14066
Yices2 Yices-2.4.2 default unsat ✅ 0.06941 0.06942
Z3 z3-4.4.1 default unsat ✅ 0.25088 0.25234
SMT-COMP 2017 Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 0.25787 0.25422
Boolector SMT17 final boolector unsat ✅ 0.27414 0.27264
CVC4 CVC4-smtcomp2017-main default unsat ✅ 1.49865 2.43079
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.23454 0.22921
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 0.41505 0.40903
Q3B Q3B default unsat ✅ 0.37567 0.85180
STP stp_st default unsat ✅ 0.17139 0.17073
stp_mt default unsat ✅ 0.18234 0.17883
Yices2 Yices2-Main default unsat ✅ 0.06484 0.06476
Z3 z3-4.5.0 default unsat ✅ 0.28162 0.27953
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 0.23002 0.22994
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 1.30920 1.30922
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 0.20657 0.20761
MinkeyRink Minkeyrink MT_mt unsat ✅ 0.41468 0.41470
Minkeyrink ST_st unsat ✅ 0.41621 0.41609
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 0.17195 0.17193
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 0.17279 0.17266
STP-Riss-st-2018_riss-no-stderr unsat ✅ 0.17193 0.17195
Yices2 Yices 2.6.0_default unsat ✅ 0.06439 0.06431
Z3 z3-4.7.1_default unsat ✅ 0.25133 0.25104
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default unsat ✅ 0.43018 0.43019
Poolector-wrapped-sq_default unsat ✅ 0.58360 2.01275
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default unsat ✅ 0.35763 0.35763
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 1.31873 1.31890
MinkeyRink MinkeyRink MT-wrapped-sq_default unsat ✅ 0.33233 0.33248
MinkeyRink ST-wrapped-sq_default unsat ✅ 0.32869 0.32870
Par4 Par4-wrapped-sq_default unsat ✅ 0.07796 0.00859
STP STP-2019-wrapped-sq_default unsat ✅ 0.18515 0.18528
stp-mergesat-fixed-wrapped-sq_default unsat ✅ 0.18447 0.18457
stp-minisat-wrapped-sq_default unsat ✅ 0.18471 0.18481
stp-mt-wrapped-sq_default unsat ✅ 0.18586 0.18597
stp-portfolio-fixed-wrapped-sq_default unsat ✅ 0.18606 0.18584
stp-riss-wrapped-sq_default unsat ✅ 0.18493 0.18505
Yices2 Yices 2.6.2-wrapped-sq_default unsat ✅ 0.06755 0.06756
Yices 2.6.2 Cadical-wrapped-sq_default unsat ✅ 0.06919 0.06919
Yices 2.6.2 Cryptominisat-wrapped-sq_default unsat ✅ 0.06732 0.06731
Yices 2.6.2 MCSAT BV-wrapped-sq_default unsat ✅ 0.06650 0.06650
Yices 2.6.2 new bvsolver-wrapped-sq_default unsat ✅ 0.06730 0.06730
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 0.25226 0.25224
SMT-COMP 2023 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.55416 0.55395
cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 1.01156 1.01209
STP STP 2022.4_default unsat ✅ 0.18551 0.18553
STP 2022.4_default unsat ✅ 0.18987 0.18990
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unsat ✅ 353.96300 406.29400
Yices2 Yices 2 for SMTCOMP 2023_default unsat ✅ 0.07549 0.07545
Z3-Owl z3-Owl-Final_default unsat ✅ 0.86326 0.86323
z3-Owl-Final_default unsat ✅ 0.87724 0.87662