Benchmark

non-incremental/QF_BV/sage/app1/bench_1936.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation)
 For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size77245
Compressed Size10902
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 77237
Compressed Size10889
Max. Term Depth181
Asserts 1
Declared Functions0
Declared Constants290
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 ite82 not75 and1
=200 let171 extract1 bvand44
bvor174 bvadd380 bvmul5 bvsub255
bvult267 bvule583 bvslt2 bvsle57
bvshl175 bvashr5 zero_extend314

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 4Simp 4Simp-SMT-COMP-2012 default unsat ✅ 0.95442 —
Abziz abziz_portfolio_2011_minfeatures_2 default unsat ✅ 0.20767 —
abziz_portfolio_2011_solvers_2 default unsat ✅ 0.21348 —
abziz_portfolio_2012_minfeatures default unsat ✅ 0.20694 —
abziz_portfolio_2012_solvers default unsat ✅ 0.20736 —
AbzizPortfolio-SMT-COMP-2012 default unsat ✅ 0.21997 —
Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 0.12947 —
Boolector-SMT-COMP-2011 default unsat ✅ 0.12110 —
Boolector-SMT-COMP-2012 default unsat ✅ 0.12722 —
CVC3 CVC3-SMT-COMP-2010 default unsat ✅ 2.69758 —
CVC3-SMT-COMP-2011 default unsat ✅ 2.31225 —
CVC3-SMT-COMP-2012 default unsat ✅ 2.39123 —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 0.60573 —
CVC4-SMT-EVAL-2013 default unsat ✅ 1.79148 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 0.38560 —
MathSAT5-HeavyBV-SMT-COMP-2012 default unsat ✅ 0.83855 —
MathSAT5-SMT-COMP-2011 default unsat ✅ 0.37341 —
MathSAT5-SMT-COMP-2012 default unsat ✅ 0.37178 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unsat ✅ 0.23232 —
SONOLAR-SMT-COMP-2010 default unsat ✅ 0.27833 —
SONOLAR-SMT-COMP-2011 default unsat ✅ 0.99899 —
SONOLAR-SMT-COMP-2012 default unsat ✅ 0.22895 —
STP STP2-SMT-COMP-2011 default unsat ✅ 0.04486 —
STP2-SMT-COMP-2012 default unsat ✅ 0.07563 —
simplifyingSTP-SMT-COMP-2010 default unsat ✅ 0.08365 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 0.21503 —
Z3-SMT-COMP-2011 default unsat ✅ 0.20233 —
SMT-COMP 2015 0.14 (6/7) Boolector Boolector SMT15 QF_BV final boolector_qf_bv unsat ✅ 0.02389 0.02300
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 1.05674 2.05569
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 1.09395 2.13268
MathSAT MathSat 5.3.6 main smtcomp2015_main unsat ✅ 0.95303 0.95285
SMT-RAT SMT-RAT-final default unknown ❌ 2400.01000 2400.98000
STP stp-cryptominisat4 default unsat ✅ 0.06604 0.06499
stp-cmsat4-v15 default unsat ✅ 0.06459 0.06399
stp-cmsat4-mt-v15 default unsat ✅ 0.06521 0.06399
stp-minisat-v15 default unsat ✅ 0.06423 0.06299
Yices2 Yices default unsat ✅ 0.04388 0.04299
Z3 z3 4.4.0 default unsat ✅ 0.32988 0.32995
SMT-COMP 2016 ABC ABC_default default_abc unsat ✅ 0.93166 0.93190
ABC_glucose glucose unsat ✅ 12.70870 12.71470
Boolector Boolector boolector unsat ✅ 0.02785 0.02781
Boolector preprop boolector unsat ✅ 0.02677 0.02721
CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 1.04844 2.04557
MapleSTP MapleSTP default unsat ✅ 0.04610 0.04605
MapleSTP-mt default unsat ✅ 0.04600 0.04601
MathSAT mathsat-5.3.11-linux-x86_64-Main default unsat ✅ 0.73953 0.74091
MinkeyRink Minkeyrink 2016 default unsat ✅ 0.05860 0.05856
Q3B Q3B default unsat ✅ 0.46537 1.12171
STP stp-cms-exp-2016 default unsat ✅ 0.04741 0.04734
stp-cms-mt-2016 default unsat ✅ 0.04747 0.04748
stp-cms-st-2016 default unsat ✅ 0.04749 0.04748
stp-minisat-st-2016 default unsat ✅ 0.04831 0.04822
Yices2 Yices-2.4.2 default unsat ✅ 0.04433 0.04412
Z3 z3-4.4.1 default unsat ✅ 0.35732 0.35743
SMT-COMP 2017 Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 0.02780 0.02776
Boolector SMT17 final boolector unsat ✅ 0.02862 0.02856
CVC4 CVC4-smtcomp2017-main default unsat ✅ 1.08257 2.10954
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.77153 0.77124
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 0.04220 0.04086
Q3B Q3B default unsat ✅ 0.51384 1.27006
STP stp_st default unsat ✅ 0.07191 0.07018
stp_mt default unsat ✅ 0.07065 0.06941
Yices2 Yices2-Main default unsat ✅ 0.04401 0.04229
Z3 z3-4.5.0 default unsat ✅ 0.32055 0.31916
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 0.04838 0.04828
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 1.85455 1.85468
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 0.79438 0.79529
MinkeyRink Minkeyrink MT_mt unsat ✅ 0.04321 0.04329
Minkeyrink ST_st unsat ✅ 0.04345 0.04348
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 0.11035 0.11041
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 0.11058 0.11064
STP-Riss-st-2018_riss-no-stderr unsat ✅ 0.11114 0.11120
Yices2 Yices 2.6.0_default unsat ✅ 0.03990 0.03985
Z3 z3-4.7.1_default unsat ✅ 0.34543 0.34534
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default unsat ✅ 0.04693 0.04690
Poolector-wrapped-sq_default unsat ✅ 0.17917 0.27722
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default unsat ✅ 0.03925 0.03925
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 1.06637 1.06662
MinkeyRink MinkeyRink MT-wrapped-sq_default unsat ✅ 0.05345 0.05363
MinkeyRink ST-wrapped-sq_default unsat ✅ 0.05233 0.05240
Par4 Par4-wrapped-sq_default unsat ✅ 0.04676 0.00605
STP STP-2019-wrapped-sq_default unsat ✅ 0.19111 0.19121
stp-mergesat-fixed-wrapped-sq_default unsat ✅ 0.19100 0.19118
stp-minisat-wrapped-sq_default unsat ✅ 0.19235 0.19246
stp-mt-wrapped-sq_default unsat ✅ 0.19099 0.19116
stp-portfolio-fixed-wrapped-sq_default unsat ✅ 0.19087 0.19100
stp-riss-wrapped-sq_default unsat ✅ 0.19192 0.19208
Yices2 Yices 2.6.2-wrapped-sq_default unsat ✅ 0.04603 0.04604
Yices 2.6.2 Cadical-wrapped-sq_default unsat ✅ 0.04569 0.04566
Yices 2.6.2 Cryptominisat-wrapped-sq_default unsat ✅ 0.04554 0.04550
Yices 2.6.2 MCSAT BV-wrapped-sq_default unsat ✅ 0.09916 0.09912
Yices 2.6.2 new bvsolver-wrapped-sq_default unsat ✅ 0.04642 0.04636
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 0.37093 0.37092
SMT-COMP 2020 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.04423 0.04420
Boolector Boolector-wrapped-sq_default unsat ✅ 0.04902 0.04900
Poolector-wrapped-sq_default unsat ✅ 0.17968 0.29204
CVC4 CVC4-sq-final_default unsat ✅ 1.11771 1.11776
LazyBV2Int LazyBV2Int20200523_default.sh unsat ✅ 126.37100 126.34300
MathSAT MathSAT5_default.sh unsat ✅ 0.55409 0.55406
MinkeyRink MinkeyRink Solver 2020.3.1_default unsat ✅ 0.04457 0.04465
MinkeyRink Solver 2020.3_default unsat ✅ 0.04675 0.04688
STP STP_default unsat ✅ 0.14593 0.14605
STP ++ Mergsat v1_default unsat ✅ 0.14456 0.14616
Yices2 Yices 2.6.2 bug fix_default unsat ✅ 0.04785 0.04781
Z3 z3-4.8.8_default unsat ✅ 0.37103 0.37097
SMT-COMP 2021 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.04408 0.04405
MathSAT mathsat-5.6.6_default unsat ✅ 0.56126 0.55750
STP STP 2021.0_default unsat ✅ 0.08344 0.08359
Z3 z3-4.8.11_default unsat ✅ 0.40149 0.40141
SMT-COMP 2022 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.04222 0.04218
Bitwuzla-wrapped_default unsat ✅ 0.04517 0.04511
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 0.88009 0.88061
MathSAT MathSAT-5.6.8_default unsat ✅ 0.58112 0.58100
STP STP 2022.4_default unsat ✅ 0.03674 0.03678
Yices2 Yices 2.6.2 for SMTCOMP 2021_default unsat ✅ 0.04496 0.04487
Z3++BV z3++bv_0702_default unsat ✅ 0.48475 0.48467
Z3 z3-4.8.17_default unsat ✅ 0.59604 0.59786
SMT-COMP 2024 0.17 (5/6) Bitwuzla Bitwuzla unsat ✅ 0.23452 0.13427
cvc5 cvc5 unsat ✅ 0.96316 0.86332
SMTInterpol SMTInterpol unknown ❌ 1201.74332 1235.64146
STP STP unsat ✅ 0.29201 0.19035
Yices2 Yices2 unsat ✅ 0.24034 0.14058
Z3alpha Z3-alpha unsat ✅ 0.29469 0.19471
SMT-COMP 2025 0.11 (8/9) Bitwuzla Bitwuzla unsat ✅ 0.30190 0.18217
Bitwuzla-MachBV-base unsat ✅ 0.27085 0.14994
Bitwuzla-MachBV Bitwuzla-MachBV unsat ✅ 0.38761 0.26171
BVDecide bv_decide unsat ✅ 15.89251 15.75684
bv_decide-nokernel unsat ✅ 8.64988 8.51041
cvc5 cvc5 unsat ✅ 0.87636 0.75554
SMTInterpol SMTInterpol unknown ❌ 1201.58856 1227.43423
Yices2 Yices2 unsat ✅ 0.31180 0.18306
Z3alpha Z3-alpha unsat ✅ 0.43582 0.39948
Z3 Z3-alpha-base unsat ✅ 0.29002 0.17080
Z3-Owl-base unsat ✅ 0.39131 0.26485
z3siri-base unsat ✅ 0.30386 0.18150
Z3-Owl Z3-Owl unsat ✅ 0.79918 0.67672