Benchmark

non-incremental/QF_BV/sage/app7/bench_1301.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation)
 For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size1881347
Compressed Size131545
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 1881339
Compressed Size131554
Max. Term Depth7324
Asserts 1
Declared Functions0
Declared Constants42
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 ite10 not1672 and1
=2257 let7171 extract1262 bvand18875
bvor12304 bvxor1461 bvadd20521 bvmul1
bvsub6614 bvult438 bvule476 bvslt204
bvsle100 bvshl6450 bvashr11936 zero_extend977

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 4Simp 4Simp-SMT-COMP-2012 default unsat ✅ 0.29163 —
Abziz abziz_portfolio_2011_minfeatures_2 default unsat ✅ 0.41541 —
abziz_portfolio_2011_solvers_2 default unsat ✅ 0.41969 —
abziz_portfolio_2012_minfeatures default unsat ✅ 0.43093 —
abziz_portfolio_2012_solvers default unsat ✅ 0.42168 —
AbzizPortfolio-SMT-COMP-2012 default unsat ✅ 0.42207 —
Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 0.36034 —
Boolector-SMT-COMP-2011 default unsat ✅ 0.44543 —
Boolector-SMT-COMP-2012 default unsat ✅ 0.38337 —
CVC3 CVC3-SMT-COMP-2010 default unsat ✅ 222.09100 —
CVC3-SMT-COMP-2011 default unsat ✅ 185.68400 —
CVC3-SMT-COMP-2012 default unsat ✅ 193.78100 —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 1.45677 —
CVC4-SMT-EVAL-2013 default unsat ✅ 2.43861 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 0.55828 —
MathSAT5-HeavyBV-SMT-COMP-2012 default unsat ✅ 0.53720 —
MathSAT5-SMT-COMP-2011 default unsat ✅ 0.71099 —
MathSAT5-SMT-COMP-2012 default unsat ✅ 0.68585 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unsat ✅ 0.49765 —
SONOLAR-SMT-COMP-2010 default unsat ✅ 2.59785 —
SONOLAR-SMT-COMP-2011 default unsat ✅ 3.49897 —
SONOLAR-SMT-COMP-2012 default unsat ✅ 0.79211 —
STP STP2-SMT-COMP-2011 default unsat ✅ 0.30541 —
STP2-SMT-COMP-2012 default unsat ✅ 0.29350 —
simplifyingSTP-SMT-COMP-2010 default unsat ✅ 0.26903 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 0.46697 —
Z3-SMT-COMP-2011 default unsat ✅ 0.41965 —
SMT-COMP 2015 0.14 (6/7) Boolector Boolector SMT15 QF_BV final boolector_qf_bv unsat ✅ 0.51562 0.51492
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 2.49844 4.07838
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 2.48793 4.07338
MathSAT MathSat 5.3.6 main smtcomp2015_main unsat ✅ 0.39577 0.39494
SMT-RAT SMT-RAT-final default unknown ❌ 2400.01000 2400.62000
STP stp-cryptominisat4 default unsat ✅ 0.25302 0.25196
stp-cmsat4-v15 default unsat ✅ 0.25341 0.25196
stp-cmsat4-mt-v15 default unsat ✅ 0.25353 0.25296
stp-minisat-v15 default unsat ✅ 0.25348 0.25296
Yices2 Yices default unsat ✅ 0.11044 0.10898
Z3 z3 4.4.0 default unsat ✅ 0.34816 0.34795
SMT-COMP 2016 ABC ABC_default default_abc unsat ✅ 1.06019 1.06076
ABC_glucose glucose unsat ✅ 1.04850 1.04929
Boolector Boolector boolector unsat ✅ 0.57275 0.57346
Boolector preprop boolector unsat ✅ 0.56149 0.56193
CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 2.44863 4.01427
MapleSTP MapleSTP default unsat ✅ 0.24125 0.24175
MapleSTP-mt default unsat ✅ 0.24006 0.24014
MathSAT mathsat-5.3.11-linux-x86_64-Main default unsat ✅ 0.35488 0.35637
MinkeyRink Minkeyrink 2016 default unsat ✅ 0.35014 0.35031
Q3B Q3B default unsat ✅ 0.58868 1.44000
STP stp-cms-exp-2016 default unsat ✅ 0.24559 0.24588
stp-cms-mt-2016 default unsat ✅ 0.25056 0.25065
stp-cms-st-2016 default unsat ✅ 0.25049 0.25056
stp-minisat-st-2016 default unsat ✅ 0.24864 0.24888
Yices2 Yices-2.4.2 default unsat ✅ 0.10847 0.10847
Z3 z3-4.4.1 default unsat ✅ 0.27216 0.27357
SMT-COMP 2017 Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 0.51351 0.51073
Boolector SMT17 final boolector unsat ✅ 0.48763 0.48636
CVC4 CVC4-smtcomp2017-main default unsat ✅ 2.56684 4.16925
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.38554 0.38573
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 0.75541 0.75316
Q3B Q3B default unsat ✅ 0.57439 0.57464
STP stp_st default unsat ✅ 0.34229 0.34113
stp_mt default unsat ✅ 0.35552 0.35412
Yices2 Yices2-Main default unsat ✅ 0.10266 0.10178
Z3 z3-4.5.0 default unsat ✅ 0.32651 0.32551
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 0.42673 0.42650
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 2.26690 2.26690
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 0.35589 0.35695
MinkeyRink Minkeyrink MT_mt unsat ✅ 0.73523 0.73521
Minkeyrink ST_st unsat ✅ 0.73720 0.73704
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 0.31058 0.31057
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 0.31112 0.31111
STP-Riss-st-2018_riss-no-stderr unsat ✅ 0.31351 0.31353
Yices2 Yices 2.6.0_default unsat ✅ 0.10018 0.10008
Z3 z3-4.7.1_default unsat ✅ 0.35848 0.35825
SMT-COMP 2020 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.65225 0.65226
Boolector Boolector-wrapped-sq_default unsat ✅ 0.82412 0.82404
Poolector-wrapped-sq_default unsat ✅ 1.08077 3.78541
CVC4 CVC4-sq-final_default unsat ✅ 3.05427 3.05465
LazyBV2Int LazyBV2Int20200523_default.sh unsat ✅ 0.44912 0.44900
MathSAT MathSAT5_default.sh unsat ✅ 0.36977 0.36969
MinkeyRink MinkeyRink Solver 2020.3.1_default unsat ✅ 0.44470 0.44481
MinkeyRink Solver 2020.3_default unsat ✅ 0.46163 0.46164
STP STP_default unsat ✅ 0.29879 0.29892
STP ++ Mergsat v1_default unsat ✅ 0.29114 0.29290
Yices2 Yices 2.6.2 bug fix_default unsat ✅ 0.12396 0.12387
Z3 z3-4.8.8_default unsat ✅ 0.33350 0.33342
SMT-COMP 2023 Bitwuzla Bitwuzla-fixed_default unsat ✅ 1.02700 1.02696
cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 1.72600 1.72331
STP STP 2022.4_default unsat ✅ 0.34328 0.34329
STP 2022.4_default unsat ✅ 0.34296 0.34299
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unsat ✅ 510.59900 587.36600
Yices2 Yices 2 for SMTCOMP 2023_default unsat ✅ 0.12133 0.12129
Z3-Owl z3-Owl-Final_default unsat ✅ 0.90326 0.90322
z3-Owl-Final_default unsat ✅ 0.95755 0.95702
SMT-COMP 2024 Bitwuzla Bitwuzla unsat ✅ 0.73069 0.63071
cvc5 cvc5 unsat ✅ 1.00652 0.90685
SMTInterpol SMTInterpol unsat ✅ 1089.68459 1576.64923
STP STP unsat ✅ 10.00253 9.90216
Yices2 Yices2 unsat ✅ 0.29638 0.19682
Z3alpha Z3-alpha unsat ✅ 0.42619 0.32634