Benchmark

non-incremental/QF_BV/sage/app1/bench_1093.smt2

Patrice Godefroid, SAGE (systematic dynamic test generation)
 For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size41456
Compressed Size4734
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 41448
Compressed Size4750
Max. Term Depth64
Asserts 1
Declared Functions0
Declared Constants280
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 ite25 not41 and1
=104 let54 bvor168 bvadd193
bvsub64 bvult107 bvule192 bvshl169
bvashr3 zero_extend250

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 4Simp 4Simp-SMT-COMP-2012 default unsat ✅ 0.47291
Abziz abziz_portfolio_2011_minfeatures_2 default unsat ✅ 0.36397
abziz_portfolio_2011_solvers_2 default unsat ✅ 0.36501
abziz_portfolio_2012_minfeatures default unsat ✅ 0.36492
abziz_portfolio_2012_solvers default unsat ✅ 0.35712
AbzizPortfolio-SMT-COMP-2012 default unsat ✅ 0.38354
Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 0.11086
Boolector-SMT-COMP-2011 default unsat ✅ 0.30164
Boolector-SMT-COMP-2012 default unsat ✅ 0.05491
CVC3 CVC3-SMT-COMP-2010 default unsat ✅ 3.66790
CVC3-SMT-COMP-2011 default unsat ✅ 3.50030
CVC3-SMT-COMP-2012 default unsat ✅ 3.50985
CVC4 CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 0.25807
CVC4-SMT-EVAL-2013 default unsat ✅ 0.33868
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 0.14075
MathSAT5-HeavyBV-SMT-COMP-2012 default unsat ✅ 0.88077
MathSAT5-SMT-COMP-2011 default unsat ✅ 0.14020
MathSAT5-SMT-COMP-2012 default unsat ✅ 0.14301
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unsat ✅ 0.27453
SONOLAR-SMT-COMP-2010 default unsat ✅ 0.35813
SONOLAR-SMT-COMP-2011 default unsat ✅ 0.43897
SONOLAR-SMT-COMP-2012 default unsat ✅ 0.25049
STP STP2-SMT-COMP-2011 default unsat ✅ 0.39968
STP2-SMT-COMP-2012 default unsat ✅ 0.71479
simplifyingSTP-SMT-COMP-2010 default unsat ✅ 0.51245
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 0.38655
Z3-SMT-COMP-2011 default unsat ✅ 0.34899
SMT-COMP 2015 Boolector Boolector SMT15 QF_BV final boolector_qf_bv unsat ✅ 0.46056 0.45993
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 0.68373 1.32980
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 0.65607 1.27581
MathSAT MathSat 5.3.6 main smtcomp2015_main unsat ✅ 0.58990 0.58891
SMT-RAT SMT-RAT-final default unsat ✅ 65.39390 65.40810
STP stp-cryptominisat4 default unsat ✅ 0.45794 0.45693
stp-cmsat4-v15 default unsat ✅ 1.42884 1.42878
stp-cmsat4-mt-v15 default unknown ❌ 0.37786 0.37694
stp-minisat-v15 default unsat ✅ 0.39879 0.39794
Yices2 Yices default unsat ✅ 0.02434 0.02300
Z3 z3 4.4.0 default unsat ✅ 0.64637 0.64690
SMT-COMP 2016 0.10 (9/10) ABC ABC_default default_abc unsat ✅ 0.45278 0.45282
ABC_glucose glucose unsat ✅ 4.84034 4.84312
Boolector Boolector boolector unsat ✅ 0.68189 0.68124
Boolector preprop boolector unsat ✅ 0.67304 0.67345
CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 0.59833 1.16165
MapleSTP MapleSTP default unsat ✅ 0.55822 0.55852
MapleSTP-mt default unsat ✅ 0.64575 1.47184
MathSAT mathsat-5.3.11-linux-x86_64-Main default unsat ✅ 0.49138 0.49283
MinkeyRink Minkeyrink 2016 default unsat ✅ 1.53168 2.01910
Q3B Q3B default unknown ❌ 2400.02000 7204.47000
STP stp-cms-exp-2016 default unsat ✅ 0.63076 0.63109
stp-cms-mt-2016 default unsat ✅ 0.65238 1.47172
stp-cms-st-2016 default unsat ✅ 0.53882 0.53911
stp-minisat-st-2016 default unsat ✅ 0.68689 0.68722
Yices2 Yices-2.4.2 default unsat ✅ 0.02440 0.02438
Z3 z3-4.4.1 default unsat ✅ 0.68765 0.68934
SMT-COMP 2017 0.12 (7/8) Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 0.19085 0.18994
Boolector SMT17 final boolector unsat ✅ 0.70780 0.70679
CVC4 CVC4-smtcomp2017-main default unsat ✅ 1.58674 1.74015
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.49045 0.47109
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 0.99474 0.42301
Q3B Q3B default unknown ❌ 600.03600 1417.56000
STP stp_st default unsat ✅ 0.67831 0.67686
stp_mt default unsat ✅ 0.77621 1.63342
Yices2 Yices2-Main default unsat ✅ 0.02479 0.02387
Z3 z3-4.5.0 default unsat ✅ 0.98809 0.98726
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 0.15692 0.15686
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 1.40688 1.40708
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 0.49323 0.49403
MinkeyRink Minkeyrink MT_mt unsat ✅ 0.26082 0.34024
Minkeyrink ST_st unsat ✅ 0.24829 0.24858
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 0.44715 0.44723
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 0.49154 0.73183
STP-Riss-st-2018_riss-no-stderr unsat ✅ 1.39779 1.39786
Yices2 Yices 2.6.0_default unsat ✅ 0.02495 0.02491
Z3 z3-4.7.1_default unsat ✅ 0.42384 0.42356
SMT-COMP 2020 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.20514 0.20503
Boolector Boolector-wrapped-sq_default unsat ✅ 0.20594 0.20596
Poolector-wrapped-sq_default unsat ✅ 0.28370 0.21450
CVC4 CVC4-sq-final_default unsat ✅ 0.50688 0.50705
LazyBV2Int LazyBV2Int20200523_default.sh unsat ✅ 17.21470 17.21190
MathSAT MathSAT5_default.sh unsat ✅ 0.16271 0.16265
MinkeyRink MinkeyRink Solver 2020.3.1_default unknown ❌ 0.24712 0.24737
MinkeyRink Solver 2020.3_default unsat ✅ 0.27146 0.35709
STP STP_default unsat ✅ 0.20699 0.27170
STP ++ Mergsat v1_default unsat ✅ 0.18366 0.18537
Yices2 Yices 2.6.2 bug fix_default unsat ✅ 0.04217 0.04213
Z3 z3-4.8.8_default unsat ✅ 0.48227 0.48220
SMT-COMP 2021 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.23927 0.23922
MathSAT mathsat-5.6.6_default unsat ✅ 0.17356 0.17352
STP STP 2021.0_default unsat ✅ 0.20516 0.25960
Z3 z3-4.8.11_default unsat ✅ 0.52469 0.52457
SMT-COMP 2025 Bitwuzla Bitwuzla unsat ✅ 0.32181 0.20708
Bitwuzla-MachBV-base unsat ✅ 0.36875 0.24661
Bitwuzla-MachBV Bitwuzla-MachBV unsat ✅ 0.50368 0.38308
BVDecide bv_decide unsat ✅ 6.95530 6.80939
bv_decide-nokernel unsat ✅ 3.73168 3.58737
cvc5 cvc5 unsat ✅ 0.57469 0.45017
SMTInterpol SMTInterpol unsat ✅ 357.45398 381.97621
Yices2 Yices2 unsat ✅ 0.39723 0.27985
Z3alpha Z3-alpha unsat ✅ 0.55086 0.81963
Z3 Z3-alpha-base unsat ✅ 1.25287 1.11942
Z3-Owl-base unsat ✅ 4.08087 3.95963
z3siri-base unsat ✅ 1.20811 1.08696
Z3-Owl Z3-Owl unsat ✅ 6.01956 5.89959