Benchmark

non-incremental/QF_BV/sage/app1/bench_349.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation)
 For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size56294
Compressed Size7325
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status sat
Inferred Status unsat
Size 56286
Compressed Size7340
Max. Term Depth96
Asserts 1
Declared Functions0
Declared Constants285
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 ite41 not65 and1
=161 let86 extract1 bvand26
bvor171 bvadd296 bvmul5 bvsub128
bvult156 bvule357 bvslt1 bvsle12
bvshl172 bvashr5 zero_extend269

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 0.11 (8/9) 4Simp 4Simp-SMT-COMP-2012 default unsat ✅ 0.82512 —
Abziz abziz_portfolio_2011_minfeatures_2 default unsat ✅ 3.30630 —
abziz_portfolio_2011_solvers_2 default unsat ✅ 3.44097 —
abziz_portfolio_2012_minfeatures default unsat ✅ 3.22025 —
abziz_portfolio_2012_solvers default unsat ✅ 3.43816 —
AbzizPortfolio-SMT-COMP-2012 default unsat ✅ 3.29995 —
Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 0.21030 —
Boolector-SMT-COMP-2011 default unsat ✅ 3.53950 —
Boolector-SMT-COMP-2012 default unsat ✅ 0.09364 —
CVC3 CVC3-SMT-COMP-2010 default unknown ❌ — —
CVC3-SMT-COMP-2011 default unknown ❌ — —
CVC3-SMT-COMP-2012 default unknown ❌ — —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 1.23595 —
CVC4-SMT-EVAL-2013 default unsat ✅ 1.16014 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 0.76579 —
MathSAT5-HeavyBV-SMT-COMP-2012 default unsat ✅ 1.69092 —
MathSAT5-SMT-COMP-2011 default unsat ✅ 0.29922 —
MathSAT5-SMT-COMP-2012 default unsat ✅ 0.29857 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unsat ✅ 1.21709 —
SONOLAR-SMT-COMP-2010 default unsat ✅ 1.36140 —
SONOLAR-SMT-COMP-2011 default unsat ✅ 1.13562 —
SONOLAR-SMT-COMP-2012 default unsat ✅ 0.70242 —
STP STP2-SMT-COMP-2011 default unsat ✅ 2.91041 —
STP2-SMT-COMP-2012 default unsat ✅ 1.43098 —
simplifyingSTP-SMT-COMP-2010 default unsat ✅ 5.85067 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 3.91280 —
Z3-SMT-COMP-2011 default unsat ✅ 3.35150 —
SMT-COMP 2015 Boolector Boolector SMT15 QF_BV final boolector_qf_bv sat ✅ 2.46271 2.46263
CVC4 CVC4-master-2015-06-15-9b32405-main default sat ✅ 3.29252 6.55100
CVC4-experimental-2015-06-15-ff5745a-main default sat ✅ 3.22960 6.43002
MathSAT MathSat 5.3.6 main smtcomp2015_main sat ✅ 1.88026 1.87971
SMT-RAT SMT-RAT-final default sat ✅ 261.83000 261.88500
STP stp-cryptominisat4 default sat ✅ 11.67950 11.68320
stp-cmsat4-v15 default sat ✅ 11.68840 11.69220
stp-cmsat4-mt-v15 default unknown ❌ 0.39594 0.39494
stp-minisat-v15 default sat ✅ 3.67511 3.67444
Yices2 Yices default sat ✅ 0.05464 0.05399
Z3 z3 4.4.0 default sat ✅ 6.78939 6.79197
SMT-COMP 2016 0.10 (9/10) ABC ABC_default default_abc sat ✅ 0.67545 0.67560
ABC_glucose glucose sat ✅ 7.93715 7.94131
Boolector Boolector boolector sat ✅ 1.58234 1.58316
Boolector preprop boolector sat ✅ 1.58282 1.58379
CVC4 CVC4-master-2016-05-27-cfef263-main default sat ✅ 5.29761 10.58330
MapleSTP MapleSTP default sat ✅ 3.78011 3.78235
MapleSTP-mt default sat ✅ 2.12602 7.22815
MathSAT mathsat-5.3.11-linux-x86_64-Main default sat ✅ 2.16101 2.16297
MinkeyRink Minkeyrink 2016 default sat ✅ 2.03169 3.80517
Q3B Q3B default unknown ❌ 2400.03000 7204.40000
STP stp-cms-exp-2016 default sat ✅ 70.55380 70.59420
stp-cms-mt-2016 default sat ✅ 11.04690 42.81690
stp-cms-st-2016 default sat ✅ 16.17750 16.18820
stp-minisat-st-2016 default sat ✅ 28.41760 28.43190
Yices2 Yices-2.4.2 default sat ✅ 0.03914 0.03901
Z3 z3-4.4.1 default sat ✅ 3.52060 3.52392
SMT-COMP 2017 0.12 (7/8) Boolector Boolector+CaDiCaL SMT17 final boolector sat ✅ 0.37751 0.37569
Boolector SMT17 final boolector sat ✅ 1.68945 1.68833
CVC4 CVC4-smtcomp2017-main default sat ✅ 2.94925 5.86434
MathSAT mathsat-5.4.1-linux-x86_64-Main default sat ✅ 1.44207 1.44184
MinkeyRink MinkeyRink 2017.3a default sat ✅ 0.87636 0.87152
Q3B Q3B default unknown ❌ 600.02400 1799.54000
STP stp_st default sat ✅ 4.18167 4.18160
stp_mt default sat ✅ 3.90836 14.05400
Yices2 Yices2-Main default sat ✅ 0.04379 0.04282
Z3 z3-4.5.0 default sat ✅ 5.25747 5.25180
SMT-COMP 2018 Boolector Boolector_default sat ✅ 0.27032 0.27027
CVC4 master-2018-06-10-b19c840-competition-default_default sat ✅ 5.12161 5.12163
MathSAT mathsat-5.5.2-linux-x86_64-Main_default sat ✅ 1.66401 1.66516
MinkeyRink Minkeyrink MT_mt sat ✅ 0.68161 1.89840
Minkeyrink ST_st sat ✅ 0.62321 0.62296
STP STP-CMS-st-2018_default-no-stderr sat ✅ 11.87470 11.87390
STP-CMS-mt-2018_multicore-no-stderr sat ✅ 4.25401 15.53200
STP-Riss-st-2018_riss-no-stderr sat ✅ 6.13727 6.13731
Yices2 Yices 2.6.0_default sat ✅ 0.04639 0.04629
Z3 z3-4.7.1_default sat ✅ 7.09728 7.09709
SMT-COMP 2020 0.11 (8/9) Bitwuzla Bitwuzla-fixed_default sat ✅ 0.37154 0.36741
Boolector Boolector-wrapped-sq_default sat ✅ 0.41192 0.41191
Poolector-wrapped-sq_default sat ✅ 0.59030 1.00000
CVC4 CVC4-sq-final_default sat ✅ 3.05921 3.05932
LazyBV2Int LazyBV2Int20200523_default.sh unknown ❌ 1200.02000 1199.75000
MathSAT MathSAT5_default.sh sat ✅ 0.39672 0.39670
MinkeyRink MinkeyRink Solver 2020.3.1_default unknown ❌ 0.26704 0.26714
MinkeyRink Solver 2020.3_default sat ✅ 0.29189 0.37066
STP STP_default sat ✅ 0.30715 0.60701
STP ++ Mergsat v1_default sat ✅ 0.39308 0.39480
Yices2 Yices 2.6.2 bug fix_default sat ✅ 0.43708 0.43695
Z3 z3-4.8.8_default sat ✅ 6.74991 6.74924
SMT-COMP 2021 Bitwuzla Bitwuzla-fixed_default sat ✅ 0.39053 0.39050
MathSAT mathsat-5.6.6_default sat ✅ 0.25644 0.25640
STP STP 2021.0_default sat ✅ 0.41151 0.98393
Z3 z3-4.8.11_default sat ✅ 1.93558 1.93549
SMT-COMP 2025 0.11 (8/9) Bitwuzla Bitwuzla sat ✅ 0.45742 0.33017
Bitwuzla-MachBV-base sat ✅ 0.43406 0.31619
Bitwuzla-MachBV Bitwuzla-MachBV sat ✅ 0.81220 0.68149
BVDecide bv_decide sat ✅ 5.15029 4.98013
bv_decide-nokernel sat ✅ 4.64247 4.52308
cvc5 cvc5 sat ✅ 2.29068 2.17248
SMTInterpol SMTInterpol unknown ❌ 1201.58994 1227.73050
Yices2 Yices2 sat ✅ 0.51182 0.37926
Z3alpha Z3-alpha sat ✅ 5.30701 18.29829
Z3 Z3-alpha-base sat ✅ 3.13910 3.01450
Z3-Owl-base sat ✅ 12.38063 12.26236
z3siri-base sat ✅ 3.24820 3.12418
Z3-Owl Z3-Owl sat ✅ 7.46873 7.33648