Benchmark

non-incremental/QF_BV/sage/app7/bench_3213.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation)
 For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size4353186
Compressed Size270908
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 4353178
Compressed Size270894
Max. Term Depth16596
Asserts 1
Declared Functions0
Declared Constants45
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 ite11 not2556 and1
=3328 let16510 extract1711 bvand45244
bvor29875 bvxor2276 bvadd48469 bvmul7
bvsub15989 bvsdiv19 bvult604 bvule626
bvslt219 bvsle124 bvshl15680 bvashr29512
zero_extend1515

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 4Simp 4Simp-SMT-COMP-2012 default unsat ✅ 0.69430 —
Abziz abziz_portfolio_2011_minfeatures_2 default unsat ✅ 0.97313 —
abziz_portfolio_2011_solvers_2 default unsat ✅ 0.96783 —
abziz_portfolio_2012_minfeatures default unsat ✅ 0.97635 —
abziz_portfolio_2012_solvers default unsat ✅ 0.97515 —
AbzizPortfolio-SMT-COMP-2012 default unsat ✅ 0.96715 —
Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 0.93670 —
Boolector-SMT-COMP-2011 default unsat ✅ 1.06727 —
Boolector-SMT-COMP-2012 default unsat ✅ 0.97973 —
CVC3 CVC3-SMT-COMP-2010 default unsat ✅ 595.10900 —
CVC3-SMT-COMP-2011 default unsat ✅ 493.66200 —
CVC3-SMT-COMP-2012 default unsat ✅ 514.37300 —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 3.57698 —
CVC4-SMT-EVAL-2013 default unsat ✅ 5.49361 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 1.27992 —
MathSAT5-HeavyBV-SMT-COMP-2012 default unsat ✅ 1.23188 —
MathSAT5-SMT-COMP-2011 default unsat ✅ 1.61364 —
MathSAT5-SMT-COMP-2012 default unsat ✅ 1.60188 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unsat ✅ 1.12372 —
SONOLAR-SMT-COMP-2010 default unsat ✅ 5.48204 —
SONOLAR-SMT-COMP-2011 default unsat ✅ 8.09664 —
SONOLAR-SMT-COMP-2012 default unsat ✅ 1.83227 —
STP STP2-SMT-COMP-2011 default unsat ✅ 0.74075 —
STP2-SMT-COMP-2012 default unsat ✅ 0.70283 —
simplifyingSTP-SMT-COMP-2010 default unsat ✅ 0.74729 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 0.99922 —
Z3-SMT-COMP-2011 default unsat ✅ 0.97166 —
SMT-COMP 2017 Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 1.16562 1.16552
Boolector SMT17 final boolector unsat ✅ 1.16631 1.16496
CVC4 CVC4-smtcomp2017-main default unsat ✅ 5.64353 8.96039
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.82709 0.82633
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 1.66619 1.66615
Q3B Q3B default unsat ✅ 1.09512 2.72000
STP stp_st default unsat ✅ 0.79997 0.79889
stp_mt default unsat ✅ 0.80099 0.80086
Yices2 Yices2-Main default unsat ✅ 0.26806 0.26722
Z3 z3-4.5.0 default unsat ✅ 0.83596 0.83530
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 1.13671 1.13669
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 5.24084 5.24082
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 0.81470 0.81567
MinkeyRink Minkeyrink MT_mt unsat ✅ 1.69515 1.69513
Minkeyrink ST_st unsat ✅ 1.69856 1.69853
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 0.81561 0.81569
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 0.81004 0.81013
STP-Riss-st-2018_riss-no-stderr unsat ✅ 0.81463 0.81452
Yices2 Yices 2.6.0_default unsat ✅ 0.25408 0.25399
Z3 z3-4.7.1_default unsat ✅ 0.94275 0.94264
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default unsat ✅ 2.08520 2.08495
Poolector-wrapped-sq_default unsat ✅ 2.41205 9.11619
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default unsat ✅ 1.68399 1.68385
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 5.50041 5.49990
MinkeyRink MinkeyRink MT-wrapped-sq_default unsat ✅ 1.16278 1.16283
MinkeyRink ST-wrapped-sq_default unsat ✅ 1.16012 1.16004
Par4 Par4-wrapped-sq_default unsat ✅ 0.27343 0.00588
STP STP-2019-wrapped-sq_default unsat ✅ 0.81232 0.81255
stp-mergesat-fixed-wrapped-sq_default unsat ✅ 0.80332 0.80342
stp-minisat-wrapped-sq_default unsat ✅ 0.85571 0.85589
stp-mt-wrapped-sq_default unsat ✅ 0.81297 0.81312
stp-portfolio-fixed-wrapped-sq_default unsat ✅ 0.80034 0.80044
stp-riss-wrapped-sq_default unsat ✅ 0.81516 0.81533
Yices2 Yices 2.6.2-wrapped-sq_default unsat ✅ 0.26347 0.26348
Yices 2.6.2 Cadical-wrapped-sq_default unsat ✅ 0.26275 0.26274
Yices 2.6.2 Cryptominisat-wrapped-sq_default unsat ✅ 0.26262 0.26260
Yices 2.6.2 MCSAT BV-wrapped-sq_default unsat ✅ 0.25926 0.25927
Yices 2.6.2 new bvsolver-wrapped-sq_default unsat ✅ 0.26508 0.26506
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 0.70092 0.70086
SMT-COMP 2020 Bitwuzla Bitwuzla-fixed_default unsat ✅ 1.67150 1.67148
Boolector Boolector-wrapped-sq_default unsat ✅ 2.09377 2.09320
Poolector-wrapped-sq_default unsat ✅ 2.48308 9.37577
CVC4 CVC4-sq-final_default unsat ✅ 7.08837 7.08768
LazyBV2Int LazyBV2Int20200523_default.sh unsat ✅ 1.02851 1.02854
MathSAT MathSAT5_default.sh unsat ✅ 0.83038 0.83029
MinkeyRink MinkeyRink Solver 2020.3.1_default unsat ✅ 0.95674 0.95682
MinkeyRink Solver 2020.3_default unsat ✅ 0.99539 0.99545
STP STP_default unsat ✅ 0.77268 0.77267
STP ++ Mergsat v1_default unsat ✅ 0.75378 0.75542
Yices2 Yices 2.6.2 bug fix_default unsat ✅ 0.31184 0.31177
Z3 z3-4.8.8_default unsat ✅ 0.79369 0.79360
SMT-COMP 2022 Bitwuzla Bitwuzla-fixed_default unsat ✅ 1.68573 1.68197
Bitwuzla-wrapped_default unsat ✅ 1.83023 1.82995
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 5.64202 5.64194
MathSAT MathSAT-5.6.8_default unsat ✅ 0.86040 0.86029
STP STP 2022.4_default unsat ✅ 0.86646 0.86543
Yices2 Yices 2.6.2 for SMTCOMP 2021_default unsat ✅ 0.30826 0.30817
Z3++BV z3++bv_0702_default unsat ✅ 0.52024 0.52005
Z3 z3-4.8.17_default unsat ✅ 0.57725 0.57578
SMT-COMP 2023 0.17 (5/6) Bitwuzla Bitwuzla-fixed_default unsat ✅ 2.53250 2.52947
cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 4.18864 4.18381
STP STP 2022.4_default unsat ✅ 0.82999 0.82994
STP 2022.4_default unsat ✅ 0.83001 0.83007
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unknown ❌ 1200.04000 1327.42000
Yices2 Yices 2 for SMTCOMP 2023_default unsat ✅ 0.29815 0.29809
Z3-Owl z3-Owl-Final_default unsat ✅ 1.16589 1.16592
z3-Owl-Final_default unsat ✅ 1.18428 1.18451
SMT-COMP 2024 0.17 (5/6) Bitwuzla Bitwuzla unsat ✅ 1.49321 1.39330
cvc5 cvc5 unsat ✅ 2.07839 1.97845
SMTInterpol SMTInterpol unknown ❌ 1202.74931 1427.98175
STP STP unsat ✅ 59.37917 59.26064
Yices2 Yices2 unsat ✅ 0.41422 0.31436
Z3alpha Z3-alpha unsat ✅ 0.61590 0.51585