Benchmark

non-incremental/QF_BV/sage/app7/bench_69.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation)
 For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size3331392
Compressed Size210826
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 3331384
Compressed Size210833
Max. Term Depth12801
Asserts 1
Declared Functions0
Declared Constants42
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 ite10 not2213 and1
=2908 let12696 extract1617 bvand34146
bvor22407 bvxor2082 bvadd36763 bvmul4
bvsub11941 bvsdiv10 bvult518 bvule561
bvslt214 bvsle122 bvshl11740 bvashr22016
zero_extend1398

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 4Simp 4Simp-SMT-COMP-2012 default unsat ✅ 0.49701 —
Abziz abziz_portfolio_2011_minfeatures_2 default unsat ✅ 0.50724 —
abziz_portfolio_2011_solvers_2 default unsat ✅ 0.49768 —
abziz_portfolio_2012_minfeatures default unsat ✅ 0.50884 —
abziz_portfolio_2012_solvers default unsat ✅ 0.49733 —
AbzizPortfolio-SMT-COMP-2012 default unsat ✅ 0.50006 —
Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 0.66548 —
Boolector-SMT-COMP-2011 default unsat ✅ 0.79692 —
Boolector-SMT-COMP-2012 default unsat ✅ 0.69987 —
CVC3 CVC3-SMT-COMP-2010 default unsat ✅ 173.60600 —
CVC3-SMT-COMP-2011 default unsat ✅ 146.79500 —
CVC3-SMT-COMP-2012 default unsat ✅ 153.59700 —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 2.85644 —
CVC4-SMT-EVAL-2013 default unsat ✅ 4.55382 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 0.99784 —
MathSAT5-HeavyBV-SMT-COMP-2012 default unsat ✅ 0.95617 —
MathSAT5-SMT-COMP-2011 default unsat ✅ 1.23105 —
MathSAT5-SMT-COMP-2012 default unsat ✅ 1.20376 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unsat ✅ 0.87733 —
SONOLAR-SMT-COMP-2010 default unsat ✅ 4.04175 —
SONOLAR-SMT-COMP-2011 default unsat ✅ 6.17441 —
SONOLAR-SMT-COMP-2012 default unsat ✅ 1.34834 —
STP STP2-SMT-COMP-2011 default unsat ✅ 0.53035 —
STP2-SMT-COMP-2012 default unsat ✅ 0.49684 —
simplifyingSTP-SMT-COMP-2010 default unsat ✅ 0.52658 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 0.54865 —
Z3-SMT-COMP-2011 default unsat ✅ 0.49816 —
SMT-COMP 2017 Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 0.87162 0.87042
Boolector SMT17 final boolector unsat ✅ 0.87720 0.87644
CVC4 CVC4-smtcomp2017-main default unsat ✅ 4.28087 6.87361
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.64314 0.64299
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 1.26119 1.26051
Q3B Q3B default unsat ✅ 0.83871 2.17000
STP stp_st default unsat ✅ 0.56710 0.56640
stp_mt default unsat ✅ 0.56382 0.56332
Yices2 Yices2-Main default unsat ✅ 0.36582 0.36378
Z3 z3-4.5.0 default unsat ✅ 0.69695 0.69558
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 0.78788 0.78762
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 3.95628 3.95658
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 0.63528 0.63625
MinkeyRink Minkeyrink MT_mt unsat ✅ 1.27135 1.27131
Minkeyrink ST_st unsat ✅ 1.27019 1.27019
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 0.57514 0.57502
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 0.57689 0.57687
STP-Riss-st-2018_riss-no-stderr unsat ✅ 0.57719 0.57723
Yices2 Yices 2.6.0_default unsat ✅ 0.37014 0.37009
Z3 z3-4.7.1_default unsat ✅ 0.80912 0.80888
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default unsat ✅ 1.50463 1.50446
Poolector-wrapped-sq_default unsat ✅ 1.79111 6.72354
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default unsat ✅ 1.21950 1.21937
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 4.16351 4.16379
MinkeyRink MinkeyRink MT-wrapped-sq_default unsat ✅ 0.90173 0.90159
MinkeyRink ST-wrapped-sq_default unsat ✅ 0.90296 0.90305
Par4 Par4-wrapped-sq_default unsat ✅ 0.38579 0.00599
STP STP-2019-wrapped-sq_default unsat ✅ 0.59091 0.59106
stp-mergesat-fixed-wrapped-sq_default unsat ✅ 0.60287 0.60304
stp-minisat-wrapped-sq_default unsat ✅ 0.59191 0.59202
stp-mt-wrapped-sq_default unsat ✅ 0.59052 0.59070
stp-portfolio-fixed-wrapped-sq_default unsat ✅ 0.59680 0.59695
stp-riss-wrapped-sq_default unsat ✅ 0.59473 0.59484
Yices2 Yices 2.6.2-wrapped-sq_default unsat ✅ 0.34617 0.34618
Yices 2.6.2 Cadical-wrapped-sq_default unsat ✅ 0.34607 0.34601
Yices 2.6.2 Cryptominisat-wrapped-sq_default unsat ✅ 0.34655 0.34651
Yices 2.6.2 MCSAT BV-wrapped-sq_default unsat ✅ 0.33774 0.33771
Yices 2.6.2 new bvsolver-wrapped-sq_default unsat ✅ 0.35050 0.35048
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 0.58357 0.58248
SMT-COMP 2021 Bitwuzla Bitwuzla-fixed_default unsat ✅ 1.24371 1.24369
MathSAT mathsat-5.6.6_default unsat ✅ 0.67003 0.66996
STP STP 2021.0_default unsat ✅ 0.56704 0.56714
Z3 z3-4.8.11_default unsat ✅ 0.54588 0.54580
SMT-COMP 2023 0.17 (5/6) Bitwuzla Bitwuzla-fixed_default unsat ✅ 1.93420 1.92894
cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 3.04650 3.04173
STP STP 2022.4_default unsat ✅ 0.60401 0.60399
STP 2022.4_default unsat ✅ 0.61455 0.61444
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unknown ❌ 1200.05000 1314.04000
Yices2 Yices 2 for SMTCOMP 2023_default unsat ✅ 0.37273 0.37268
Z3-Owl z3-Owl-Final_default unsat ✅ 1.37656 1.37662
z3-Owl-Final_default unsat ✅ 1.41232 1.41044