Benchmark

non-incremental/QF_BV/sage/app7/bench_916.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation)
 For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size2648346
Compressed Size169157
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 2648338
Compressed Size169162
Max. Term Depth10177
Asserts 1
Declared Functions0
Declared Constants42
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 ite10 not1807 and1
=2423 let10078 extract1319 bvand27356
bvor17972 bvxor1578 bvadd29156 bvmul1
bvsub9438 bvult445 bvule490 bvslt207
bvsle104 bvshl9268 bvashr17509 zero_extend1040

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 4Simp 4Simp-SMT-COMP-2012 default unsat ✅ 0.39472 —
Abziz abziz_portfolio_2011_minfeatures_2 default unsat ✅ 0.38322 —
abziz_portfolio_2011_solvers_2 default unsat ✅ 0.39157 —
abziz_portfolio_2012_minfeatures default unsat ✅ 0.38511 —
abziz_portfolio_2012_solvers default unsat ✅ 0.38892 —
AbzizPortfolio-SMT-COMP-2012 default unsat ✅ 0.38880 —
Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 0.53439 —
Boolector-SMT-COMP-2011 default unsat ✅ 0.62802 —
Boolector-SMT-COMP-2012 default unsat ✅ 0.56426 —
CVC3 CVC3-SMT-COMP-2010 default unsat ✅ 130.84300 —
CVC3-SMT-COMP-2011 default unsat ✅ 110.60800 —
CVC3-SMT-COMP-2012 default unsat ✅ 115.77700 —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 2.15545 —
CVC4-SMT-EVAL-2013 default unsat ✅ 3.40720 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 0.80002 —
MathSAT5-HeavyBV-SMT-COMP-2012 default unsat ✅ 0.77398 —
MathSAT5-SMT-COMP-2011 default unsat ✅ 0.99403 —
MathSAT5-SMT-COMP-2012 default unsat ✅ 0.97342 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unsat ✅ 0.68980 —
SONOLAR-SMT-COMP-2010 default unsat ✅ 3.29914 —
SONOLAR-SMT-COMP-2011 default unsat ✅ 4.94520 —
SONOLAR-SMT-COMP-2012 default unsat ✅ 1.07740 —
STP STP2-SMT-COMP-2011 default unsat ✅ 0.41857 —
STP2-SMT-COMP-2012 default unsat ✅ 0.39736 —
simplifyingSTP-SMT-COMP-2010 default unsat ✅ 0.41578 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 0.42007 —
Z3-SMT-COMP-2011 default unsat ✅ 0.37867 —
SMT-COMP 2015 0.14 (6/7) Boolector Boolector SMT15 QF_BV final boolector_qf_bv unsat ✅ 0.77219 0.77188
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 3.47947 5.62714
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 3.46062 5.61315
MathSAT MathSat 5.3.6 main smtcomp2015_main unsat ✅ 0.53790 0.53692
SMT-RAT SMT-RAT-final default unknown ❌ 2400.01000 2400.62000
STP stp-cryptominisat4 default unsat ✅ 0.37703 0.37594
stp-cmsat4-v15 default unsat ✅ 0.37399 0.37294
stp-cmsat4-mt-v15 default unsat ✅ 0.37561 0.37494
stp-minisat-v15 default unsat ✅ 0.37379 0.37294
Yices2 Yices default unsat ✅ 0.15494 0.15398
Z3 z3 4.4.0 default unsat ✅ 0.44647 0.44693
SMT-COMP 2016 ABC ABC_default default_abc unsat ✅ 1.50291 1.50395
ABC_glucose glucose unsat ✅ 1.49123 1.49189
Boolector Boolector boolector unsat ✅ 0.86040 0.86073
Boolector preprop boolector unsat ✅ 0.85089 0.85148
CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 3.40902 5.52280
MapleSTP MapleSTP default unsat ✅ 0.35636 0.35651
MapleSTP-mt default unsat ✅ 0.35690 0.35705
MathSAT mathsat-5.3.11-linux-x86_64-Main default unsat ✅ 0.48397 0.48511
MinkeyRink Minkeyrink 2016 default unsat ✅ 0.48917 0.48934
Q3B Q3B default unsat ✅ 0.72801 1.84000
STP stp-cms-exp-2016 default unsat ✅ 0.37049 0.37065
stp-cms-mt-2016 default unsat ✅ 0.37381 0.37397
stp-cms-st-2016 default unsat ✅ 0.38378 0.38390
stp-minisat-st-2016 default unsat ✅ 0.36967 0.37027
Yices2 Yices-2.4.2 default unsat ✅ 0.15483 0.15487
Z3 z3-4.4.1 default unsat ✅ 0.40208 0.40354
SMT-COMP 2017 Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 0.71964 0.71901
Boolector SMT17 final boolector unsat ✅ 0.73670 0.73460
CVC4 CVC4-smtcomp2017-main default unsat ✅ 3.36725 5.38585
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.49534 0.49550
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 1.03464 1.03395
Q3B Q3B default unsat ✅ 0.69864 1.61000
STP stp_st default unsat ✅ 0.45415 0.45342
stp_mt default unsat ✅ 0.45126 0.45113
Yices2 Yices2-Main default unsat ✅ 0.14738 0.14634
Z3 z3-4.5.0 default unsat ✅ 0.46537 0.46471
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 0.63401 0.63389
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 3.17038 3.17028
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 0.48965 0.48996
MinkeyRink Minkeyrink MT_mt unsat ✅ 1.02837 1.02592
Minkeyrink ST_st unsat ✅ 1.02619 1.02402
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 0.47294 0.47293
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 0.47340 0.47342
STP-Riss-st-2018_riss-no-stderr unsat ✅ 0.45904 0.45903
Yices2 Yices 2.6.0_default unsat ✅ 0.13905 0.13899
Z3 z3-4.7.1_default unsat ✅ 0.48689 0.48677
SMT-COMP 2020 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.98095 0.98077
Boolector Boolector-wrapped-sq_default unsat ✅ 1.18314 1.18313
Poolector-wrapped-sq_default unsat ✅ 1.48101 5.37027
CVC4 CVC4-sq-final_default unsat ✅ 4.30466 4.30432
LazyBV2Int LazyBV2Int20200523_default.sh unsat ✅ 0.61483 0.61473
MathSAT MathSAT5_default.sh unsat ✅ 0.50048 0.50040
MinkeyRink MinkeyRink Solver 2020.3.1_default unsat ✅ 0.59575 0.59587
MinkeyRink Solver 2020.3_default unsat ✅ 0.61959 0.61957
STP STP_default unsat ✅ 0.43558 0.43566
STP ++ Mergsat v1_default unsat ✅ 0.43728 0.43900
Yices2 Yices 2.6.2 bug fix_default unsat ✅ 0.17544 0.17542
Z3 z3-4.8.8_default unsat ✅ 0.30390 0.30387
SMT-COMP 2024 0.17 (5/6) Bitwuzla Bitwuzla unsat ✅ 0.92469 0.82432
cvc5 cvc5 unsat ✅ 0.96333 0.86362
SMTInterpol SMTInterpol unknown ❌ 1202.74351 1560.98383
STP STP unsat ✅ 23.44818 23.34241
Yices2 Yices2 unsat ✅ 0.32907 0.22953
Z3alpha Z3-alpha unsat ✅ 0.53653 0.43698
SMT-COMP 2025 0.22 (7/9) Bitwuzla Bitwuzla unsat ✅ 0.77534 0.65671
Bitwuzla-MachBV-base unsat ✅ 0.92596 0.80041
Bitwuzla-MachBV Bitwuzla-MachBV unsat ✅ 1.08371 0.96295
BVDecide bv_decide unknown ❌ 1201.41175 1200.98539
bv_decide-nokernel unknown ❌ 1201.39705 1200.90484
cvc5 cvc5 unsat ✅ 1.05885 0.93278
SMTInterpol SMTInterpol unknown ❌ 1201.88991 2861.30511
Yices2 Yices2 unsat ✅ 0.33401 0.21600
Z3alpha Z3-alpha unsat ✅ 0.87237 0.83787
Z3 Z3-alpha-base unsat ✅ 0.47664 0.35965
Z3-Owl-base unsat ✅ 1.11961 0.99966
z3siri-base unsat ✅ 0.49944 0.37279
Z3-Owl Z3-Owl unsat ✅ 1.00215 0.87636