Benchmark

non-incremental/QF_BV/sage/app11/bench_499.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation)
 For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size1529280
Compressed Size151038
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 1529272
Compressed Size151047
Max. Term Depth4209
Asserts 1
Declared Functions0
Declared Constants8425
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true2 false1 ite92 not1274
and1 =2058 let2876 extract1482
bvand959 bvor272 bvxor2275 bvadd14619
bvmul1181 bvsdiv16 bvult1095 bvule1499
bvslt122 bvsle163 bvshl8906 bvashr13273
zero_extend10172

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 4Simp 4Simp-SMT-COMP-2012 default unsat ✅ 0.15965 —
Abziz abziz_portfolio_2011_minfeatures_2 default unsat ✅ 0.40632 —
abziz_portfolio_2011_solvers_2 default unsat ✅ 0.41268 —
abziz_portfolio_2012_minfeatures default unsat ✅ 0.40880 —
abziz_portfolio_2012_solvers default unsat ✅ 0.40792 —
AbzizPortfolio-SMT-COMP-2012 default unsat ✅ 0.40847 —
Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 0.22250 —
Boolector-SMT-COMP-2011 default unsat ✅ 0.29928 —
Boolector-SMT-COMP-2012 default unsat ✅ 0.23735 —
CVC3 CVC3-SMT-COMP-2010 default unsat ✅ 30.84260 —
CVC3-SMT-COMP-2011 default unsat ✅ 26.22000 —
CVC3-SMT-COMP-2012 default unsat ✅ 27.26980 —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 1.69455 —
CVC4-SMT-EVAL-2013 default unsat ✅ 13.55340 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 0.45781 —
MathSAT5-HeavyBV-SMT-COMP-2012 default unsat ✅ 0.44811 —
MathSAT5-SMT-COMP-2011 default unsat ✅ 23.27550 —
MathSAT5-SMT-COMP-2012 default unsat ✅ 0.54566 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unsat ✅ 0.46665 —
SONOLAR-SMT-COMP-2010 default unsat ✅ 7.93579 —
SONOLAR-SMT-COMP-2011 default unsat ✅ 0.80819 —
SONOLAR-SMT-COMP-2012 default unsat ✅ 0.54441 —
STP STP2-SMT-COMP-2011 default unsat ✅ 1.09635 —
STP2-SMT-COMP-2012 default unsat ✅ 0.16449 —
simplifyingSTP-SMT-COMP-2010 default unsat ✅ 0.25419 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 0.44379 —
Z3-SMT-COMP-2011 default unsat ✅ 0.40179 —
SMT-COMP 2017 Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 0.32113 0.31955
Boolector SMT17 final boolector unsat ✅ 0.34846 0.34785
CVC4 CVC4-smtcomp2017-main default unsat ✅ 3.59642 6.42296
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.30518 0.30402
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 0.68956 0.68626
Q3B Q3B default unsat ✅ 21.55730 64.13000
STP stp_st default unsat ✅ 12.76720 12.76550
stp_mt default unsat ✅ 12.77980 12.77750
Yices2 Yices2-Main default unsat ✅ 0.13558 0.13393
Z3 z3-4.5.0 default unsat ✅ 0.27608 0.27520
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 0.29397 0.29368
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 3.31359 3.31357
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 0.31101 0.31200
MinkeyRink Minkeyrink MT_mt unsat ✅ 0.68236 0.68246
Minkeyrink ST_st unsat ✅ 0.68366 0.68369
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 6.54721 6.54689
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 6.53573 6.53231
STP-Riss-st-2018_riss-no-stderr unsat ✅ 6.51671 6.51645
Yices2 Yices 2.6.0_default unsat ✅ 0.12087 0.12080
Z3 z3-4.7.1_default unsat ✅ 0.34168 0.34134
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default unsat ✅ 0.57909 0.57907
Poolector-wrapped-sq_default unsat ✅ 0.79647 2.84996
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default unsat ✅ 0.50550 0.50548
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 3.51947 3.51997
MinkeyRink MinkeyRink MT-wrapped-sq_default unsat ✅ 1.35614 1.35619
MinkeyRink ST-wrapped-sq_default unsat ✅ 1.35765 1.35767
Par4 Par4-wrapped-sq_default unsat ✅ 0.13168 0.00604
STP STP-2019-wrapped-sq_default unsat ✅ 12.58420 12.58100
stp-mergesat-fixed-wrapped-sq_default unsat ✅ 12.59620 12.59120
stp-minisat-wrapped-sq_default unsat ✅ 12.57860 12.57720
stp-mt-wrapped-sq_default unsat ✅ 12.56810 12.56590
stp-portfolio-fixed-wrapped-sq_default unsat ✅ 12.55730 12.55740
stp-riss-wrapped-sq_default unsat ✅ 12.58030 12.57710
Yices2 Yices 2.6.2-wrapped-sq_default unsat ✅ 0.12713 0.12712
Yices 2.6.2 Cadical-wrapped-sq_default unsat ✅ 0.12856 0.12853
Yices 2.6.2 Cryptominisat-wrapped-sq_default unsat ✅ 0.12586 0.12589
Yices 2.6.2 MCSAT BV-wrapped-sq_default unsat ✅ 0.12544 0.12539
Yices 2.6.2 new bvsolver-wrapped-sq_default unsat ✅ 0.12658 0.12641
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 0.26053 0.26052
SMT-COMP 2020 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.41749 0.41747
Boolector Boolector-wrapped-sq_default unsat ✅ 0.64295 0.63968
Poolector-wrapped-sq_default unsat ✅ 0.77852 2.81791
CVC4 CVC4-sq-final_default unsat ✅ 3.85363 3.84706
LazyBV2Int LazyBV2Int20200523_default.sh unsat ✅ 87.12460 87.05790
MathSAT MathSAT5_default.sh unsat ✅ 0.32588 0.32571
MinkeyRink MinkeyRink Solver 2020.3.1_default unsat ✅ 1.05026 1.05027
MinkeyRink Solver 2020.3_default unsat ✅ 1.11226 1.11226
STP STP_default unsat ✅ 10.65970 10.65940
STP ++ Mergsat v1_default unsat ✅ 11.23000 11.23060
Yices2 Yices 2.6.2 bug fix_default unsat ✅ 0.13801 0.13792
Z3 z3-4.8.8_default unsat ✅ 0.20245 0.20236
SMT-COMP 2021 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.42435 0.42416
MathSAT mathsat-5.6.6_default unsat ✅ 0.30724 0.30722
STP STP 2021.0_default unsat ✅ 16.96320 16.96350
Z3 z3-4.8.11_default unsat ✅ 0.31574 0.31570
SMT-COMP 2022 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.41520 0.41513
Bitwuzla-wrapped_default unsat ✅ 0.44692 0.44675
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 4.45934 4.45412
MathSAT MathSAT-5.6.8_default unsat ✅ 0.32427 0.32270
STP STP 2022.4_default unsat ✅ 0.19239 0.19241
Yices2 Yices 2.6.2 for SMTCOMP 2021_default unsat ✅ 0.13805 0.13799
Z3++BV z3++bv_0702_default unsat ✅ 0.24986 0.24975
Z3 z3-4.8.17_default unsat ✅ 0.24511 0.24684
SMT-COMP 2023 0.17 (5/6) Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.57524 0.57501
cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 3.34620 3.34397
STP STP 2022.4_default unsat ✅ 0.18982 0.18979
STP 2022.4_default unsat ✅ 0.19848 0.19848
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unknown ❌ 1200.03000 1236.88000
Yices2 Yices 2 for SMTCOMP 2023_default unsat ✅ 0.13406 0.13400
Z3-Owl z3-Owl-Final_default unsat ✅ 0.91929 0.91923
z3-Owl-Final_default unsat ✅ 0.93525 0.93552
SMT-COMP 2025 0.22 (7/9) Bitwuzla Bitwuzla unsat ✅ 1.10916 0.98080
Bitwuzla-MachBV-base unsat ✅ 3.02225 2.88831
Bitwuzla-MachBV Bitwuzla-MachBV unsat ✅ 2.98983 2.86492
BVDecide bv_decide unknown ❌ 1201.44482 1201.01520
bv_decide-nokernel unknown ❌ 1201.38663 1200.97320
cvc5 cvc5 unsat ✅ 0.90286 0.78241
SMTInterpol SMTInterpol unknown ❌ 1201.89433 2842.73469
Yices2 Yices2 unsat ✅ 0.32397 0.21037
Z3alpha Z3-alpha unsat ✅ 0.62526 0.53996
Z3 Z3-alpha-base unsat ✅ 0.49348 0.36530
Z3-Owl-base unsat ✅ 1.30887 1.18945
z3siri-base unsat ✅ 0.45005 0.33160
Z3-Owl Z3-Owl unsat ✅ 0.95770 0.83351