Benchmark

non-incremental/QF_BV/sage/app7/bench_1847.smt2

Patrice Godefroid, SAGE (systematic dynamic test generation)
 For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size4410425
Compressed Size273707
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 4410417
Compressed Size273716
Max. Term Depth16918
Asserts 1
Declared Functions0
Declared Constants45
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 ite11 not2668 and1
=3446 let16704 extract1712 bvand45648
bvor30092 bvxor2276 bvadd48999 bvmul7
bvsub16090 bvsdiv20 bvult604 bvule628
bvslt219 bvsle124 bvshl15779 bvashr29793
zero_extend1515

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 4Simp 4Simp-SMT-COMP-2012 default unsat ✅ 0.70814
Abziz abziz_portfolio_2011_minfeatures_2 default unsat ✅ 0.70953
abziz_portfolio_2011_solvers_2 default unsat ✅ 0.69103
abziz_portfolio_2012_minfeatures default unsat ✅ 0.69053
abziz_portfolio_2012_solvers default unsat ✅ 0.70035
AbzizPortfolio-SMT-COMP-2012 default unsat ✅ 0.70058
Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 0.95691
Boolector-SMT-COMP-2011 default unsat ✅ 1.05742
Boolector-SMT-COMP-2012 default unsat ✅ 0.99400
CVC3 CVC3-SMT-COMP-2010 default unsat ✅ 241.85400
CVC3-SMT-COMP-2011 default unsat ✅ 204.47500
CVC3-SMT-COMP-2012 default unsat ✅ 213.83200
CVC4 CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 3.60072
CVC4-SMT-EVAL-2013 default unsat ✅ 5.51878
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 1.30402
MathSAT5-HeavyBV-SMT-COMP-2012 default unsat ✅ 1.25347
MathSAT5-SMT-COMP-2011 default unsat ✅ 1.64650
MathSAT5-SMT-COMP-2012 default unsat ✅ 1.60299
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unsat ✅ 1.14358
SONOLAR-SMT-COMP-2010 default unsat ✅ 5.54213
SONOLAR-SMT-COMP-2011 default unsat ✅ 8.16180
SONOLAR-SMT-COMP-2012 default unsat ✅ 1.86840
STP STP2-SMT-COMP-2011 default unsat ✅ 0.74242
STP2-SMT-COMP-2012 default unsat ✅ 0.71520
simplifyingSTP-SMT-COMP-2010 default unsat ✅ 0.77326
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 0.76071
Z3-SMT-COMP-2011 default unsat ✅ 0.70239
SMT-COMP 2017 Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 1.14947 1.14904
Boolector SMT17 final boolector unsat ✅ 1.22028 1.21953
CVC4 CVC4-smtcomp2017-main default unsat ✅ 15.59950 10.19980
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.93471 0.92634
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 2.44650 1.79271
Q3B Q3B default unsat ✅ 1.11492 2.94000
STP stp_st default unsat ✅ 0.80758 0.80642
stp_mt default unsat ✅ 0.80966 0.80907
Yices2 Yices2-Main default unsat ✅ 0.47605 0.47503
Z3 z3-4.5.0 default unsat ✅ 0.87345 0.87248
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 1.04505 1.04490
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 5.27420 5.27372
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 0.83390 0.83481
MinkeyRink Minkeyrink MT_mt unsat ✅ 1.69765 1.69775
Minkeyrink ST_st unsat ✅ 1.69817 1.69816
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 0.82187 0.82182
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 0.82413 0.82408
STP-Riss-st-2018_riss-no-stderr unsat ✅ 0.82333 0.82331
Yices2 Yices 2.6.0_default unsat ✅ 0.47963 0.47956
Z3 z3-4.7.1_default unsat ✅ 1.07198 1.07184
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default unsat ✅ 2.01487 2.01302
Poolector-wrapped-sq_default unsat ✅ 2.40029 9.00265
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default unsat ✅ 1.63510 1.63498
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 5.58208 5.58196
MinkeyRink MinkeyRink MT-wrapped-sq_default unsat ✅ 1.14696 1.14720
MinkeyRink ST-wrapped-sq_default unsat ✅ 1.14693 1.14626
Par4 Par4-wrapped-sq_default unsat ✅ 0.49313 0.00635
STP STP-2019-wrapped-sq_default unsat ✅ 0.82371 0.82393
stp-mergesat-fixed-wrapped-sq_default unsat ✅ 0.81751 0.81765
stp-minisat-wrapped-sq_default unsat ✅ 0.83289 0.83301
stp-mt-wrapped-sq_default unsat ✅ 0.81608 0.81615
stp-portfolio-fixed-wrapped-sq_default unsat ✅ 0.81664 0.81674
stp-riss-wrapped-sq_default unsat ✅ 0.81833 0.81854
Yices2 Yices 2.6.2-wrapped-sq_default unsat ✅ 0.45254 0.45255
Yices 2.6.2 Cadical-wrapped-sq_default unsat ✅ 0.44415 0.44417
Yices 2.6.2 Cryptominisat-wrapped-sq_default unsat ✅ 0.44503 0.44494
Yices 2.6.2 MCSAT BV-wrapped-sq_default unsat ✅ 0.43985 0.43979
Yices 2.6.2 new bvsolver-wrapped-sq_default unsat ✅ 0.44836 0.44833
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 0.91997 0.91991
SMT-COMP 2021 Bitwuzla Bitwuzla-fixed_default unsat ✅ 1.65458 1.65428
MathSAT mathsat-5.6.6_default unsat ✅ 0.86377 0.86360
STP STP 2021.0_default unsat ✅ 0.79031 0.79042
Z3 z3-4.8.11_default unsat ✅ 0.56328 0.56327
SMT-COMP 2022 Bitwuzla Bitwuzla-fixed_default unsat ✅ 1.65648 1.65645
Bitwuzla-wrapped_default unsat ✅ 1.84667 1.84634
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 5.65450 5.65456
MathSAT MathSAT-5.6.8_default unsat ✅ 0.89037 0.88931
STP STP 2022.4_default unsat ✅ 0.85785 0.85501
Yices2 Yices 2.6.2 for SMTCOMP 2021_default unsat ✅ 0.49054 0.49040
Z3++BV z3++bv_0702_default unsat ✅ 0.52673 0.52651
Z3 z3-4.8.17_default unsat ✅ 0.54274 0.54458