Benchmark

non-incremental/QF_BV/sage/app1/bench_2586.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation)
 For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size64904
Compressed Size9129
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status sat
Inferred Status sat
Size 64896
Compressed Size9142
Max. Term Depth136
Asserts 1
Declared Functions0
Declared Constants285
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 ite58 not69 and1
=175 let126 extract1 bvand32
bvor171 bvadd331 bvmul5 bvsub177
bvult206 bvule455 bvslt1 bvsle27
bvshl172 bvashr5 zero_extend286

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 4Simp 4Simp-SMT-COMP-2012 default sat ✅ 1.09212 —
Abziz abziz_portfolio_2011_minfeatures_2 default sat ✅ 2.77830 —
abziz_portfolio_2011_solvers_2 default sat ✅ 2.84082 —
abziz_portfolio_2012_minfeatures default unknown ❌ — —
abziz_portfolio_2012_solvers default sat ✅ 2.82960 —
AbzizPortfolio-SMT-COMP-2012 default sat ✅ 2.76088 —
Boolector Boolector-1.5.118-SMT-EVAL-2013 default sat ✅ 0.26422 —
Boolector-SMT-COMP-2011 default sat ✅ 3.23915 —
Boolector-SMT-COMP-2012 default sat ✅ 0.12497 —
CVC3 CVC3-SMT-COMP-2010 default sat ✅ 549.82800 —
CVC3-SMT-COMP-2011 default unknown ❌ — —
CVC3-SMT-COMP-2012 default unknown ❌ — —
CVC4 CVC4-SMT-COMP-2012-Resubmission default sat ✅ 1.22771 —
CVC4-SMT-EVAL-2013 default sat ✅ 1.21564 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default sat ✅ 1.27951 —
MathSAT5-HeavyBV-SMT-COMP-2012 default sat ✅ 1.75801 —
MathSAT5-SMT-COMP-2011 default sat ✅ 0.49974 —
MathSAT5-SMT-COMP-2012 default sat ✅ 0.49838 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default sat ✅ 1.10980 —
SONOLAR-SMT-COMP-2010 default sat ✅ 1.74249 —
SONOLAR-SMT-COMP-2011 default sat ✅ 1.25484 —
SONOLAR-SMT-COMP-2012 default sat ✅ 0.65045 —
STP STP2-SMT-COMP-2011 default sat ✅ 3.34716 —
STP2-SMT-COMP-2012 default sat ✅ 2.79397 —
simplifyingSTP-SMT-COMP-2010 default sat ✅ 3.94644 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default sat ✅ 4.11341 —
Z3-SMT-COMP-2011 default sat ✅ 2.82661 —
SMT-COMP 2015 Boolector Boolector SMT15 QF_BV final boolector_qf_bv sat ✅ 0.93249 0.93186
CVC4 CVC4-master-2015-06-15-9b32405-main default sat ✅ 4.25952 8.48271
CVC4-experimental-2015-06-15-ff5745a-main default sat ✅ 6.63073 13.24800
MathSAT MathSat 5.3.6 main smtcomp2015_main sat ✅ 1.82026 1.81972
SMT-RAT SMT-RAT-final default sat ✅ 256.99100 257.06900
STP stp-cryptominisat4 default sat ✅ 5.87685 5.87710
stp-cmsat4-v15 default sat ✅ 19.05170 19.05810
stp-cmsat4-mt-v15 default unknown ❌ 0.40601 0.40494
stp-minisat-v15 default sat ✅ 2.54916 2.54861
Yices2 Yices default sat ✅ 0.11410 0.11298
Z3 z3 4.4.0 default sat ✅ 3.88188 3.88341
SMT-COMP 2016 0.10 (9/10) ABC ABC_default default_abc sat ✅ 0.98240 0.98255
ABC_glucose glucose sat ✅ 9.83436 9.83944
Boolector Boolector boolector sat ✅ 1.54986 1.55056
Boolector preprop boolector sat ✅ 1.54955 1.55039
CVC4 CVC4-master-2016-05-27-cfef263-main default sat ✅ 8.73695 17.48450
MapleSTP MapleSTP default sat ✅ 2.87176 2.87338
MapleSTP-mt default sat ✅ 2.70806 9.57142
MathSAT mathsat-5.3.11-linux-x86_64-Main default sat ✅ 1.49288 1.49470
MinkeyRink Minkeyrink 2016 default sat ✅ 2.04427 3.88742
Q3B Q3B default unknown ❌ 2400.02000 7204.07000
STP stp-cms-exp-2016 default sat ✅ 97.65960 97.71430
stp-cms-mt-2016 default sat ✅ 13.24000 51.51050
stp-cms-st-2016 default sat ✅ 13.70710 13.71510
stp-minisat-st-2016 default sat ✅ 20.83780 20.84560
Yices2 Yices-2.4.2 default sat ✅ 0.16733 0.16736
Z3 z3-4.4.1 default sat ✅ 3.71658 3.72010
SMT-COMP 2017 0.12 (7/8) Boolector Boolector+CaDiCaL SMT17 final boolector sat ✅ 0.25876 0.25738
Boolector SMT17 final boolector sat ✅ 2.56992 2.56885
CVC4 CVC4-smtcomp2017-main default sat ✅ 3.06195 6.09458
MathSAT mathsat-5.4.1-linux-x86_64-Main default sat ✅ 1.59692 1.59773
MinkeyRink MinkeyRink 2017.3a default sat ✅ 0.83404 0.80294
Q3B Q3B default unknown ❌ 600.07200 1799.30000
STP stp_st default sat ✅ 10.08060 10.07910
stp_mt default sat ✅ 8.48768 31.84450
Yices2 Yices2-Main default sat ✅ 0.16822 0.16763
Z3 z3-4.5.0 default sat ✅ 3.81982 3.81809
SMT-COMP 2018 Boolector Boolector_default sat ✅ 0.22161 0.22151
CVC4 master-2018-06-10-b19c840-competition-default_default sat ✅ 5.21588 5.21623
MathSAT mathsat-5.5.2-linux-x86_64-Main_default sat ✅ 1.32412 1.32516
MinkeyRink Minkeyrink MT_mt sat ✅ 0.76855 2.24576
Minkeyrink ST_st sat ✅ 0.87749 0.87749
STP STP-CMS-st-2018_default-no-stderr sat ✅ 12.08420 12.08360
STP-CMS-mt-2018_multicore-no-stderr sat ✅ 4.29384 15.62420
STP-Riss-st-2018_riss-no-stderr sat ✅ 5.46397 5.46415
Yices2 Yices 2.6.0_default sat ✅ 0.15509 0.15500
Z3 z3-4.7.1_default sat ✅ 7.41803 7.41772
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default sat ✅ 0.36440 0.36436
Poolector-wrapped-sq_default sat ✅ 0.50002 0.50665
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default sat ✅ 1.46860 1.46852
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default sat ✅ 6.88198 6.88179
MinkeyRink MinkeyRink MT-wrapped-sq_default sat ✅ 0.83737 2.57461
MinkeyRink ST-wrapped-sq_default sat ✅ 0.75748 0.75754
Par4 Par4-wrapped-sq_default sat ✅ 0.20477 0.00600
STP STP-2019-wrapped-sq_default sat ✅ 14.19890 14.19840
stp-mergesat-fixed-wrapped-sq_default sat ✅ 11.92060 11.90450
stp-minisat-wrapped-sq_default sat ✅ 4.54511 4.54507
stp-mt-wrapped-sq_default sat ✅ 12.90960 49.83940
stp-portfolio-fixed-wrapped-sq_default sat ✅ 15.07300 32.06350
stp-riss-wrapped-sq_default unknown ❌ 0.46876 0.46870
Yices2 Yices 2.6.2-wrapped-sq_default sat ✅ 0.20018 0.20017
Yices 2.6.2 Cadical-wrapped-sq_default sat ✅ 0.56505 0.56500
Yices 2.6.2 Cryptominisat-wrapped-sq_default sat ✅ 1.02976 1.02964
Yices 2.6.2 MCSAT BV-wrapped-sq_default sat ✅ 10.44830 10.44860
Yices 2.6.2 new bvsolver-wrapped-sq_default sat ✅ 0.23076 0.23075
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default sat ✅ 2.72433 2.72410