Benchmark

non-incremental/QF_BV/sage/app1/bench_2133.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation)
 For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size73564
Compressed Size10431
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status sat
Inferred Status sat
Size 73556
Compressed Size10447
Max. Term Depth176
Asserts 1
Declared Functions0
Declared Constants285
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 ite77 not73 and1
=191 let166 extract1 bvand40
bvor171 bvadd360 bvmul5 bvsub233
bvult252 bvule550 bvslt1 bvsle47
bvshl172 bvashr5 zero_extend305

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 0.11 (8/9) 4Simp 4Simp-SMT-COMP-2012 default sat ✅ 1.36519 —
Abziz abziz_portfolio_2011_minfeatures_2 default sat ✅ 2.95128 —
abziz_portfolio_2011_solvers_2 default sat ✅ 2.89612 —
abziz_portfolio_2012_minfeatures default sat ✅ 2.94745 —
abziz_portfolio_2012_solvers default sat ✅ 3.03289 —
AbzizPortfolio-SMT-COMP-2012 default sat ✅ 2.95452 —
Boolector Boolector-1.5.118-SMT-EVAL-2013 default sat ✅ 7.22133 —
Boolector-SMT-COMP-2011 default sat ✅ 3.29304 —
Boolector-SMT-COMP-2012 default sat ✅ 0.96055 —
CVC3 CVC3-SMT-COMP-2010 default unknown ❌ — —
CVC3-SMT-COMP-2011 default unknown ❌ — —
CVC3-SMT-COMP-2012 default unknown ❌ — —
CVC4 CVC4-SMT-COMP-2012-Resubmission default sat ✅ 2.26332 —
CVC4-SMT-EVAL-2013 default sat ✅ 2.22753 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default sat ✅ 1.95450 —
MathSAT5-HeavyBV-SMT-COMP-2012 default sat ✅ 2.69421 —
MathSAT5-SMT-COMP-2011 default sat ✅ 3.13351 —
MathSAT5-SMT-COMP-2012 default sat ✅ 3.12262 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default sat ✅ 1.80452 —
SONOLAR-SMT-COMP-2010 default sat ✅ 1.96813 —
SONOLAR-SMT-COMP-2011 default sat ✅ 1.52557 —
SONOLAR-SMT-COMP-2012 default sat ✅ 0.87950 —
STP STP2-SMT-COMP-2011 default sat ✅ 5.23602 —
STP2-SMT-COMP-2012 default sat ✅ 7.13848 —
simplifyingSTP-SMT-COMP-2010 default sat ✅ 20.00110 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default sat ✅ 5.01260 —
Z3-SMT-COMP-2011 default sat ✅ 2.93724 —
SMT-COMP 2015 Boolector Boolector SMT15 QF_BV final boolector_qf_bv sat ✅ 3.65541 3.65544
CVC4 CVC4-master-2015-06-15-9b32405-main default sat ✅ 15.29850 30.62930
CVC4-experimental-2015-06-15-ff5745a-main default sat ✅ 8.35275 16.68450
MathSAT MathSat 5.3.6 main smtcomp2015_main sat ✅ 2.69977 2.69959
SMT-RAT SMT-RAT-final default sat ✅ 736.71500 736.95100
STP stp-cryptominisat4 default sat ✅ 26.43860 26.44900
stp-cmsat4-v15 default sat ✅ 19.92930 19.93600
stp-cmsat4-mt-v15 default unknown ❌ 0.41502 0.41394
stp-minisat-v15 default sat ✅ 9.65048 9.65153
Yices2 Yices default sat ✅ 1.82913 1.82872
Z3 z3 4.4.0 default sat ✅ 5.96512 5.96809
SMT-COMP 2016 0.10 (9/10) ABC ABC_default default_abc sat ✅ 1.48669 1.48746
ABC_glucose glucose sat ✅ 12.42620 12.42470
Boolector Boolector boolector sat ✅ 7.05988 7.06375
Boolector preprop boolector sat ✅ 7.12976 7.13393
CVC4 CVC4-master-2016-05-27-cfef263-main default sat ✅ 11.89210 23.80830
MapleSTP MapleSTP default sat ✅ 217.79600 217.92200
MapleSTP-mt default sat ✅ 126.91900 504.97000
MathSAT mathsat-5.3.11-linux-x86_64-Main default sat ✅ 2.15598 2.15820
MinkeyRink Minkeyrink 2016 default sat ✅ 3.12272 8.32144
Q3B Q3B default unknown ❌ 2400.02000 7203.85000
STP stp-cms-exp-2016 default sat ✅ 86.03030 86.08710
stp-cms-mt-2016 default sat ✅ 16.98980 65.63730
stp-cms-st-2016 default sat ✅ 20.47210 20.48550
stp-minisat-st-2016 default sat ✅ 35.04070 35.05480
Yices2 Yices-2.4.2 default sat ✅ 3.31517 3.31725
Z3 z3-4.4.1 default sat ✅ 6.69614 6.70128
SMT-COMP 2017 0.12 (7/8) Boolector Boolector+CaDiCaL SMT17 final boolector sat ✅ 0.76660 0.76636
Boolector SMT17 final boolector sat ✅ 6.14729 6.14695
CVC4 CVC4-smtcomp2017-main default sat ✅ 6.86617 13.71390
MathSAT mathsat-5.4.1-linux-x86_64-Main default sat ✅ 3.38428 3.38367
MinkeyRink MinkeyRink 2017.3a default sat ✅ 1.23534 1.23394
Q3B Q3B default unknown ❌ 600.10500 1799.94000
STP stp_st default sat ✅ 13.14750 13.14690
stp_mt default sat ✅ 11.29150 43.33780
Yices2 Yices2-Main default sat ✅ 1.67583 1.66779
Z3 z3-4.5.0 default sat ✅ 5.28070 5.27947
SMT-COMP 2018 Boolector Boolector_default sat ✅ 0.83244 0.83235
CVC4 master-2018-06-10-b19c840-competition-default_default sat ✅ 7.46777 7.46760
MathSAT mathsat-5.5.2-linux-x86_64-Main_default sat ✅ 2.54606 2.54682
MinkeyRink Minkeyrink MT_mt sat ✅ 1.83013 6.42851
Minkeyrink ST_st sat ✅ 2.78329 2.78273
STP STP-CMS-st-2018_default-no-stderr sat ✅ 17.81660 35.58300
STP-CMS-mt-2018_multicore-no-stderr sat ✅ 9.44820 35.35660
STP-Riss-st-2018_riss-no-stderr sat ✅ 6.48766 6.48746
Yices2 Yices 2.6.0_default sat ✅ 1.43707 1.43668
Z3 z3-4.7.1_default sat ✅ 13.68030 13.67910
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default sat ✅ 1.14873 1.14848
Poolector-wrapped-sq_default sat ✅ 1.40099 5.01181
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default sat ✅ 2.25662 2.25551
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default sat ✅ 8.63332 8.63319
MinkeyRink MinkeyRink MT-wrapped-sq_default sat ✅ 1.96457 7.02184
MinkeyRink ST-wrapped-sq_default sat ✅ 2.03757 2.03739
Par4 Par4-wrapped-sq_default sat ✅ 0.34772 0.00605
STP STP-2019-wrapped-sq_default sat ✅ 12.42260 12.41650
stp-mergesat-fixed-wrapped-sq_default sat ✅ 10.38940 10.38920
stp-minisat-wrapped-sq_default sat ✅ 5.16194 5.16220
stp-mt-wrapped-sq_default sat ✅ 14.57730 56.57670
stp-portfolio-fixed-wrapped-sq_default sat ✅ 13.45910 29.81590
stp-riss-wrapped-sq_default unknown ❌ 0.46517 0.46496
Yices2 Yices 2.6.2-wrapped-sq_default sat ✅ 2.02447 2.02431
Yices 2.6.2 Cadical-wrapped-sq_default sat ✅ 0.95630 0.95546
Yices 2.6.2 Cryptominisat-wrapped-sq_default sat ✅ 4.14488 4.14447
Yices 2.6.2 MCSAT BV-wrapped-sq_default sat ✅ 2.64365 2.64342
Yices 2.6.2 new bvsolver-wrapped-sq_default sat ✅ 1.16708 1.16697
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default sat ✅ 3.68513 3.68484
SMT-COMP 2020 0.11 (8/9) Bitwuzla Bitwuzla-fixed_default sat ✅ 0.61126 0.61119
Boolector Boolector-wrapped-sq_default sat ✅ 0.43640 0.43642
Poolector-wrapped-sq_default sat ✅ 0.58228 1.90596
CVC4 CVC4-sq-final_default sat ✅ 7.71237 7.71264
LazyBV2Int LazyBV2Int20200523_default.sh unknown ❌ 1200.07000 1200.02000
MathSAT MathSAT5_default.sh sat ✅ 1.32341 1.32315
MinkeyRink MinkeyRink Solver 2020.3.1_default unknown ❌ 0.27142 0.27166
MinkeyRink Solver 2020.3_default sat ✅ 0.66056 1.80331
STP STP_default sat ✅ 1.06928 3.60536
STP ++ Mergsat v1_default sat ✅ 5.85809 5.85950
Yices2 Yices 2.6.2 bug fix_default sat ✅ 1.28636 1.28634
Z3 z3-4.8.8_default sat ✅ 3.17151 3.17006
SMT-COMP 2023 0.17 (5/6) Bitwuzla Bitwuzla-fixed_default sat ✅ 2.72479 2.72469
cvc5 cvc5-default-2023-05-16-ea045f305_sq sat ✅ 14.96930 14.96980
STP STP 2022.4_default sat ✅ 0.87968 0.87974
STP 2022.4_default sat ✅ 0.87506 0.87500
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unknown ❌ 1200.13000 1259.53000
Yices2 Yices 2 for SMTCOMP 2023_default sat ✅ 1.64985 1.64981
Z3-Owl z3-Owl-Final_default sat ✅ 19.43090 19.42800
z3-Owl-Final_default sat ✅ 19.01160 18.99780