Benchmark

non-incremental/QF_BV/sage/app1/bench_1525.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation)
 For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size80494
Compressed Size11511
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status sat
Inferred Status sat
Size 80486
Compressed Size11511
Max. Term Depth203
Asserts 1
Declared Functions0
Declared Constants300
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 ite87 not76 and1
=206 let193 extract1 bvand46
bvor180 bvadd389 bvmul5 bvsub271
bvult279 bvule608 bvslt1 bvsle62
bvshl181 bvashr5 zero_extend327

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 0.11 (8/9) 4Simp 4Simp-SMT-COMP-2012 default sat ✅ 1.66217 —
Abziz abziz_portfolio_2011_minfeatures_2 default sat ✅ 11.02480 —
abziz_portfolio_2011_solvers_2 default sat ✅ 8.15764 —
abziz_portfolio_2012_minfeatures default sat ✅ 8.08670 —
abziz_portfolio_2012_solvers default sat ✅ 6.07274 —
AbzizPortfolio-SMT-COMP-2012 default sat ✅ 7.29649 —
Boolector Boolector-1.5.118-SMT-EVAL-2013 default sat ✅ 6.98045 —
Boolector-SMT-COMP-2011 default sat ✅ 3.59444 —
Boolector-SMT-COMP-2012 default sat ✅ 0.91651 —
CVC3 CVC3-SMT-COMP-2010 default unknown ❌ — —
CVC3-SMT-COMP-2011 default unknown ❌ — —
CVC3-SMT-COMP-2012 default unknown ❌ — —
CVC4 CVC4-SMT-COMP-2012-Resubmission default sat ✅ 3.01680 —
CVC4-SMT-EVAL-2013 default sat ✅ 4.33031 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default sat ✅ 2.22065 —
MathSAT5-HeavyBV-SMT-COMP-2012 default sat ✅ 3.33884 —
MathSAT5-SMT-COMP-2011 default sat ✅ 3.05364 —
MathSAT5-SMT-COMP-2012 default sat ✅ 3.00600 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default sat ✅ 1.16550 —
SONOLAR-SMT-COMP-2010 default sat ✅ 3.07473 —
SONOLAR-SMT-COMP-2011 default sat ✅ 2.19200 —
SONOLAR-SMT-COMP-2012 default sat ✅ 0.99543 —
STP STP2-SMT-COMP-2011 default sat ✅ 8.87912 —
STP2-SMT-COMP-2012 default sat ✅ 11.62170 —
simplifyingSTP-SMT-COMP-2010 default sat ✅ 11.36120 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default sat ✅ 7.16152 —
Z3-SMT-COMP-2011 default sat ✅ 6.10564 —
SMT-COMP 2015 Boolector Boolector SMT15 QF_BV final boolector_qf_bv sat ✅ 4.59775 4.59830
CVC4 CVC4-master-2015-06-15-9b32405-main default sat ✅ 10.34430 20.67290
CVC4-experimental-2015-06-15-ff5745a-main default sat ✅ 9.50151 18.99510
MathSAT MathSat 5.3.6 main smtcomp2015_main sat ✅ 4.14103 4.14137
SMT-RAT SMT-RAT-final default sat ✅ 716.72800 716.94500
STP stp-cryptominisat4 default sat ✅ 17.58670 17.58930
stp-cmsat4-v15 default sat ✅ 22.85330 22.85950
stp-cmsat4-mt-v15 default unknown ❌ 0.42497 0.42394
stp-minisat-v15 default sat ✅ 4.60683 4.60630
Yices2 Yices default sat ✅ 1.22427 1.22381
Z3 z3 4.4.0 default sat ✅ 7.98277 7.98579
SMT-COMP 2016 0.10 (9/10) ABC ABC_default default_abc sat ✅ 57.82240 57.84260
ABC_glucose glucose sat ✅ 14.09110 14.09870
Boolector Boolector boolector sat ✅ 3.25309 3.25304
Boolector preprop boolector sat ✅ 3.25191 3.25464
CVC4 CVC4-master-2016-05-27-cfef263-main default sat ✅ 7.85172 15.70690
MapleSTP MapleSTP default sat ✅ 824.05800 824.49500
MapleSTP-mt default sat ✅ 273.77600 1090.54000
MathSAT mathsat-5.3.11-linux-x86_64-Main default sat ✅ 2.77742 2.78055
MinkeyRink Minkeyrink 2016 default sat ✅ 3.86720 11.23350
Q3B Q3B default unknown ❌ 2400.03000 7203.85000
STP stp-cms-exp-2016 default sat ✅ 104.74000 104.80000
stp-cms-mt-2016 default sat ✅ 21.97560 86.23410
stp-cms-st-2016 default sat ✅ 50.23910 50.26790
stp-minisat-st-2016 default sat ✅ 58.13780 58.15850
Yices2 Yices-2.4.2 default sat ✅ 1.88449 1.88554
Z3 z3-4.4.1 default sat ✅ 7.70897 7.71545
SMT-COMP 2017 0.12 (7/8) Boolector Boolector+CaDiCaL SMT17 final boolector sat ✅ 1.34555 1.34068
Boolector SMT17 final boolector sat ✅ 5.35841 5.35800
CVC4 CVC4-smtcomp2017-main default sat ✅ 9.91232 19.82750
MathSAT mathsat-5.4.1-linux-x86_64-Main default sat ✅ 3.52060 3.51984
MinkeyRink MinkeyRink 2017.3a default sat ✅ 1.39158 1.40880
Q3B Q3B default unknown ❌ 600.05600 1788.91000
STP stp_st default sat ✅ 10.92610 10.92500
stp_mt default sat ✅ 16.26930 48.95060
Yices2 Yices2-Main default sat ✅ 3.25994 3.25833
Z3 z3-4.5.0 default sat ✅ 6.41031 6.40933
SMT-COMP 2018 Boolector Boolector_default sat ✅ 0.87798 0.87782
CVC4 master-2018-06-10-b19c840-competition-default_default sat ✅ 8.37597 8.37247
MathSAT mathsat-5.5.2-linux-x86_64-Main_default sat ✅ 3.64095 3.64150
MinkeyRink Minkeyrink MT_mt sat ✅ 3.43972 12.79700
Minkeyrink ST_st sat ✅ 4.91161 4.91144
STP STP-CMS-st-2018_default-no-stderr sat ✅ 15.63770 15.62910
STP-CMS-mt-2018_multicore-no-stderr sat ✅ 17.32120 65.29310
STP-Riss-st-2018_riss-no-stderr sat ✅ 11.32170 11.32080
Yices2 Yices 2.6.0_default sat ✅ 3.14569 3.14471
Z3 z3-4.7.1_default sat ✅ 8.94810 8.94590
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default sat ✅ 1.37859 1.37856
Poolector-wrapped-sq_default sat ✅ 1.60464 5.97000
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default sat ✅ 3.10021 3.10013
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default sat ✅ 11.82590 11.82540
MinkeyRink MinkeyRink MT-wrapped-sq_default sat ✅ 3.17114 11.81060
MinkeyRink ST-wrapped-sq_default sat ✅ 2.84793 2.84763
Par4 Par4-wrapped-sq_default sat ✅ 0.82638 2.28000
STP STP-2019-wrapped-sq_default sat ✅ 19.76940 19.76860
stp-mergesat-fixed-wrapped-sq_default sat ✅ 14.56280 14.56150
stp-minisat-wrapped-sq_default sat ✅ 5.09318 5.09265
stp-mt-wrapped-sq_default sat ✅ 13.88430 52.53840
stp-portfolio-fixed-wrapped-sq_default sat ✅ 20.76470 40.34690
stp-riss-wrapped-sq_default unknown ❌ 0.86952 0.86953
Yices2 Yices 2.6.2-wrapped-sq_default sat ✅ 3.12850 3.12852
Yices 2.6.2 Cadical-wrapped-sq_default sat ✅ 0.97529 0.97397
Yices 2.6.2 Cryptominisat-wrapped-sq_default sat ✅ 10.87780 10.87130
Yices 2.6.2 MCSAT BV-wrapped-sq_default sat ✅ 497.48500 497.42500
Yices 2.6.2 new bvsolver-wrapped-sq_default sat ✅ 1.98305 1.98308
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default sat ✅ 22.04330 22.04470
SMT-COMP 2023 0.17 (5/6) Bitwuzla Bitwuzla-fixed_default sat ✅ 4.08489 4.08250
cvc5 cvc5-default-2023-05-16-ea045f305_sq sat ✅ 8.83847 17.56770
STP STP 2022.4_default sat ✅ 0.35557 0.35561
STP 2022.4_default sat ✅ 0.36149 0.35929
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unknown ❌ 1200.04000 1259.90000
Yices2 Yices 2 for SMTCOMP 2023_default sat ✅ 1.63809 1.63785
Z3-Owl z3-Owl-Final_default sat ✅ 17.89330 17.88360
z3-Owl-Final_default sat ✅ 19.58760 19.03640
SMT-COMP 2025 0.11 (8/9) Bitwuzla Bitwuzla sat ✅ 1.12779 1.01071
Bitwuzla-MachBV-base sat ✅ 1.01318 0.88680
Bitwuzla-MachBV Bitwuzla-MachBV sat ✅ 0.99234 0.86276
BVDecide bv_decide sat ✅ 10.60995 10.46789
bv_decide-nokernel sat ✅ 10.10470 9.96685
cvc5 cvc5 sat ✅ 5.49510 5.37032
SMTInterpol SMTInterpol unknown ❌ 1201.55666 1229.39610
Yices2 Yices2 sat ✅ 0.77399 0.64351
Z3alpha Z3-alpha sat ✅ 9.52521 36.55449
Z3 Z3-alpha-base sat ✅ 5.77702 5.64341
Z3-Owl-base sat ✅ 34.13823 34.00853
z3siri-base sat ✅ 5.94195 5.81338
Z3-Owl Z3-Owl sat ✅ 9.84729 9.71645