Benchmark

non-incremental/QF_BV/Sage2/bench_4972.smt2

Patrice Godefroid, SAGE (systematic dynamic test generation). For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size14390
Compressed Size1931
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2015-07-02
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status sat
Inferred Status sat
Size 14382
Compressed Size1873
Max. Term Depth58
Asserts 110
Declared Functions0
Declared Constants19
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 not84 =90 let248
bvadd28 bvmul28 bvult19 zero_extend108

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2017 0.12 (7/8) Boolector Boolector+CaDiCaL SMT17 final boolector sat ✅ 45.32770 45.32170
Boolector SMT17 final boolector sat ✅ 62.88800 62.88940
CVC4 CVC4-smtcomp2017-main default sat ✅ 23.56610 47.22260
MathSAT mathsat-5.4.1-linux-x86_64-Main default sat ✅ 10.16120 10.16110
MinkeyRink MinkeyRink 2017.3a default sat ✅ 5.34708 5.42979
Q3B Q3B default unknown ❌ 600.01800 1799.30000
STP stp_st default sat ✅ 3.95325 3.95258
stp_mt default sat ✅ 6.05194 23.75470
Yices2 Yices2-Main default sat ✅ 24.60620 24.60330
Z3 z3-4.5.0 default sat ✅ 59.04660 59.03580
SMT-COMP 2018 Boolector Boolector_default sat ✅ 17.28160 17.27870
CVC4 master-2018-06-10-b19c840-competition-default_default sat ✅ 11.75400 11.75380
MathSAT mathsat-5.5.2-linux-x86_64-Main_default sat ✅ 24.95610 24.95740
MinkeyRink Minkeyrink MT_mt sat ✅ 1.78958 6.80932
Minkeyrink ST_st sat ✅ 1.37083 1.37088
STP STP-CMS-st-2018_default-no-stderr sat ✅ 3.97723 3.97694
STP-CMS-mt-2018_multicore-no-stderr sat ✅ 0.60871 2.16761
STP-Riss-st-2018_riss-no-stderr sat ✅ 2.37102 2.37067
Yices2 Yices 2.6.0_default sat ✅ 1.84613 1.84580
Z3 z3-4.7.1_default sat ✅ 92.40340 92.39060
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default sat ✅ 33.51910 33.51790
Poolector-wrapped-sq_default sat ✅ 21.63050 85.22000
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default sat ✅ 75.15640 75.15300
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default sat ✅ 63.88020 63.88410
MinkeyRink MinkeyRink MT-wrapped-sq_default sat ✅ 0.37789 1.25492
MinkeyRink ST-wrapped-sq_default sat ✅ 0.36927 0.36931
Par4 Par4-wrapped-sq_default sat ✅ 19.73920 59.06000
STP STP-2019-wrapped-sq_default sat ✅ 3.54192 3.54158
stp-mergesat-fixed-wrapped-sq_default sat ✅ 10.03480 10.03510
stp-minisat-wrapped-sq_default sat ✅ 4.57193 4.57077
stp-mt-wrapped-sq_default sat ✅ 1.78017 6.79660
stp-portfolio-fixed-wrapped-sq_default sat ✅ 10.02960 18.19780
stp-riss-wrapped-sq_default unknown ❌ 0.08174 0.08194
Yices2 Yices 2.6.2-wrapped-sq_default sat ✅ 96.37550 96.37390
Yices 2.6.2 Cadical-wrapped-sq_default sat ✅ 3.10905 3.10898
Yices 2.6.2 Cryptominisat-wrapped-sq_default sat ✅ 26.06490 26.06640
Yices 2.6.2 MCSAT BV-wrapped-sq_default unknown ❌ 2400.03000 2400.04000
Yices 2.6.2 new bvsolver-wrapped-sq_default sat ✅ 13.19090 13.18980
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default sat ✅ 158.62900 158.63700
SMT-COMP 2020 0.11 (8/9) Bitwuzla Bitwuzla-fixed_default sat ✅ 28.00580 28.00720
Boolector Boolector-wrapped-sq_default sat ✅ 2.43413 2.43400
Poolector-wrapped-sq_default sat ✅ 2.69441 10.07000
CVC4 CVC4-sq-final_default sat ✅ 97.14320 97.13790
LazyBV2Int LazyBV2Int20200523_default.sh unknown ❌ 1200.07000 1200.01000
MathSAT MathSAT5_default.sh sat ✅ 28.27820 28.27780
MinkeyRink MinkeyRink Solver 2020.3.1_default unknown ❌ 0.08191 0.08210
MinkeyRink Solver 2020.3_default sat ✅ 1.33239 5.04289
STP STP_default sat ✅ 3.62498 14.13240
STP ++ Mergsat v1_default sat ✅ 15.77050 15.77020
Yices2 Yices 2.6.2 bug fix_default sat ✅ 5.61790 5.61747
Z3 z3-4.8.8_default sat ✅ 202.20700 202.15800
SMT-COMP 2025 0.11 (8/9) Bitwuzla Bitwuzla sat ✅ 18.42120 18.28634
Bitwuzla-MachBV-base sat ✅ 15.31331 15.17919
Bitwuzla-MachBV Bitwuzla-MachBV sat ✅ 6.67197 6.54934
BVDecide bv_decide sat ✅ 30.52461 30.40563
bv_decide-nokernel sat ✅ 30.82337 30.67451
cvc5 cvc5 sat ✅ 110.75119 110.62239
SMTInterpol SMTInterpol unknown ❌ 1201.37879 1234.03074
Yices2 Yices2 sat ✅ 21.71930 21.59806
Z3alpha Z3-alpha sat ✅ 1.52027 4.81674
Z3 Z3-alpha-base sat ✅ 9.62457 9.50225
Z3-Owl-base sat ✅ 39.52120 39.39160
z3siri-base sat ✅ 9.71760 9.58888
Z3-Owl Z3-Owl sat ✅ 13.72379 13.59877