Benchmark

non-incremental/QF_BV/Sage2/bench_3173.smt2

Patrice Godefroid, SAGE (systematic dynamic test generation). For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size21081
Compressed Size1943
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2015-07-02
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status sat
Inferred Status sat
Size 21073
Compressed Size1937
Max. Term Depth60
Asserts 116
Declared Functions0
Declared Constants19
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 not92 =96 let416
bvadd78 bvmul78 bvult19 zero_extend168

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2017 0.12 (7/8) Boolector Boolector+CaDiCaL SMT17 final boolector sat ✅ 12.26560 12.26310
Boolector SMT17 final boolector sat ✅ 61.65060 61.64020
CVC4 CVC4-smtcomp2017-main default sat ✅ 20.66110 41.38270
MathSAT mathsat-5.4.1-linux-x86_64-Main default sat ✅ 5.96449 5.96435
MinkeyRink MinkeyRink 2017.3a default sat ✅ 8.00034 11.00000
Q3B Q3B default unknown ❌ 600.11400 1799.89000
STP stp_st default sat ✅ 5.40926 5.40831
stp_mt default sat ✅ 3.82288 10.85770
Yices2 Yices2-Main default sat ✅ 149.62800 149.58800
Z3 z3-4.5.0 default sat ✅ 508.70600 508.61600
SMT-COMP 2018 Boolector Boolector_default sat ✅ 97.16850 97.17120
CVC4 master-2018-06-10-b19c840-competition-default_default sat ✅ 129.55200 129.54900
MathSAT mathsat-5.5.2-linux-x86_64-Main_default sat ✅ 62.78120 62.77590
MinkeyRink Minkeyrink MT_mt sat ✅ 2.76580 10.64240
Minkeyrink ST_st sat ✅ 1.84105 1.84134
STP STP-CMS-st-2018_default-no-stderr sat ✅ 4.59821 4.59839
STP-CMS-mt-2018_multicore-no-stderr sat ✅ 2.78361 10.60520
STP-Riss-st-2018_riss-no-stderr sat ✅ 5.26631 5.26628
Yices2 Yices 2.6.0_default sat ✅ 316.78900 316.76200
Z3 z3-4.7.1_default sat ✅ 646.02900 645.97400
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default sat ✅ 14.48710 14.48500
Poolector-wrapped-sq_default sat ✅ 4.75533 18.45000
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default sat ✅ 55.45120 55.44800
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default sat ✅ 113.73400 113.71300
MinkeyRink MinkeyRink MT-wrapped-sq_default sat ✅ 0.67493 2.40380
MinkeyRink ST-wrapped-sq_default sat ✅ 3.07130 3.07109
Par4 Par4-wrapped-sq_default sat ✅ 45.41790 136.17000
STP STP-2019-wrapped-sq_default sat ✅ 0.79907 0.79937
stp-mergesat-fixed-wrapped-sq_default sat ✅ 16.94770 16.94860
stp-minisat-wrapped-sq_default sat ✅ 16.31540 16.31460
stp-mt-wrapped-sq_default sat ✅ 0.86895 2.91923
stp-portfolio-fixed-wrapped-sq_default sat ✅ 17.20380 34.32760
stp-riss-wrapped-sq_default unknown ❌ 0.15368 0.15387
Yices2 Yices 2.6.2-wrapped-sq_default sat ✅ 124.65900 124.65000
Yices 2.6.2 Cadical-wrapped-sq_default sat ✅ 11.88620 11.88560
Yices 2.6.2 Cryptominisat-wrapped-sq_default sat ✅ 28.74360 28.74030
Yices 2.6.2 MCSAT BV-wrapped-sq_default unknown ❌ 2400.03000 2399.82000
Yices 2.6.2 new bvsolver-wrapped-sq_default sat ✅ 21.26830 21.26220
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default sat ✅ 186.14000 186.13600
SMT-COMP 2021 Bitwuzla Bitwuzla-fixed_default sat ✅ 13.73720 13.73730
MathSAT mathsat-5.6.6_default sat ✅ 22.25470 22.25500
STP STP 2021.0_default sat ✅ 0.83995 3.07609
Z3 z3-4.8.11_default sat ✅ 484.34600 484.30400
SMT-COMP 2024 0.17 (5/6) Bitwuzla Bitwuzla sat ✅ 2.52462 2.42299
cvc5 cvc5 sat ✅ 106.82719 106.72467
SMTInterpol SMTInterpol unknown ❌ 1201.74134 1220.39969
STP STP sat ✅ 11.04389 10.94363
Yices2 Yices2 sat ✅ 280.85243 280.74715
Z3alpha Z3-alpha sat ✅ 80.04279 79.89268
SMT-COMP 2025 0.11 (8/9) Bitwuzla Bitwuzla sat ✅ 5.19480 5.07119
Bitwuzla-MachBV-base sat ✅ 7.72627 7.60669
Bitwuzla-MachBV Bitwuzla-MachBV sat ✅ 3.90401 3.78660
BVDecide bv_decide sat ✅ 10.82691 10.69461
bv_decide-nokernel sat ✅ 10.83006 10.64214
cvc5 cvc5 sat ✅ 16.45488 16.32246
SMTInterpol SMTInterpol unknown ❌ 1201.36588 1223.04494
Yices2 Yices2 sat ✅ 19.03309 18.91640
Z3alpha Z3-alpha sat ✅ 34.86179 138.02067
Z3 Z3-alpha-base sat ✅ 313.68554 313.50070
Z3-Owl-base unknown ❌ 1201.27772 1201.02366
z3siri-base sat ✅ 315.78721 315.61807
Z3-Owl Z3-Owl sat ✅ 12.43570 12.30175