Benchmark

non-incremental/QF_BV/Sage2/bench_2827.smt2

Patrice Godefroid, SAGE (systematic dynamic test generation). For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size1950099
Compressed Size11480
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2015-07-02
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status sat
Inferred Status sat
Size 1950091
Compressed Size11469
Max. Term Depth481
Asserts 325
Declared Functions0
Declared Constants94
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 ite1 not103 =132
let46020 extract8 bvand4 bvor2
bvadd23193 bvmul5882 bvudiv80 bvult10
bvule47 bvugt1 bvuge96 bvsle19
bvsgt2 bvsge18 bvshl3 bvlshr26
zero_extend16717

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2017 0.12 (7/8) Boolector Boolector+CaDiCaL SMT17 final boolector sat ✅ 36.76700 36.76240
Boolector SMT17 final boolector unknown ❌ 600.01400 599.97700
CVC4 CVC4-smtcomp2017-main default sat ✅ 209.41700 420.05700
MathSAT mathsat-5.4.1-linux-x86_64-Main default sat ✅ 18.51650 18.51460
MinkeyRink MinkeyRink 2017.3a default sat ✅ 1.44505 1.44772
Q3B Q3B default unknown ❌ 600.03600 1200.99000
STP stp_st default sat ✅ 140.69700 140.68200
stp_mt default sat ✅ 538.76500 2133.99000
Yices2 Yices2-Main default sat ✅ 0.26410 0.26402
Z3 z3-4.5.0 default sat ✅ 19.77600 19.77470
SMT-COMP 2018 Boolector Boolector_default sat ✅ 1.05581 1.05572
CVC4 master-2018-06-10-b19c840-competition-default_default sat ✅ 7.53246 7.53172
MathSAT mathsat-5.5.2-linux-x86_64-Main_default sat ✅ 15.10770 15.10770
MinkeyRink Minkeyrink MT_mt sat ✅ 1.26182 2.96549
Minkeyrink ST_st sat ✅ 1.07944 1.07945
STP STP-CMS-st-2018_default-no-stderr sat ✅ 140.82900 140.76600
STP-CMS-mt-2018_multicore-no-stderr sat ✅ 222.05300 876.93300
STP-Riss-st-2018_riss-no-stderr sat ✅ 270.79100 270.77100
Yices2 Yices 2.6.0_default sat ✅ 0.25121 0.25115
Z3 z3-4.7.1_default sat ✅ 52.99620 52.99240
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default sat ✅ 6.43933 6.43396
Poolector-wrapped-sq_default sat ✅ 7.36658 28.63000
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default sat ✅ 1141.07000 1140.88000
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default sat ✅ 5.32398 5.32336
MinkeyRink MinkeyRink MT-wrapped-sq_default sat ✅ 1.56073 3.18498
MinkeyRink ST-wrapped-sq_default sat ✅ 1.37509 1.37519
Par4 Par4-wrapped-sq_default sat ✅ 0.26079 0.00774
STP STP-2019-wrapped-sq_default sat ✅ 525.23900 525.19400
stp-mergesat-fixed-wrapped-sq_default sat ✅ 156.25300 156.24500
stp-minisat-wrapped-sq_default sat ✅ 1194.08000 1193.88000
stp-mt-wrapped-sq_default sat ✅ 452.51300 1757.01000
stp-portfolio-fixed-wrapped-sq_default sat ✅ 1229.16000 1993.92000
stp-riss-wrapped-sq_default unknown ❌ 2.18128 2.18148
Yices2 Yices 2.6.2-wrapped-sq_default sat ✅ 0.24940 0.24942
Yices 2.6.2 Cadical-wrapped-sq_default sat ✅ 0.32605 0.32602
Yices 2.6.2 Cryptominisat-wrapped-sq_default sat ✅ 1.63929 1.63900
Yices 2.6.2 MCSAT BV-wrapped-sq_default unknown ❌ 2400.10000 2399.99000
Yices 2.6.2 new bvsolver-wrapped-sq_default sat ✅ 0.31390 0.31388
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default sat ✅ 38.69240 38.69070
SMT-COMP 2020 0.11 (8/9) Bitwuzla Bitwuzla-fixed_default sat ✅ 16.98620 16.98330
Boolector Boolector-wrapped-sq_default sat ✅ 8.51528 8.51404
Poolector-wrapped-sq_default sat ✅ 9.81045 38.33430
CVC4 CVC4-sq-final_default sat ✅ 9.14783 9.14805
LazyBV2Int LazyBV2Int20200523_default.sh unknown ❌ 1200.02000 1199.94000
MathSAT MathSAT5_default.sh sat ✅ 15.09060 15.09090
MinkeyRink MinkeyRink Solver 2020.3.1_default unknown ❌ 0.72963 0.72986
MinkeyRink Solver 2020.3_default sat ✅ 0.83950 1.15797
STP STP_default sat ✅ 1.27198 2.71300
STP ++ Mergsat v1_default sat ✅ 1.44511 1.44685
Yices2 Yices 2.6.2 bug fix_default sat ✅ 0.30146 0.30142
Z3 z3-4.8.8_default sat ✅ 44.90420 44.90080
SMT-COMP 2023 0.17 (5/6) Bitwuzla Bitwuzla-fixed_default sat ✅ 1.52962 1.52932
cvc5 cvc5-default-2023-05-16-ea045f305_sq sat ✅ 7.37870 7.37436
STP STP 2022.4_default sat ✅ 0.61418 0.61427
STP 2022.4_default sat ✅ 0.62158 0.62159
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unknown ❌ 6.07702 18.40240
Yices2 Yices 2 for SMTCOMP 2023_default sat ✅ 0.29308 0.29304
Z3-Owl z3-Owl-Final_default sat ✅ 609.49000 609.44000
z3-Owl-Final_default sat ✅ 425.92200 425.84600
SMT-COMP 2025 0.22 (7/9) Bitwuzla Bitwuzla sat ✅ 0.49396 0.36036
Bitwuzla-MachBV-base sat ✅ 0.89471 0.77296
Bitwuzla-MachBV Bitwuzla-MachBV sat ✅ 2.75981 2.63848
BVDecide bv_decide sat ✅ 35.82349 35.70020
bv_decide-nokernel sat ✅ 35.80976 35.63671
cvc5 cvc5 sat ✅ 5.17209 5.04864
SMTInterpol SMTInterpol unknown ❌ 92.90768 113.29122
Yices2 Yices2 sat ✅ 0.54487 0.41878
Z3alpha Z3-alpha sat ✅ 55.71225 216.47593
Z3 Z3-alpha-base unknown ❌ 1201.37304 1201.14125
Z3-Owl-base unknown ❌ 1201.36902 1201.03133
z3siri-base unknown ❌ 1201.39888 1201.02800
Z3-Owl Z3-Owl sat ✅ 169.74304 169.59798