Benchmark

non-incremental/QF_BV/Sage2/bench_16525.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation). For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size60916
Compressed Size3002
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2015-07-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 60908
Compressed Size3019
Max. Term Depth63
Asserts 144
Declared Functions0
Declared Constants20
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 not41 =42 let1397
bvadd809 bvmul4 bvult35 bvule39
bvugt2 bvuge25 bvlshr20 zero_extend523

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2017 0.25 (6/8) Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 0.05932 0.05825
Boolector SMT17 final boolector unsat ✅ 0.43159 0.43095
CVC4 CVC4-smtcomp2017-main default unsat ✅ 19.62130 39.43110
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.11980 0.12020
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 0.12068 0.09806
Q3B Q3B default unknown ❌ 600.06300 1786.33000
STP stp_st default unsat ✅ 9.50449 4.94460
stp_mt default unsat ✅ 9.18157 16.95600
Yices2 Yices2-Main default unsat ✅ 0.01174 0.01095
Z3 z3-4.5.0 default unknown ❌ 600.10800 600.08500
SMT-COMP 2018 0.14 (6/7) Boolector Boolector_default unsat ✅ 0.04178 0.04172
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 0.27810 0.27823
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 0.11665 0.11771
MinkeyRink Minkeyrink MT_mt unsat ✅ 0.07483 0.08931
Minkeyrink ST_st unsat ✅ 0.07062 0.07081
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 5.10480 5.10423
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 5.35159 20.97060
STP-Riss-st-2018_riss-no-stderr unsat ✅ 5.39976 5.39945
Yices2 Yices 2.6.0_default unsat ✅ 0.01208 0.01199
Z3 z3-4.7.1_default unknown ❌ 1200.02000 1199.99000
SMT-COMP 2019 0.12 (7/8) Boolector Boolector-wrapped-sq_default unsat ✅ 0.06662 0.06664
Poolector-wrapped-sq_default unsat ✅ 0.17747 0.19989
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default unsat ✅ 0.33500 0.33498
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 0.16859 0.16884
MinkeyRink MinkeyRink MT-wrapped-sq_default unsat ✅ 0.05133 0.05796
MinkeyRink ST-wrapped-sq_default unsat ✅ 0.04763 0.04773
Par4 Par4-wrapped-sq_default unsat ✅ 0.02221 0.00586
STP STP-2019-wrapped-sq_default unsat ✅ 116.54200 116.54800
stp-mergesat-fixed-wrapped-sq_default unsat ✅ 581.04000 580.95700
stp-minisat-wrapped-sq_default unknown ❌ 2400.10000 2400.06000
stp-mt-wrapped-sq_default unsat ✅ 81.17540 322.14000
stp-portfolio-fixed-wrapped-sq_default unsat ✅ 2400.12000 3114.71000
stp-riss-wrapped-sq_default unknown ❌ 0.10200 0.10219
Yices2 Yices 2.6.2-wrapped-sq_default unsat ✅ 0.01261 0.01261
Yices 2.6.2 Cadical-wrapped-sq_default unsat ✅ 0.01722 0.01720
Yices 2.6.2 Cryptominisat-wrapped-sq_default unsat ✅ 0.01528 0.01530
Yices 2.6.2 MCSAT BV-wrapped-sq_default unknown ❌ 2400.02000 2399.72000
Yices 2.6.2 new bvsolver-wrapped-sq_default unsat ✅ 0.02020 0.02022
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unknown ❌ 2400.11000 2399.91000
SMT-COMP 2020 0.11 (8/9) Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.08969 0.08961
Boolector Boolector-wrapped-sq_default unsat ✅ 0.08699 0.08699
Poolector-wrapped-sq_default unsat ✅ 0.18054 0.22623
CVC4 CVC4-sq-final_default unsat ✅ 32.67430 32.67580
LazyBV2Int LazyBV2Int20200523_default.sh unsat ✅ 0.19555 0.19552
MathSAT MathSAT5_default.sh unsat ✅ 0.08334 0.08331
MinkeyRink MinkeyRink Solver 2020.3.1_default unknown ❌ 0.04846 0.04868
MinkeyRink Solver 2020.3_default unsat ✅ 0.05137 0.05925
STP STP_default unsat ✅ 0.04865 0.05735
STP ++ Mergsat v1_default unsat ✅ 0.03744 0.03910
Yices2 Yices 2.6.2 bug fix_default unsat ✅ 0.01861 0.01392
Z3 z3-4.8.8_default unknown ❌ 1200.01000 1199.94000
SMT-COMP 2021 0.25 (3/4) Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.08018 0.08010
MathSAT mathsat-5.6.6_default unsat ✅ 0.08123 0.08118
STP STP 2021.0_default unsat ✅ 0.04909 0.05690
Z3 z3-4.8.11_default unknown ❌ 1200.02000 1199.89000
SMT-COMP 2022 0.29 (5/7) Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.08726 0.08723
Bitwuzla-wrapped_default unsat ✅ 0.08710 0.08707
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 3.55231 3.55313
MathSAT MathSAT-5.6.8_default unsat ✅ 0.06586 0.06581
STP STP 2022.4_default unsat ✅ 0.04755 0.04759
Yices2 Yices 2.6.2 for SMTCOMP 2021_default unsat ✅ 0.01463 0.01381
Z3++BV z3++bv_0702_default unknown ❌ 1200.10000 1200.05000
Z3 z3-4.8.17_default unknown ❌ 1200.01000 1199.89000
SMT-COMP 2025 0.33 (6/9) Bitwuzla Bitwuzla unsat ✅ 0.30165 0.17136
Bitwuzla-MachBV-base unsat ✅ 2.11319 1.99400
Bitwuzla-MachBV Bitwuzla-MachBV unsat ✅ 0.39983 0.28007
BVDecide bv_decide unsat ✅ 2.60303 2.43452
bv_decide-nokernel unsat ✅ 1.49448 1.32481
cvc5 cvc5 unsat ✅ 2.46211 2.34721
SMTInterpol SMTInterpol unsat ✅ 0.94969 2.19957
Yices2 Yices2 unsat ✅ 0.29876 0.17225
Z3alpha Z3-alpha unknown ❌ 1201.00643 4802.31244
Z3 Z3-alpha-base unknown ❌ 1201.25885 1201.02190
Z3-Owl-base unknown ❌ 1201.32556 1201.04330
z3siri-base unknown ❌ 1201.30445 1201.06036
Z3-Owl Z3-Owl unknown ❌ 1201.75406 1201.01007