Benchmark

non-incremental/QF_BV/Sage2/bench_13045.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation). For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size631166
Compressed Size47949
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2015-07-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status sat
Inferred Status sat
Size 631158
Compressed Size47940
Max. Term Depth2821
Asserts 1043
Declared Functions0
Declared Constants768
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 ite512 not497 =1341
let12901 bvor256 bvadd4248 bvmul1388
bvult40 bvule40 bvugt40 bvuge43
bvsle9 bvsgt41 bvshl256 bvlshr1199
zero_extend4033

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2017 0.50 (4/8) Boolector Boolector+CaDiCaL SMT17 final boolector sat ✅ 0.09746 0.09748
Boolector SMT17 final boolector sat ✅ 0.09794 0.09761
CVC4 CVC4-smtcomp2017-main default sat ✅ 37.05190 73.97050
MathSAT mathsat-5.4.1-linux-x86_64-Main default unknown ❌ 600.03300 592.53000
MinkeyRink MinkeyRink 2017.3a default sat ✅ 1.84666 1.85697
Q3B Q3B default unknown ❌ 600.05400 1425.34000
STP stp_st default unknown ❌ 600.04500 599.93300
stp_mt default unknown ❌ 600.04300 2380.80000
Yices2 Yices2-Main default sat ✅ 0.18252 0.18246
Z3 z3-4.5.0 default unknown ❌ 600.08600 599.92700
SMT-COMP 2018 0.29 (5/7) Boolector Boolector_default sat ✅ 0.08752 0.08747
CVC4 master-2018-06-10-b19c840-competition-default_default sat ✅ 32.30840 32.30800
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unknown ❌ 1200.01000 1199.83000
MinkeyRink Minkeyrink MT_mt sat ✅ 6.36462 23.27400
Minkeyrink ST_st sat ✅ 3.52563 3.52559
STP STP-CMS-st-2018_default-no-stderr unknown ❌ 1200.02000 1199.89000
STP-CMS-mt-2018_multicore-no-stderr unknown ❌ 1200.06000 4764.24000
STP-Riss-st-2018_riss-no-stderr sat ✅ 231.82700 231.79900
Yices2 Yices 2.6.0_default sat ✅ 0.16852 0.16842
Z3 z3-4.7.1_default unknown ❌ 1200.11000 1199.99000
SMT-COMP 2019 0.12 (7/8) Boolector Boolector-wrapped-sq_default sat ✅ 0.12535 0.12533
Poolector-wrapped-sq_default sat ✅ 0.28168 0.23246
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default sat ✅ 2335.27000 2334.88000
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default sat ✅ 5.67289 5.67310
MinkeyRink MinkeyRink MT-wrapped-sq_default sat ✅ 4.72789 16.55690
MinkeyRink ST-wrapped-sq_default sat ✅ 11.51920 11.51860
Par4 Par4-wrapped-sq_default sat ✅ 0.09441 0.00580
STP STP-2019-wrapped-sq_default sat ✅ 1939.31000 1939.17000
stp-mergesat-fixed-wrapped-sq_default sat ✅ 268.45600 268.37300
stp-minisat-wrapped-sq_default sat ✅ 574.13600 574.10500
stp-mt-wrapped-sq_default sat ✅ 1786.35000 7091.51000
stp-portfolio-fixed-wrapped-sq_default sat ✅ 2042.30000 3054.24000
stp-riss-wrapped-sq_default unknown ❌ 1.48264 1.48288
Yices2 Yices 2.6.2-wrapped-sq_default sat ✅ 0.18604 0.18608
Yices 2.6.2 Cadical-wrapped-sq_default sat ✅ 0.50582 0.50584
Yices 2.6.2 Cryptominisat-wrapped-sq_default unknown ❌ 2400.03000 2399.69000
Yices 2.6.2 MCSAT BV-wrapped-sq_default sat ✅ 944.55700 944.43400
Yices 2.6.2 new bvsolver-wrapped-sq_default sat ✅ 0.46391 0.46392
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unknown ❌ 2400.02000 2399.56000
SMT-COMP 2020 0.11 (8/9) Bitwuzla Bitwuzla-fixed_default sat ✅ 0.55837 0.55830
Boolector Boolector-wrapped-sq_default sat ✅ 0.12430 0.12433
Poolector-wrapped-sq_default sat ✅ 0.28912 0.23860
CVC4 CVC4-sq-final_default sat ✅ 5.58830 5.58792
LazyBV2Int LazyBV2Int20200523_default.sh unknown ❌ 1200.04000 1199.82000
MathSAT MathSAT5_default.sh sat ✅ 4.47804 4.47744
MinkeyRink MinkeyRink Solver 2020.3.1_default unknown ❌ 0.73010 0.73029
MinkeyRink Solver 2020.3_default sat ✅ 10.88970 40.99260
STP STP_default sat ✅ 493.67500 1957.20000
STP ++ Mergsat v1_default sat ✅ 266.28400 266.28200
Yices2 Yices 2.6.2 bug fix_default sat ✅ 442.56900 442.48800
Z3 z3-4.8.8_default sat ✅ 337.65100 337.54400