Benchmark

non-incremental/QF_BV/Sage2/bench_1614.smt2

Patrice Godefroid, SAGE (systematic dynamic test generation). For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size16669
Compressed Size1606
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2015-07-02
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status sat
Inferred Status sat
Size 16661
Compressed Size1613
Max. Term Depth60
Asserts 95
Declared Functions0
Declared Constants19
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 not71 =75 let320
bvadd60 bvmul60 bvult19 zero_extend129

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2017 0.12 (7/8) Boolector Boolector+CaDiCaL SMT17 final boolector sat ✅ 9.95633 9.95509
Boolector SMT17 final boolector sat ✅ 27.28560 27.28190
CVC4 CVC4-smtcomp2017-main default sat ✅ 44.53340 89.29630
MathSAT mathsat-5.4.1-linux-x86_64-Main default sat ✅ 17.14100 17.14010
MinkeyRink MinkeyRink 2017.3a default sat ✅ 5.44296 5.75000
Q3B Q3B default unknown ❌ 600.06500 1799.47000
STP stp_st default sat ✅ 163.64600 163.62600
stp_mt default sat ✅ 29.20850 115.71500
Yices2 Yices2-Main default sat ✅ 180.49900 180.49100
Z3 z3-4.5.0 default sat ✅ 70.95140 70.93880
SMT-COMP 2018 Boolector Boolector_default sat ✅ 9.75742 9.75660
CVC4 master-2018-06-10-b19c840-competition-default_default sat ✅ 804.91700 804.88400
MathSAT mathsat-5.5.2-linux-x86_64-Main_default sat ✅ 2.06971 2.07058
MinkeyRink Minkeyrink MT_mt sat ✅ 1.07990 3.97681
Minkeyrink ST_st sat ✅ 3.13189 3.13255
STP STP-CMS-st-2018_default-no-stderr sat ✅ 88.36470 88.35900
STP-CMS-mt-2018_multicore-no-stderr sat ✅ 17.08560 67.51920
STP-Riss-st-2018_riss-no-stderr sat ✅ 182.36100 182.36200
Yices2 Yices 2.6.0_default sat ✅ 11.89500 11.89490
Z3 z3-4.7.1_default sat ✅ 192.67400 192.67900
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default sat ✅ 23.68540 23.67380
Poolector-wrapped-sq_default sat ✅ 16.63290 65.12290
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default sat ✅ 130.54500 130.52000
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default sat ✅ 103.94200 103.94300
MinkeyRink MinkeyRink MT-wrapped-sq_default sat ✅ 1.93174 7.40012
MinkeyRink ST-wrapped-sq_default sat ✅ 4.76031 4.76025
Par4 Par4-wrapped-sq_default sat ✅ 23.89440 71.45000
STP STP-2019-wrapped-sq_default sat ✅ 29.31380 29.31570
stp-mergesat-fixed-wrapped-sq_default sat ✅ 58.84510 58.84570
stp-minisat-wrapped-sq_default sat ✅ 219.14000 219.12000
stp-mt-wrapped-sq_default sat ✅ 12.89020 50.75290
stp-portfolio-fixed-wrapped-sq_default sat ✅ 214.27600 305.97600
stp-riss-wrapped-sq_default unknown ❌ 0.13726 0.13748
Yices2 Yices 2.6.2-wrapped-sq_default sat ✅ 662.84000 662.78800
Yices 2.6.2 Cadical-wrapped-sq_default sat ✅ 47.14600 47.14870
Yices 2.6.2 Cryptominisat-wrapped-sq_default sat ✅ 23.05100 23.05070
Yices 2.6.2 MCSAT BV-wrapped-sq_default unknown ❌ 2400.01000 2399.72000
Yices 2.6.2 new bvsolver-wrapped-sq_default sat ✅ 310.66200 310.61900
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default sat ✅ 60.82750 60.82520
SMT-COMP 2025 0.11 (8/9) Bitwuzla Bitwuzla sat ✅ 23.23368 23.08769
Bitwuzla-MachBV-base sat ✅ 2.62897 2.49623
Bitwuzla-MachBV Bitwuzla-MachBV sat ✅ 22.52730 22.39435
BVDecide bv_decide sat ✅ 23.47861 23.35378
bv_decide-nokernel sat ✅ 23.53559 23.37380
cvc5 cvc5 sat ✅ 2.79728 2.67541
SMTInterpol SMTInterpol unknown ❌ 1201.38797 1225.43720
Yices2 Yices2 sat ✅ 73.65393 73.51641
Z3alpha Z3-alpha sat ✅ 1.13105 3.18656
Z3 Z3-alpha-base sat ✅ 12.35341 12.23450
Z3-Owl-base sat ✅ 50.82357 50.69159
z3siri-base sat ✅ 12.37134 12.24394
Z3-Owl Z3-Owl sat ✅ 101.73641 101.60264