Benchmark

non-incremental/QF_BV/Sage2/bench_12983.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation). For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size977741
Compressed Size40011
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2015-07-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status sat
Inferred Status sat
Size 977733
Compressed Size40000
Max. Term Depth630
Asserts 1202
Declared Functions0
Declared Constants786
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 ite26 not208 =530
let20302 extract33 bvand36 bvor331
bvadd10186 bvmul2778 bvult186 bvule224
bvugt66 bvuge221 bvshl351 bvlshr63
zero_extend6264

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2017 0.50 (4/8) Boolector Boolector+CaDiCaL SMT17 final boolector sat ✅ 130.69500 130.69500
Boolector SMT17 final boolector sat ✅ 239.90500 239.87300
CVC4 CVC4-smtcomp2017-main default unknown ❌ 600.08800 1207.73000
MathSAT mathsat-5.4.1-linux-x86_64-Main default unknown ❌ 600.10600 599.88000
MinkeyRink MinkeyRink 2017.3a default sat ✅ 34.69690 64.30000
Q3B Q3B default unknown ❌ 600.05200 1785.56000
STP stp_st default sat ✅ 110.43200 110.42600
stp_mt default sat ✅ 85.97540 255.45900
Yices2 Yices2-Main default sat ✅ 12.96500 12.96260
Z3 z3-4.5.0 default unknown ❌ 600.10700 600.01100
SMT-COMP 2018 0.43 (4/7) Boolector Boolector_default sat ✅ 65.29730 65.29410
CVC4 master-2018-06-10-b19c840-competition-default_default sat ✅ 73.61880 73.61270
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unknown ❌ 1200.02000 1200.00000
MinkeyRink Minkeyrink MT_mt sat ✅ 12.91730 48.93370
Minkeyrink ST_st sat ✅ 70.06240 70.05480
STP STP-CMS-st-2018_default-no-stderr unknown ❌ 1200.11000 1200.05000
STP-CMS-mt-2018_multicore-no-stderr unknown ❌ 1200.08000 4750.28000
STP-Riss-st-2018_riss-no-stderr unknown ❌ 1200.01000 1199.69000
Yices2 Yices 2.6.0_default sat ✅ 11.96590 11.96500
Z3 z3-4.7.1_default unknown ❌ 1200.02000 1199.87000
SMT-COMP 2019 0.12 (7/8) Boolector Boolector-wrapped-sq_default sat ✅ 59.50220 59.49660
Poolector-wrapped-sq_default sat ✅ 68.05160 269.45000
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default sat ✅ 186.16300 186.14400
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default sat ✅ 83.31190 83.30850
MinkeyRink MinkeyRink MT-wrapped-sq_default sat ✅ 45.66450 163.59000
MinkeyRink ST-wrapped-sq_default sat ✅ 27.42820 27.42960
Par4 Par4-wrapped-sq_default sat ✅ 8.06529 23.97000
STP STP-2019-wrapped-sq_default unknown ❌ 2400.04000 2399.84000
stp-mergesat-fixed-wrapped-sq_default unknown ❌ 2400.11000 2399.79000
stp-minisat-wrapped-sq_default unknown ❌ 2400.03000 2399.55000
stp-mt-wrapped-sq_default unknown ❌ 2400.09000 9513.21000
stp-portfolio-fixed-wrapped-sq_default unknown ❌ 2400.07000 7184.85000
stp-riss-wrapped-sq_default unknown ❌ 8.99020 8.01904
Yices2 Yices 2.6.2-wrapped-sq_default sat ✅ 7.26504 7.26381
Yices 2.6.2 Cadical-wrapped-sq_default sat ✅ 3.11777 3.11769
Yices 2.6.2 Cryptominisat-wrapped-sq_default sat ✅ 11.02270 11.02270
Yices 2.6.2 MCSAT BV-wrapped-sq_default unknown ❌ 2400.02000 2399.86000
Yices 2.6.2 new bvsolver-wrapped-sq_default sat ✅ 2.68985 2.68982
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default sat ✅ 1791.19000 1791.20000
SMT-COMP 2020 0.22 (7/9) Bitwuzla Bitwuzla-fixed_default sat ✅ 21.26660 21.25210
Boolector Boolector-wrapped-sq_default sat ✅ 114.55800 114.55600
Poolector-wrapped-sq_default sat ✅ 136.35700 539.45000
CVC4 CVC4-sq-final_default sat ✅ 69.50960 69.50580
LazyBV2Int LazyBV2Int20200523_default.sh unknown ❌ 1200.04000 1199.85000
MathSAT MathSAT5_default.sh unknown ❌ 1200.02000 1199.70000
MinkeyRink MinkeyRink Solver 2020.3.1_default unknown ❌ 0.76042 0.76060
MinkeyRink Solver 2020.3_default sat ✅ 11.79550 44.46040
STP STP_default sat ✅ 30.35000 118.09300
STP ++ Mergsat v1_default sat ✅ 43.58800 43.58630
Yices2 Yices 2.6.2 bug fix_default sat ✅ 1.91441 1.91427
Z3 z3-4.8.8_default sat ✅ 397.98900 397.98700
SMT-COMP 2023 0.17 (5/6) Bitwuzla Bitwuzla-fixed_default sat ✅ 69.76260 69.75500
cvc5 cvc5-default-2023-05-16-ea045f305_sq sat ✅ 108.95500 108.95300
STP STP 2022.4_default sat ✅ 44.98070 44.97840
STP 2022.4_default sat ✅ 45.20910 45.20380
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unknown ❌ 1200.02000 1256.58000
Yices2 Yices 2 for SMTCOMP 2023_default sat ✅ 10.63960 10.63950
Z3-Owl z3-Owl-Final_default sat ✅ 920.19800 919.92600
z3-Owl-Final_default sat ✅ 454.91000 454.88000
SMT-COMP 2024 0.33 (4/6) Bitwuzla Bitwuzla sat ✅ 3.76668 3.66676
cvc5 cvc5 sat ✅ 46.81876 46.69817
SMTInterpol SMTInterpol unknown ❌ 1201.74682 1237.69130
STP STP sat ✅ 51.40008 51.29864
Yices2 Yices2 sat ✅ 2.05091 1.95104
Z3alpha Z3-alpha unknown ❌ 1201.72918 1201.09466
SMT-COMP 2025 0.44 (5/9) Bitwuzla Bitwuzla sat ✅ 28.02655 27.90324
Bitwuzla-MachBV-base sat ✅ 29.22362 29.10525
Bitwuzla-MachBV Bitwuzla-MachBV sat ✅ 28.93495 28.80983
BVDecide bv_decide sat ✅ 75.76548 75.65093
bv_decide-nokernel sat ✅ 72.70810 72.55440
cvc5 cvc5 sat ✅ 79.12001 78.98403
SMTInterpol SMTInterpol unknown ❌ 1201.56890 1228.45485
Yices2 Yices2 sat ✅ 1.96735 1.84250
Z3alpha Z3-alpha unknown ❌ 1201.00482 4801.30168
Z3 Z3-alpha-base unknown ❌ 1201.34880 1201.09945
Z3-Owl-base unknown ❌ 1201.35042 1201.07455
z3siri-base unknown ❌ 1201.33642 1201.05858
Z3-Owl Z3-Owl unknown ❌ 1201.75579 1201.24207