Benchmark

non-incremental/QF_BV/Sage2/bench_14256.smt2

Patrice Godefroid, SAGE (systematic dynamic test generation). For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size1653530
Compressed Size31797
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2015-07-02
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status sat
Inferred Status sat
Size 1653522
Compressed Size31788
Max. Term Depth1990
Asserts 369
Declared Functions0
Declared Constants1108
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 false1 ite380 not41
=47 let36862 extract5 bvand2
bvor6 bvadd12316 bvmul2562 bvudiv9
bvult425 bvule103 bvugt37 bvuge133
bvsle1 bvsge3 bvshl8888 bvlshr28
zero_extend12244

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2017 0.38 (5/8) Boolector Boolector+CaDiCaL SMT17 final boolector sat ✅ 4.64306 4.64094
Boolector SMT17 final boolector sat ✅ 9.96134 9.96047
CVC4 CVC4-smtcomp2017-main default sat ✅ 23.96350 47.33760
MathSAT mathsat-5.4.1-linux-x86_64-Main default unknown ❌ 600.02100 599.79000
MinkeyRink MinkeyRink 2017.3a default sat ✅ 9.02827 11.97000
Q3B Q3B default unknown ❌ 600.03300 1799.56000
STP stp_st default sat ✅ 277.61400 277.56900
stp_mt default sat ✅ 87.48890 337.93300
Yices2 Yices2-Main default sat ✅ 1.34022 1.33958
Z3 z3-4.5.0 default unknown ❌ 600.01500 599.90700
SMT-COMP 2018 0.14 (6/7) Boolector Boolector_default sat ✅ 5.62613 5.62612
CVC4 master-2018-06-10-b19c840-competition-default_default sat ✅ 12.17010 12.16940
MathSAT mathsat-5.5.2-linux-x86_64-Main_default sat ✅ 562.10400 562.01000
MinkeyRink Minkeyrink MT_mt sat ✅ 12.54240 28.70920
Minkeyrink ST_st sat ✅ 20.46120 20.46070
STP STP-CMS-st-2018_default-no-stderr sat ✅ 112.74000 112.73600
STP-CMS-mt-2018_multicore-no-stderr sat ✅ 45.00180 171.82400
STP-Riss-st-2018_riss-no-stderr sat ✅ 176.66700 176.65200
Yices2 Yices 2.6.0_default sat ✅ 0.80364 0.80354
Z3 z3-4.7.1_default unknown ❌ 1200.01000 1199.84000
SMT-COMP 2019 0.12 (7/8) Boolector Boolector-wrapped-sq_default sat ✅ 1.55455 1.55461
Poolector-wrapped-sq_default sat ✅ 1.90036 6.85534
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default sat ✅ 17.79590 17.79700
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default sat ✅ 17.95220 17.94860
MinkeyRink MinkeyRink MT-wrapped-sq_default sat ✅ 21.22060 80.73360
MinkeyRink ST-wrapped-sq_default sat ✅ 5.74019 5.74029
Par4 Par4-wrapped-sq_default sat ✅ 0.75209 2.11000
STP STP-2019-wrapped-sq_default sat ✅ 20.13320 20.13390
stp-mergesat-fixed-wrapped-sq_default sat ✅ 22.22660 22.22650
stp-minisat-wrapped-sq_default sat ✅ 50.50040 50.49910
stp-mt-wrapped-sq_default sat ✅ 23.52900 86.91880
stp-portfolio-fixed-wrapped-sq_default sat ✅ 53.59970 97.66700
stp-riss-wrapped-sq_default unknown ❌ 1.97620 1.97637
Yices2 Yices 2.6.2-wrapped-sq_default sat ✅ 0.82602 0.82586
Yices 2.6.2 Cadical-wrapped-sq_default sat ✅ 5.47642 5.47568
Yices 2.6.2 Cryptominisat-wrapped-sq_default sat ✅ 60.04770 60.03890
Yices 2.6.2 MCSAT BV-wrapped-sq_default unknown ❌ 2400.02000 2399.95000
Yices 2.6.2 new bvsolver-wrapped-sq_default sat ✅ 2.48994 2.48958
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unknown ❌ 2400.02000 2399.55000
SMT-COMP 2020 0.33 (6/9) Bitwuzla Bitwuzla-fixed_default sat ✅ 5.54174 5.54204
Boolector Boolector-wrapped-sq_default sat ✅ 5.19309 5.19267
Poolector-wrapped-sq_default sat ✅ 3.99134 15.14450
CVC4 CVC4-sq-final_default sat ✅ 223.33200 223.26700
LazyBV2Int LazyBV2Int20200523_default.sh unknown ❌ 1200.05000 1199.98000
MathSAT MathSAT5_default.sh unknown ❌ 1200.02000 1199.73000
MinkeyRink MinkeyRink Solver 2020.3.1_default unknown ❌ 1.13731 1.13750
MinkeyRink Solver 2020.3_default sat ✅ 4.78746 15.58700
STP STP_default sat ✅ 4.31245 14.47330
STP ++ Mergsat v1_default sat ✅ 9.10557 9.10589
Yices2 Yices 2.6.2 bug fix_default sat ✅ 4.92910 4.92916
Z3 z3-4.8.8_default unknown ❌ 1200.02000 1199.77000
SMT-COMP 2021 0.50 (2/4) Bitwuzla Bitwuzla-fixed_default sat ✅ 6.03085 6.03002
MathSAT mathsat-5.6.6_default unknown ❌ 1200.01000 1199.54000
STP STP 2021.0_default sat ✅ 3.17491 9.95792
Z3 z3-4.8.11_default unknown ❌ 1200.01000 1199.91000
SMT-COMP 2023 0.17 (5/6) Bitwuzla Bitwuzla-fixed_default sat ✅ 7.45373 7.45239
cvc5 cvc5-default-2023-05-16-ea045f305_sq sat ✅ 159.86600 159.81300
STP STP 2022.4_default sat ✅ 4.19898 4.19883
STP 2022.4_default sat ✅ 4.19896 4.19890
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unknown ❌ 4.82387 13.25830
Yices2 Yices 2 for SMTCOMP 2023_default sat ✅ 1.53179 1.53163
Z3-Owl z3-Owl-Final_default unknown ❌ 1200.03000 1199.91000
z3-Owl-Final_default sat ✅ 123.84000 123.83500
SMT-COMP 2025 0.56 (4/9) Bitwuzla Bitwuzla sat ✅ 2.91432 2.78758
Bitwuzla-MachBV-base sat ✅ 3.75031 3.63340
Bitwuzla-MachBV Bitwuzla-MachBV sat ✅ 3.48176 3.36229
BVDecide bv_decide unknown ❌ 1201.89905 1201.95634
bv_decide-nokernel unknown ❌ 1201.89441 1201.93488
cvc5 cvc5 sat ✅ 121.60603 121.44618
SMTInterpol SMTInterpol unknown ❌ 36.91494 56.34615
Yices2 Yices2 sat ✅ 3.42430 3.28937
Z3alpha Z3-alpha unknown ❌ 1201.00701 4802.10934
Z3 Z3-alpha-base unknown ❌ 1201.32473 1201.08144
Z3-Owl-base unknown ❌ 1201.29902 1201.02361
z3siri-base unknown ❌ 1201.41011 1201.10346
Z3-Owl Z3-Owl unknown ❌ 1201.80836 1201.11380