Benchmark

non-incremental/QF_BV/Sage2/bench_1704.smt2

Patrice Godefroid, SAGE (systematic dynamic test generation). For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size24097
Compressed Size2096
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2015-07-02
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status sat
Inferred Status sat
Size 24089
Compressed Size2109
Max. Term Depth60
Asserts 119
Declared Functions0
Declared Constants19
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 not93 =99 let486
bvadd102 bvmul102 bvult19 zero_extend189

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT-COMP 2017 0.12 (7/8) Boolector Boolector+CaDiCaL SMT17 final boolector sat ✅ 88.44550 49.36870
Boolector SMT17 final boolector sat ✅ 72.04060 72.02390
CVC4 CVC4-smtcomp2017-main default sat ✅ 5.87294 11.74290
MathSAT mathsat-5.4.1-linux-x86_64-Main default sat ✅ 11.75190 11.75240
MinkeyRink MinkeyRink 2017.3a default sat ✅ 2.74312 2.75087
Q3B Q3B default unknown ❌ 600.05400 1799.69000
STP stp_st default sat ✅ 9.11771 9.11822
stp_mt default sat ✅ 12.47880 38.64930
Yices2 Yices2-Main default sat ✅ 18.06530 18.06550
Z3 z3-4.5.0 default sat ✅ 472.54400 472.53300
SMT-COMP 2018 Boolector Boolector_default sat ✅ 36.73890 36.73600
CVC4 master-2018-06-10-b19c840-competition-default_default sat ✅ 13.49380 13.49300
MathSAT mathsat-5.5.2-linux-x86_64-Main_default sat ✅ 8.22451 8.22497
MinkeyRink Minkeyrink MT_mt sat ✅ 1.78552 6.79665
Minkeyrink ST_st sat ✅ 4.02979 4.02961
STP STP-CMS-st-2018_default-no-stderr sat ✅ 4.57446 4.57397
STP-CMS-mt-2018_multicore-no-stderr sat ✅ 3.25774 12.45550
STP-Riss-st-2018_riss-no-stderr sat ✅ 1.05547 1.05556
Yices2 Yices 2.6.0_default sat ✅ 54.49280 54.49210
Z3 z3-4.7.1_default sat ✅ 59.34140 59.33640
SMT-COMP 2023 Bitwuzla Bitwuzla-fixed_default sat ✅ 16.10560 16.10430
cvc5 cvc5-default-2023-05-16-ea045f305_sq sat ✅ 87.78460 87.77770
STP STP 2022.4_default sat ✅ 7.44152 7.44198
STP 2022.4_default sat ✅ 7.42654 7.42486
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default sat ✅ 155.01200 183.86800
Yices2 Yices 2 for SMTCOMP 2023_default sat ✅ 22.00410 22.00300
Z3-Owl z3-Owl-Final_default sat ✅ 37.00790 37.01050
z3-Owl-Final_default sat ✅ 24.01750 24.01430
SMT-COMP 2024 0.17 (5/6) Bitwuzla Bitwuzla sat ✅ 23.37899 23.27867
cvc5 cvc5 sat ✅ 4.80310 4.69768
SMTInterpol SMTInterpol unknown ❌ 1201.74062 1216.98480
STP STP sat ✅ 45.96435 45.84582
Yices2 Yices2 sat ✅ 16.84502 16.73500
Z3alpha Z3-alpha sat ✅ 488.10011 487.97442
SMT-COMP 2025 0.11 (8/9) Bitwuzla Bitwuzla sat ✅ 8.18953 8.07052
Bitwuzla-MachBV-base sat ✅ 6.30544 6.17224
Bitwuzla-MachBV Bitwuzla-MachBV sat ✅ 9.47158 9.35311
BVDecide bv_decide sat ✅ 19.68442 19.54916
bv_decide-nokernel sat ✅ 19.74445 19.57309
cvc5 cvc5 sat ✅ 41.43193 41.30171
SMTInterpol SMTInterpol unknown ❌ 1201.37082 1222.59345
Yices2 Yices2 sat ✅ 20.30498 20.16850
Z3alpha Z3-alpha sat ✅ 7.01511 26.74457
Z3 Z3-alpha-base sat ✅ 256.24935 256.08713
Z3-Owl-base sat ✅ 1065.63995 1065.31748
z3siri-base sat ✅ 260.35078 260.17532
Z3-Owl Z3-Owl sat ✅ 41.84669 41.72075