Benchmark

non-incremental/QF_BV/sage/app7/bench_1164.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation)
 For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size2145458
Compressed Size144971
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 2145450
Compressed Size144973
Max. Term Depth8397
Asserts 1
Declared Functions0
Declared Constants42
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 ite10 not1713 and1
=2307 let8187 extract1274 bvand21872
bvor14296 bvxor1496 bvadd23564 bvmul1
bvsub7608 bvult438 bvule479 bvslt204
bvsle101 bvshl7446 bvashr13931 zero_extend991

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 4Simp 4Simp-SMT-COMP-2012 default unsat ✅ 0.32838 —
Abziz abziz_portfolio_2011_minfeatures_2 default unsat ✅ 0.44339 —
abziz_portfolio_2011_solvers_2 default unsat ✅ 0.45271 —
abziz_portfolio_2012_minfeatures default unsat ✅ 0.44700 —
abziz_portfolio_2012_solvers default unsat ✅ 0.44958 —
AbzizPortfolio-SMT-COMP-2012 default unsat ✅ 0.44742 —
Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 0.44461 —
Boolector-SMT-COMP-2011 default unsat ✅ 0.51043 —
Boolector-SMT-COMP-2012 default unsat ✅ 0.46826 —
CVC3 CVC3-SMT-COMP-2010 default unsat ✅ 111.79800 —
CVC3-SMT-COMP-2011 default unsat ✅ 94.58420 —
CVC3-SMT-COMP-2012 default unsat ✅ 98.98120 —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 1.80800 —
CVC4-SMT-EVAL-2013 default unsat ✅ 2.82937 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 0.63703 —
MathSAT5-HeavyBV-SMT-COMP-2012 default unsat ✅ 0.60694 —
MathSAT5-SMT-COMP-2011 default unsat ✅ 0.79956 —
MathSAT5-SMT-COMP-2012 default unsat ✅ 0.77918 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unsat ✅ 0.56847 —
SONOLAR-SMT-COMP-2010 default unsat ✅ 2.89223 —
SONOLAR-SMT-COMP-2011 default unsat ✅ 3.99949 —
SONOLAR-SMT-COMP-2012 default unsat ✅ 0.89077 —
STP STP2-SMT-COMP-2011 default unsat ✅ 0.34514 —
STP2-SMT-COMP-2012 default unsat ✅ 0.32828 —
simplifyingSTP-SMT-COMP-2010 default unsat ✅ 0.33077 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 0.45094 —
Z3-SMT-COMP-2011 default unsat ✅ 0.44024 —
SMT-COMP 2015 0.14 (6/7) Boolector Boolector SMT15 QF_BV final boolector_qf_bv unsat ✅ 0.59257 0.59191
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 2.79223 4.49431
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 2.78228 4.48632
MathSAT MathSat 5.3.6 main smtcomp2015_main unsat ✅ 0.45079 0.44993
SMT-RAT SMT-RAT-final default unknown ❌ 2400.01000 2400.95000
STP stp-cryptominisat4 default unsat ✅ 0.29309 0.29196
stp-cmsat4-v15 default unsat ✅ 0.28765 0.28696
stp-cmsat4-mt-v15 default unsat ✅ 0.28848 0.28796
stp-minisat-v15 default unsat ✅ 0.28754 0.28696
Yices2 Yices default unsat ✅ 0.12438 0.12298
Z3 z3 4.4.0 default unsat ✅ 0.39426 0.39394
SMT-COMP 2016 ABC ABC_default default_abc unsat ✅ 1.22136 1.22170
ABC_glucose glucose unsat ✅ 1.20117 1.20250
Boolector Boolector boolector unsat ✅ 0.65579 0.65619
Boolector preprop boolector unsat ✅ 0.64058 0.64089
CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 2.76008 4.46643
MapleSTP MapleSTP default unsat ✅ 0.27445 0.27457
MapleSTP-mt default unsat ✅ 0.27702 0.27707
MathSAT mathsat-5.3.11-linux-x86_64-Main default unsat ✅ 0.76575 0.76729
MinkeyRink Minkeyrink 2016 default unsat ✅ 0.39560 0.39579
Q3B Q3B default unsat ✅ 0.62075 1.28000
STP stp-cms-exp-2016 default unsat ✅ 0.28086 0.28095
stp-cms-mt-2016 default unsat ✅ 0.54369 0.53557
stp-cms-st-2016 default unsat ✅ 0.28456 0.28465
stp-minisat-st-2016 default unsat ✅ 0.28464 0.28480
Yices2 Yices-2.4.2 default unsat ✅ 0.12312 0.12316
Z3 z3-4.4.1 default unsat ✅ 0.36609 0.36820
SMT-COMP 2017 Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 0.56761 0.56698
Boolector SMT17 final boolector unsat ✅ 0.56385 0.56322
CVC4 CVC4-smtcomp2017-main default unsat ✅ 2.81453 4.50473
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.46228 0.45919
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 0.82690 0.82576
Q3B Q3B default unsat ✅ 0.64649 1.55000
STP stp_st default unsat ✅ 0.42197 0.41931
stp_mt default unsat ✅ 0.37764 0.37604
Yices2 Yices2-Main default unsat ✅ 0.11734 0.11668
Z3 z3-4.5.0 default unsat ✅ 0.38116 0.37236
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 0.49167 0.49158
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 2.52572 2.52570
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 0.39989 0.40090
MinkeyRink Minkeyrink MT_mt unsat ✅ 0.84029 0.84023
Minkeyrink ST_st unsat ✅ 0.83985 0.83989
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 0.37545 0.37555
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 0.38190 0.38190
STP-Riss-st-2018_riss-no-stderr unsat ✅ 0.37508 0.37516
Yices2 Yices 2.6.0_default unsat ✅ 0.11338 0.11329
Z3 z3-4.7.1_default unsat ✅ 0.38615 0.38599
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default unsat ✅ 0.94207 0.94191
Poolector-wrapped-sq_default unsat ✅ 1.20508 4.31248
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default unsat ✅ 0.76685 0.76684
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 2.63346 2.63354
MinkeyRink MinkeyRink MT-wrapped-sq_default unsat ✅ 0.60467 0.60484
MinkeyRink ST-wrapped-sq_default unsat ✅ 0.60347 0.60356
Par4 Par4-wrapped-sq_default unsat ✅ 0.12353 0.00581
STP STP-2019-wrapped-sq_default unsat ✅ 0.38366 0.38377
stp-mergesat-fixed-wrapped-sq_default unsat ✅ 0.38025 0.38039
stp-minisat-wrapped-sq_default unsat ✅ 0.38337 0.38349
stp-mt-wrapped-sq_default unsat ✅ 0.38320 0.38333
stp-portfolio-fixed-wrapped-sq_default unsat ✅ 0.37938 0.37953
stp-riss-wrapped-sq_default unsat ✅ 0.38500 0.38512
Yices2 Yices 2.6.2-wrapped-sq_default unsat ✅ 0.11862 0.11863
Yices 2.6.2 Cadical-wrapped-sq_default unsat ✅ 0.11820 0.11818
Yices 2.6.2 Cryptominisat-wrapped-sq_default unsat ✅ 0.11758 0.11755
Yices 2.6.2 MCSAT BV-wrapped-sq_default unsat ✅ 0.11693 0.11696
Yices 2.6.2 new bvsolver-wrapped-sq_default unsat ✅ 0.11825 0.11828
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 0.41182 0.41172
SMT-COMP 2021 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.74842 0.74833
MathSAT mathsat-5.6.6_default unsat ✅ 0.42472 0.42466
STP STP 2021.0_default unsat ✅ 0.36821 0.36835
Z3 z3-4.8.11_default unsat ✅ 0.33844 0.33840
SMT-COMP 2023 Bitwuzla Bitwuzla-fixed_default unsat ✅ 1.16901 1.16881
cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 1.91273 1.91311
STP STP 2022.4_default unsat ✅ 0.38847 0.38841
STP 2022.4_default unsat ✅ 0.40028 0.39990
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unsat ✅ 543.48500 619.31300
Yices2 Yices 2 for SMTCOMP 2023_default unsat ✅ 0.13768 0.13759
Z3-Owl z3-Owl-Final_default unsat ✅ 1.01255 1.01264
z3-Owl-Final_default unsat ✅ 1.02700 1.02734
SMT-COMP 2024 Bitwuzla Bitwuzla unsat ✅ 0.88121 0.78141
cvc5 cvc5 unsat ✅ 0.70417 0.60309
SMTInterpol SMTInterpol unsat ✅ 1092.73067 1633.90172
STP STP unsat ✅ 12.95501 12.85492
Yices2 Yices2 unsat ✅ 0.30313 0.20337
Z3alpha Z3-alpha unsat ✅ 0.44146 0.34184
SMT-COMP 2025 0.22 (7/9) Bitwuzla Bitwuzla unsat ✅ 0.71562 0.59286
Bitwuzla-MachBV-base unsat ✅ 0.83622 0.70323
Bitwuzla-MachBV Bitwuzla-MachBV unsat ✅ 0.90458 0.78604
BVDecide bv_decide unknown ❌ 1201.35858 1201.00611
bv_decide-nokernel unknown ❌ 1201.38388 1201.02252
cvc5 cvc5 unsat ✅ 0.87236 0.75582
SMTInterpol SMTInterpol unknown ❌ 1201.85535 2868.93580
Yices2 Yices2 unsat ✅ 0.35121 0.22728
Z3alpha Z3-alpha unsat ✅ 0.68930 0.63841
Z3 Z3-alpha-base unsat ✅ 0.44812 0.32731
Z3-Owl-base unsat ✅ 1.03677 0.91688
z3siri-base unsat ✅ 0.43398 0.30697
Z3-Owl Z3-Owl unsat ✅ 1.00285 0.87325