Benchmark

non-incremental/QF_BV/sage/app2/bench_481.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation)
 For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size357998
Compressed Size44910
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 357990
Compressed Size44919
Max. Term Depth892
Asserts 1
Declared Functions0
Declared Constants1366
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true39 ite1 not264 and1
=438 let870 extract167 bvand1825
bvor73 bvxor60 bvadd3761 bvmul23
bvsub2427 bvsdiv22 bvult132 bvule251
bvslt167 bvsle70 bvshl2244 bvashr1155
zero_extend1507

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 0.22 (7/9) 4Simp 4Simp-SMT-COMP-2012 default unknown ❌ — —
Abziz abziz_portfolio_2011_minfeatures_2 default unsat ✅ 0.06941 —
abziz_portfolio_2011_solvers_2 default unknown ❌ — —
abziz_portfolio_2012_minfeatures default unsat ✅ 0.06455 —
abziz_portfolio_2012_solvers default unsat ✅ 0.06598 —
AbzizPortfolio-SMT-COMP-2012 default unsat ✅ 0.06388 —
Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 0.04784 —
Boolector-SMT-COMP-2011 default unsat ✅ 0.07019 —
Boolector-SMT-COMP-2012 default unsat ✅ 0.05291 —
CVC3 CVC3-SMT-COMP-2010 default unknown ❌ — —
CVC3-SMT-COMP-2011 default unsat ✅ 0.52900 —
CVC3-SMT-COMP-2012 default unsat ✅ 0.52939 —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unknown ❌ — —
CVC4-SMT-EVAL-2013 default unknown ❌ 868.89600 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 0.12488 —
MathSAT5-HeavyBV-SMT-COMP-2012 default unknown ❌ — —
MathSAT5-SMT-COMP-2011 default unsat ✅ 3.18653 —
MathSAT5-SMT-COMP-2012 default unknown ❌ — —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unsat ✅ 0.44074 —
SONOLAR-SMT-COMP-2010 default unknown ❌ — —
SONOLAR-SMT-COMP-2011 default unsat ✅ 0.43966 —
SONOLAR-SMT-COMP-2012 default unknown ❌ — —
STP STP2-SMT-COMP-2011 default unsat ✅ 0.26027 —
STP2-SMT-COMP-2012 default unsat ✅ 0.04745 —
simplifyingSTP-SMT-COMP-2010 default unsat ✅ 0.04834 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 0.05754 —
Z3-SMT-COMP-2011 default unknown ❌ — —
SMT-COMP 2017 Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 0.07276 0.07213
Boolector SMT17 final boolector unsat ✅ 0.07760 0.07096
CVC4 CVC4-smtcomp2017-main default unsat ✅ 3.51614 6.85965
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.09224 0.09197
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 0.19698 0.19684
Q3B Q3B default unsat ✅ 0.42853 1.01187
STP stp_st default unsat ✅ 0.05678 0.05583
stp_mt default unsat ✅ 0.06307 0.06168
Yices2 Yices2-Main default unsat ✅ 0.03233 0.03158
Z3 z3-4.5.0 default unsat ✅ 0.13516 0.13344
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 0.07804 0.07795
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 2.00981 2.00965
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 0.09010 0.09110
MinkeyRink Minkeyrink MT_mt unsat ✅ 0.20041 0.20043
Minkeyrink ST_st unsat ✅ 0.20089 0.20073
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 0.14748 0.14755
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 0.14742 0.14743
STP-Riss-st-2018_riss-no-stderr unsat ✅ 0.14824 0.14824
Yices2 Yices 2.6.0_default unsat ✅ 0.03394 0.03383
Z3 z3-4.7.1_default unsat ✅ 0.27909 0.27898
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default unsat ✅ 0.13530 0.13529
Poolector-wrapped-sq_default unsat ✅ 0.27163 0.67458
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default unsat ✅ 0.12673 0.12657
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 1.74721 1.74747
MinkeyRink MinkeyRink MT-wrapped-sq_default unsat ✅ 0.29993 0.30006
MinkeyRink ST-wrapped-sq_default unsat ✅ 0.29836 0.29847
Par4 Par4-wrapped-sq_default unsat ✅ 0.04186 0.00604
STP STP-2019-wrapped-sq_default unsat ✅ 0.06171 0.06185
stp-mergesat-fixed-wrapped-sq_default unsat ✅ 0.06140 0.06152
stp-minisat-wrapped-sq_default unsat ✅ 0.06111 0.06128
stp-mt-wrapped-sq_default unsat ✅ 0.06172 0.06187
stp-portfolio-fixed-wrapped-sq_default unsat ✅ 0.06146 0.06160
stp-riss-wrapped-sq_default unsat ✅ 0.06097 0.06112
Yices2 Yices 2.6.2-wrapped-sq_default unsat ✅ 0.03400 0.03392
Yices 2.6.2 Cadical-wrapped-sq_default unsat ✅ 0.03429 0.03427
Yices 2.6.2 Cryptominisat-wrapped-sq_default unsat ✅ 0.03435 0.03438
Yices 2.6.2 MCSAT BV-wrapped-sq_default unsat ✅ 0.03393 0.03392
Yices 2.6.2 new bvsolver-wrapped-sq_default unsat ✅ 0.03376 0.03375
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 0.26999 0.26996
SMT-COMP 2022 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.11104 0.11096
Bitwuzla-wrapped_default unsat ✅ 0.11843 0.11834
cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq unsat ✅ 2.05742 2.05775
MathSAT MathSAT-5.6.8_default unsat ✅ 4.58702 4.58493
STP STP 2022.4_default unsat ✅ 0.05402 0.05403
Yices2 Yices 2.6.2 for SMTCOMP 2021_default unsat ✅ 0.03896 0.03881
Z3++BV z3++bv_0702_default unsat ✅ 95.64690 95.63970
Z3 z3-4.8.17_default unsat ✅ 0.29429 0.29601
SMT-COMP 2023 Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.16589 0.16582
cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 1.98460 1.98459
STP STP 2022.4_default unsat ✅ 0.05388 0.05393
STP 2022.4_default unsat ✅ 0.05425 0.05422
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unsat ✅ 12.78950 38.24780
Yices2 Yices 2 for SMTCOMP 2023_default unsat ✅ 0.03678 0.03675
Z3-Owl z3-Owl-Final_default unsat ✅ 0.91867 0.91861
z3-Owl-Final_default unsat ✅ 0.92927 0.92933