Benchmark

non-incremental/QF_BV/sage/app1/bench_2652.smt2 

Patrice Godefroid, SAGE (systematic dynamic test generation)
 For more information: http://research.microsoft.com/en-us/um/people/pg/public_psfiles/ndss2008.pdf
Benchmark
Size63539
Compressed Size8662
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2009-08-02
Generated By—
Generated On—
Generator—
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status unsat
Inferred Status unsat
Size 63531
Compressed Size8681
Max. Term Depth125
Asserts 1
Declared Functions0
Declared Constants285
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 ite54 not69 and1
=174 let115 extract1 bvand32
bvor171 bvadd328 bvmul5 bvsub168
bvult196 bvule440 bvslt1 bvsle28
bvshl172 bvashr5 zero_extend282

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 4Simp 4Simp-SMT-COMP-2012 default unsat ✅ 1.00258 —
Abziz abziz_portfolio_2011_minfeatures_2 default unsat ✅ 0.41302 —
abziz_portfolio_2011_solvers_2 default unsat ✅ 0.40895 —
abziz_portfolio_2012_minfeatures default unsat ✅ 0.41613 —
abziz_portfolio_2012_solvers default unsat ✅ 0.41984 —
AbzizPortfolio-SMT-COMP-2012 default unsat ✅ 0.44743 —
Boolector Boolector-1.5.118-SMT-EVAL-2013 default unsat ✅ 0.09559 —
Boolector-SMT-COMP-2011 default unsat ✅ 0.47655 —
Boolector-SMT-COMP-2012 default unsat ✅ 0.08533 —
CVC3 CVC3-SMT-COMP-2010 default unsat ✅ 19.52850 —
CVC3-SMT-COMP-2011 default unsat ✅ 18.59660 —
CVC3-SMT-COMP-2012 default unsat ✅ 18.82730 —
CVC4 CVC4-SMT-COMP-2012-Resubmission default unsat ✅ 0.45789 —
CVC4-SMT-EVAL-2013 default unsat ✅ 0.60162 —
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default unsat ✅ 0.24150 —
MathSAT5-HeavyBV-SMT-COMP-2012 default unsat ✅ 1.37282 —
MathSAT5-SMT-COMP-2011 default unsat ✅ 0.23951 —
MathSAT5-SMT-COMP-2012 default unsat ✅ 0.23698 —
SONOLAR SONOLAR-2013-05-15-SMT-EVAL-2013 default unsat ✅ 0.43122 —
SONOLAR-SMT-COMP-2010 default unsat ✅ 0.48650 —
SONOLAR-SMT-COMP-2011 default unsat ✅ 0.85762 —
SONOLAR-SMT-COMP-2012 default unsat ✅ 0.41067 —
STP STP2-SMT-COMP-2011 default unsat ✅ 0.42488 —
STP2-SMT-COMP-2012 default unsat ✅ 0.79953 —
simplifyingSTP-SMT-COMP-2010 default unsat ✅ 0.57468 —
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default unsat ✅ 0.46341 —
Z3-SMT-COMP-2011 default unsat ✅ 0.41108 —
SMT-COMP 2015 Boolector Boolector SMT15 QF_BV final boolector_qf_bv unsat ✅ 0.33074 0.32995
CVC4 CVC4-master-2015-06-15-9b32405-main default unsat ✅ 1.13407 2.22066
CVC4-experimental-2015-06-15-ff5745a-main default unsat ✅ 1.09955 2.14967
MathSAT MathSat 5.3.6 main smtcomp2015_main unsat ✅ 0.81867 0.81787
SMT-RAT SMT-RAT-final default unsat ✅ 65.46480 65.47900
STP stp-cryptominisat4 default unsat ✅ 0.73377 0.73289
stp-cmsat4-v15 default unsat ✅ 0.46313 0.46193
stp-cmsat4-mt-v15 default unknown ❌ 0.41208 0.41094
stp-minisat-v15 default unsat ✅ 0.43028 0.42893
Yices2 Yices default unsat ✅ 0.03843 0.03699
Z3 z3 4.4.0 default unsat ✅ 0.85925 0.85987
SMT-COMP 2016 0.10 (9/10) ABC ABC_default default_abc unsat ✅ 0.75402 0.75411
ABC_glucose glucose unsat ✅ 9.54450 9.54955
Boolector Boolector boolector unsat ✅ 0.22859 0.22869
Boolector preprop boolector unsat ✅ 0.23943 0.23954
CVC4 CVC4-master-2016-05-27-cfef263-main default unsat ✅ 0.93963 1.83357
MapleSTP MapleSTP default unsat ✅ 0.82436 0.82477
MapleSTP-mt default unsat ✅ 0.98557 2.74933
MathSAT mathsat-5.3.11-linux-x86_64-Main default unsat ✅ 0.93556 0.93706
MinkeyRink Minkeyrink 2016 default unsat ✅ 1.65468 2.30970
Q3B Q3B default unknown ❌ 2400.02000 7203.32000
STP stp-cms-exp-2016 default unsat ✅ 0.95835 0.95894
stp-cms-mt-2016 default unsat ✅ 1.02771 2.89528
stp-cms-st-2016 default unsat ✅ 0.85313 0.85358
stp-minisat-st-2016 default unsat ✅ 0.57686 0.57715
Yices2 Yices-2.4.2 default unsat ✅ 0.03563 0.03557
Z3 z3-4.4.1 default unsat ✅ 0.52003 0.52163
SMT-COMP 2017 0.12 (7/8) Boolector Boolector+CaDiCaL SMT17 final boolector unsat ✅ 0.21300 0.21218
Boolector SMT17 final boolector unsat ✅ 0.62777 0.38987
CVC4 CVC4-smtcomp2017-main default unsat ✅ 1.02414 2.00108
MathSAT mathsat-5.4.1-linux-x86_64-Main default unsat ✅ 0.81980 0.81992
MinkeyRink MinkeyRink 2017.3a default unsat ✅ 0.52323 0.49595
Q3B Q3B default unknown ❌ 600.04000 1787.04000
STP stp_st default unsat ✅ 1.00984 1.00902
stp_mt default unsat ✅ 1.55579 3.12769
Yices2 Yices2-Main default unsat ✅ 0.03686 0.03679
Z3 z3-4.5.0 default unsat ✅ 0.89447 0.89359
SMT-COMP 2018 Boolector Boolector_default unsat ✅ 0.17568 0.17557
CVC4 master-2018-06-10-b19c840-competition-default_default unsat ✅ 1.67806 1.67821
MathSAT mathsat-5.5.2-linux-x86_64-Main_default unsat ✅ 0.83883 0.83989
MinkeyRink Minkeyrink MT_mt unsat ✅ 0.28868 0.36993
Minkeyrink ST_st unsat ✅ 0.27752 0.27767
STP STP-CMS-st-2018_default-no-stderr unsat ✅ 0.46616 0.46620
STP-CMS-mt-2018_multicore-no-stderr unsat ✅ 0.50124 0.72327
STP-Riss-st-2018_riss-no-stderr unsat ✅ 0.68181 0.68188
Yices2 Yices 2.6.0_default unsat ✅ 0.03745 0.03735
Z3 z3-4.7.1_default unsat ✅ 0.55886 0.55877
SMT-COMP 2019 Boolector Boolector-wrapped-sq_default unsat ✅ 0.26163 0.26160
Poolector-wrapped-sq_default unsat ✅ 0.28014 0.24395
Boolector-ReasonLS boolector-ReasonLS-wrapped-sq_default unsat ✅ 0.24940 0.24940
CVC4 CVC4-2019-06-03-d350fe1-wrapped-sq_default unsat ✅ 0.73275 0.73293
MinkeyRink MinkeyRink MT-wrapped-sq_default unsat ✅ 0.26678 0.32741
MinkeyRink ST-wrapped-sq_default unsat ✅ 0.24123 0.24124
Par4 Par4-wrapped-sq_default unsat ✅ 0.04049 0.00608
STP STP-2019-wrapped-sq_default unsat ✅ 0.48263 0.48303
stp-mergesat-fixed-wrapped-sq_default unsat ✅ 0.74064 0.74082
stp-minisat-wrapped-sq_default unsat ✅ 0.51693 0.51708
stp-mt-wrapped-sq_default unsat ✅ 0.52468 0.69140
stp-portfolio-fixed-wrapped-sq_default unsat ✅ 0.78656 1.02247
stp-riss-wrapped-sq_default unknown ❌ 0.46138 0.46157
Yices2 Yices 2.6.2-wrapped-sq_default unsat ✅ 0.03656 0.03658
Yices 2.6.2 Cadical-wrapped-sq_default unsat ✅ 0.07425 0.07424
Yices 2.6.2 Cryptominisat-wrapped-sq_default unsat ✅ 0.06318 0.06312
Yices 2.6.2 MCSAT BV-wrapped-sq_default unsat ✅ 0.08949 0.08948
Yices 2.6.2 new bvsolver-wrapped-sq_default unsat ✅ 0.07681 0.07681
Z3 z3-4.8.4-d6df51951f4c-wrapped-sq_default unsat ✅ 1.15357 1.15274
SMT-COMP 2023 0.17 (5/6) Bitwuzla Bitwuzla-fixed_default unsat ✅ 0.61882 0.61852
cvc5 cvc5-default-2023-05-16-ea045f305_sq unsat ✅ 1.16462 1.16517
STP STP 2022.4_default unsat ✅ 0.08421 0.08422
STP 2022.4_default unsat ✅ 0.08450 0.08451
UltimateEliminator UltimateIntBlastingWrapper+SMTInterpol_default unknown ❌ 1200.02000 1255.09000
Yices2 Yices 2 for SMTCOMP 2023_default unsat ✅ 0.03968 0.03964
Z3-Owl z3-Owl-Final_default unsat ✅ 14.02590 14.02590
z3-Owl-Final_default unsat ✅ 14.06560 14.06490