Benchmark

non-incremental/QF_LIA/nec-smt/large/checkpass_pwd/prp-50-49.smt2

http://www.nec-labs.com/~fsoft/bench.html 
 The following changes have been made: 
 The logic is changed to QF_LIA. 
 The category is set as industrial. 
 The status (except 'large' cases) is assigned according to the 'outfile' on http://www.nec-labs.com/~fsoft/bench.html.
Benchmark
Size377556
Compressed Size79620
License Creative Commons Attribution 4.0 International (CC-BY-4.0)
Categoryindustrial
First Occurrence2008-07-07
Generated By
Generated On
Generator
Dolmen OK1
strict Dolmen OK1
check-sat calls1
Query 1
Status sat
Inferred Status sat
Size 377548
Compressed Size79626
Max. Term Depth1891
Asserts 1
Declared Functions0
Declared Constants119
Declared Sorts 0
Defined Functions0
Defined Recursive Functions 0
Defined Sorts0
Constants0
Declared Datatypes0

Symbols

true1 ite9736 not2214 and8
=4808 let1693 +1231 -347
*104 <=471

Evaluations

Evaluation Rating Solver Variant Result Wallclock CPU Time
SMT Evaluation 2013 0.17 (5/6) CVC3 CVC3-SMT-COMP-2010 default unknown ❌
CVC3-SMT-COMP-2011 default sat ✅ 1456.20000
CVC3-SMT-COMP-2012 default sat ✅ 1460.20000
CVC4 CVC4-SMT-COMP-2012-Resubmission default sat ✅ 65.45690
CVC4-SMT-EVAL-2013 default sat ✅ 63.75500
MathSAT MathSAT5-5.2.6-SMT-EVAL-2013 default sat ✅ 39.62760
MathSAT5-SMT-COMP-2010 default sat ✅ 54.91490
MathSAT5-SMT-COMP-2011 default sat ✅ 39.15500
MathSAT5-SMT-COMP-2012 default sat ✅ 27.92320
test_pmathsat-SMT-COMP-2010 default sat ✅ 53.14070
SMTInterpol SMTInterpol-2.0r8402-SMT-EVAL-2013 default sat ✅ 26.82670
SMTInterpol-SMT-COMP-2011 default unknown ❌
SMTInterpol-SMT-COMP-2012 default unknown ❌
veriT veriT-SMT-EVAL-2013 default unknown ❌
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-EVAL-2013 default sat ✅ 110.94300
Z3-SMT-COMP-2011 default sat ✅ 73.84120
SMT-COMP 2014 0.17 (5/6) CVC4 CVC4 f7118b2 default sat ✅ 34.42630 34.41380
MathSAT MathSAT-5.2.12-Main default sat ✅ 30.26210 30.26340
SMTInterpol smtinterpol-2.1-118-g3dada2f default sat ✅ 26.19710 36.95540
veriT veriT-smtcomp2014 default unknown ❌ 2399.01000 2400.04000
Yices2 Yices-2.2.1-smtcomp2014 default sat ✅ 9.08503 9.07962
Z3 Z3-4.3.2.a054b099c1d6-x64-debian-6.0.6-SMT-COMP-2014 default sat ✅ 133.53900 133.49600
SMT-COMP 2015 0.29 (5/7) CVC4 CVC4-master-2015-06-15-9b32405-main default sat ✅ 34.17770 34.19280
CVC4-experimental-2015-06-15-ff5745a-main default sat ✅ 34.25540 34.26680
MathSAT MathSat 5.3.6 main smtcomp2015_main sat ✅ 31.64730 31.65820
SMTInterpol SMTInterpol v2.1-206-g86e9531 default sat ✅ 20.37200 34.55570
SMT-RAT SMT-RAT-final default unknown ❌ 2400.01000 2400.93000
veriT veriT default unknown ❌ 2400.04000 2400.88000
Yices2 Yices default sat ✅ 11.87980 11.88320
Z3 z3 4.4.0 default sat ✅ 103.58000 103.62300
SMT-COMP 2016 0.38 (5/8) CVC4 CVC4-master-2016-05-27-cfef263-main default sat ✅ 34.01470 34.03200
MathSAT mathsat-5.3.11-linux-x86_64-Main default sat ✅ 32.87240 32.89210
ProB ProB competition unknown ❌ 2400.04000 2401.41000
SMTInterpol smtinterpol-2.1-258-g92ab3df default sat ✅ 20.25240 37.35660
SMT-RAT SMT-RAT default unknown ❌ 2400.06000 2401.43000
veriT veriT-dev default unknown ❌ 2400.05000 2401.41000
Yices2 Yices-2.4.2 default sat ✅ 12.79400 12.80010
Z3 z3-4.4.1 default sat ✅ 99.85360 99.90340
SMT-COMP 2017 0.29 (5/7) CVC4 CVC4-smtcomp2017-main default sat ✅ 54.74960 54.73300
MathSAT mathsat-5.4.1-linux-x86_64-Main default sat ✅ 15.44830 15.44820
SMTInterpol SMTInterpol default sat ✅ 56.88450 54.65960
SMT-RAT SMTRAT-comp2017_2 default unknown ❌ 600.04200 600.02500
veriT veriT-2017-06-17 default unknown ❌ 600.01900 599.92200
Yices2 Yices2-Main default sat ✅ 11.04420 11.04270
Z3 z3-4.5.0 default sat ✅ 95.21070 95.19900
SMT-COMP 2018 0.25 (6/8) Ctrl-Ergo Ctrl-Ergo-SMTComp-2018_default sat ✅ 23.84920 94.59000
CVC4 master-2018-06-10-b19c840-competition-default_default sat ✅ 38.69750 38.69720
MathSAT mathsat-5.5.2-linux-x86_64-Main_default sat ✅ 142.43000 142.43500
SMTInterpol SMTInterpol-2.5-19-g0d39cdee_default sat ✅ 40.21920 55.38070
SMT-RAT SMTRAT-Rat-final_default unknown ❌ 1200.05000 1199.84000
veriT veriT_default unknown ❌ 1200.08000 1199.93000
Yices2 Yices 2.6.0_default sat ✅ 10.15720 10.15740
Z3 z3-4.7.1_default sat ✅ 109.24600 109.23700
SMT-COMP 2020 0.14 (6/7) CVC4 CVC4-sq-final_default sat ✅ 32.10620 32.10530
MathSAT MathSAT5_default.sh sat ✅ 284.59400 284.49300
Par4 Par4-wrapped-sq_default sat ✅ 11.96230 35.75000
SMTInterpol smtinterpol-2.5-679-gacfde87a_default sat ✅ 92.81130 121.06000
veriT veriT_default unknown ❌ 1200.05000 1199.96000
Yices2 Yices 2.6.2 bug fix_default sat ✅ 10.54770 10.54700
Z3 z3-4.8.8_default sat ✅ 198.52000 198.43600
SMT-COMP 2021 0.29 (5/7) cvc5 cvc5-fixed_default sat ✅ 277.95100 277.94700
MathSAT mathsat-5.6.6_default sat ✅ 244.88300 244.64000
OpenSMT OpenSMT-fixed_default sat ✅ 992.67900 992.56300
Par4 Par4-wrapped-sq_default sat ✅ 11.42600 34.12000
SMTInterpol smtinterpol-2.5-823-g881e8631_default sat ✅ 68.01460 97.82160
veriT veriT_default unknown ❌ 1200.03000 1199.99000
Z3 z3-4.8.11_default unknown ❌ 1200.06000 1199.87000
SMT-COMP 2022 0.17 (5/6) cvc5 cvc5-default-2022-07-02-b15e116-wrapped_sq sat ✅ 290.48200 290.45800
MathSAT MathSAT-5.6.8_default sat ✅ 216.40900 216.39700
Par4 Par4-wrapped-sq_default sat ✅ 8.90679 26.43000
veriT veriT_default unknown ❌ 1200.02000 1199.71000
Yices2 Yices 2.6.2 for SMTCOMP 2021_default sat ✅ 11.12040 11.11870
Z3 z3-4.8.17_default sat ✅ 64.82860 64.82230
SMT-COMP 2023 cvc5 cvc5-default-2023-05-16-ea045f305_sq sat ✅ 288.90500 288.83900
OpenSMT OpenSMT a78dcf01_default sat ✅ 679.78900 679.70600
Par4 Par4-wrapped-sq_default sat ✅ 11.72820 34.98000
SMTInterpol smtinterpol-2.5-1272-g2d6d356c_default sat ✅ 60.58650 88.46010
Yices2 Yices 2 for SMTCOMP 2023_default sat ✅ 12.41950 12.41020
Z3++ Z3++_sq_0526_default sat ✅ 53.16520 53.13040
SMT-COMP 2024 cvc5 cvc5 sat ✅ 197.73094 197.61262
OpenSMT OpenSMT sat ✅ 957.42062 957.00052
SMTInterpol SMTInterpol sat ✅ 51.53665 76.85898
Yices2 Yices2 sat ✅ 6.47543 6.37342
Z3alpha Z3-alpha sat ✅ 1136.88338 1136.75566
SMT-COMP 2025 0.17 (5/6) cvc5 cvc5 sat ✅ 165.73366 165.59261
OpenSMT OpenSMT sat ✅ 589.76882 589.57877
SMTInterpol SMTInterpol sat ✅ 141.67196 171.47380
Yices2 Yices2 sat ✅ 7.64268 7.51231
Z3alpha Z3-alpha sat ✅ 113.69400 442.38205
Z3 Z3-alpha-base unknown ❌ 1201.31289 1201.08603